Commits

Branch selector

 c9720b2

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 21, 2016

• [STREAMING][KAFKA][DOC] clarify kafka settings needed for larger batches

  Show description for c9720b2
  

  koeninger

  authored and

  zsxwing

  committed
  c9720b2

  Copy full SHA for c9720b2

• [SPARK-17812][SQL][KAFKA] Assign and specific startingOffsets for structured stream

  Show description for 268ccb9
  

  koeninger

  authored and

  zsxwing

  committed
  268ccb9

  Copy full SHA for 268ccb9

• [SPARK-18044][STREAMING] FileStreamSource should not infer partitions in every batch

  Show description for 1405702
  

  cloud-fan

  authored and

  zsxwing

  committed
  1405702

  Copy full SHA for 1405702

• [SPARK-17929][CORE] Fix deadlock when CoarseGrainedSchedulerBackend reset

  Show description for c1f344f
  

  scwf

  authored and

  zsxwing

  committed
  c1f344f

  Copy full SHA for c1f344f

• [SPARK-17926][SQL][STREAMING] Added json for statuses

  Show description for 7a531e3
  

  tdas

  authored and

  yhuai

  committed
  7a531e3

  Copy full SHA for 7a531e3

• [SPARK-17811] SparkR cannot parallelize data.frame with NA or NULL in Date columns

  Show description for e371040
  

  falaki

  authored and

  Felix Cheung

  committed
  e371040

  Copy full SHA for e371040

• [SPARK-18013][SPARKR] add crossJoin API

  Show description for e21e1c9
  

  felixcheung

  authored and

  Felix Cheung

  committed
  e21e1c9

  Copy full SHA for e21e1c9

• [SPARK-17674][SPARKR] check for warning in test output

  Show description for 4efdc76
  

  felixcheung

  authored and

  Felix Cheung

  committed
  4efdc76

  Copy full SHA for 4efdc76

• [SPARK-18034] Upgrade to MiMa 0.1.11 to fix flakiness

  Show description for b3b4b95
  JoshRosen

  committed
  b3b4b95

  Copy full SHA for b3b4b95

• [SPARK-13275][WEB UI] Visually clarified executors start time in timeline

  Show description for 3a23751
  

  ajbozarth

  authored and

  srowen

  committed
  3a23751

  Copy full SHA for 3a23751

• [SPARK-17331][FOLLOWUP][ML][CORE] Avoid allocating 0-length arrays

  Show description for a8ea4da
  

  zhengruifeng

  authored and

  srowen

  committed
  a8ea4da

  Copy full SHA for a8ea4da

• [SPARK-17960][PYSPARK][UPGRADE TO PY4J 0.10.4]

  Show description for 595893d
  

  jagadeesanas2

  authored and

  srowen

  committed
  595893d

  Copy full SHA for 595893d

• [SPARK-18029][SQL] PruneFileSourcePartitions should not change the output of LogicalRelation

  Show description for 57e97fc
  cloud-fan

  committed
  57e97fc

  Copy full SHA for 57e97fc

• [SPARKR] fix warnings

  Show description for 3180272
  

  felixcheung

  authored and

  Felix Cheung

  committed
  3180272

  Copy full SHA for 3180272

• [SPARK-18030][TESTS] Adds more checks to collect more info about FileStreamSourceSuite failure

  Show description for 1bb99c4
  zsxwing

  committed
  1bb99c4

  Copy full SHA for 1bb99c4

Commits on Oct 20, 2016

• [DOCS] Update docs to not suggest to package Spark before running tests.

  Show description for 2d14ab7
  

  markgrover

  authored and

  Marcelo Vanzin

  committed
  2d14ab7

  Copy full SHA for 2d14ab7

• [SPARK-18021][SQL] Refactor file name specification for data sources

  Show description for 7f9ec19
  rxin

  committed
  7f9ec19

  Copy full SHA for 7f9ec19

• [SPARK-17999][KAFKA][SQL] Add getPreferredLocations for KafkaSourceRDD

  Show description for 947f4f2
  

  jerryshao

  authored and

  zsxwing

  committed
  947f4f2

  Copy full SHA for 947f4f2

• [SPARK-15780][SQL] Support mapValues on KeyValueGroupedDataset

  Show description for 84b245f
  

  koertkuipers

  authored and

  rxin

  committed
  84b245f

  Copy full SHA for 84b245f

• [SPARK-17698][SQL] Join predicates should not contain filter clauses

  Show description for fb0894b
  

  tejasapatil

  authored and

  rxin

  committed
  fb0894b

  Copy full SHA for fb0894b

• [SPARK-17860][SQL] SHOW COLUMN's database conflict check should respect case sensitivity configuration

  Show description for e895bc2
  

  dilipbiswal

  authored and

  cloud-fan

  committed
  e895bc2

  Copy full SHA for e895bc2

• [SPARK-17796][SQL] Support wildcard character in filename for LOAD DATA LOCAL INPATH

  Show description for 986a3b8
  

  dongjoon-hyun

  authored and

  srowen

  committed
  986a3b8

  Copy full SHA for 986a3b8

• [SPARK-11653][DEPLOY] Allow spark-daemon.sh to run in the foreground

  Show description for c2c107a
  

  mikejihbe

  authored and

  srowen

  committed
  c2c107a

  Copy full SHA for c2c107a

• [SPARK-17991][SQL] Enable metastore partition pruning by default.

  Show description for 4bd17c4
  

  ericl

  authored and

  rxin

  committed
  4bd17c4

  Copy full SHA for 4bd17c4

• [SPARK-18003][SPARK CORE] Fix bug of RDD zipWithIndex & zipWithUniqueId index value overflowing

  Show description for 3975516
  

  WeichenXu123

  authored and

  rxin

  committed
  3975516

  Copy full SHA for 3975516

• [SPARK-18012][SQL] Simplify WriterContainer

  Show description for f313117
  

  rxin

  authored and

  liancheng

  committed
  f313117

  Copy full SHA for f313117

• [SPARK-17989][SQL] Check ascendingOrder type in sort_array function rather than throwing ClassCastException

  Show description for 4b2011e
  

  HyukjinKwon

  authored and

  rxin

  committed
  4b2011e

  Copy full SHA for 4b2011e

Commits on Oct 19, 2016

• [SPARK-10541][WEB UI] Allow ApplicationHistoryProviders to provide their own text when there aren't any complete apps

  Show description for 444c2d2
  

  ajbozarth

  authored and

  Marcelo Vanzin

  committed
  444c2d2

  Copy full SHA for 444c2d2

• [SPARK-17985][CORE] Bump commons-lang3 version to 3.5.

  Show description for 9540357
  

  ueshin

  authored and

  srowen

  committed
  9540357

  Copy full SHA for 9540357

• [SPARK-18001][DOCUMENT] fix broke link to SparkDataFrame

  Show description for f39852e
  

  Wenpei

  authored and

  rxin

  committed
  f39852e

  Copy full SHA for f39852e

• [SPARK-17873][SQL] ALTER TABLE RENAME TO should allow users to specify database in destination table name(but have to be same as source table)

  Show description for 4329c5c
  

  cloud-fan

  authored and

  yhuai

  committed
  4329c5c

  Copy full SHA for 4329c5c

• [SPARK-17711][TEST-HADOOP2.2] Fix hadoop2.2 compilation error

  Show description for 2629cd7
  

  loneknightpy

  authored and

  zsxwing

  committed
  2629cd7

  Copy full SHA for 2629cd7

• [SPARK-17980][SQL] Fix refreshByPath for converted Hive tables

  Show description for 5f20ae0
  

  ericl

  authored and

  cloud-fan

  committed
  5f20ae0

  Copy full SHA for 5f20ae0

• [SPARK-17731][SQL][STREAMING][FOLLOWUP] Refactored StreamingQueryListener APIs

  Show description for 941b3f9
  tdas

  committed
  941b3f9

  Copy full SHA for 941b3f9

Commits on Oct 18, 2016

• [SPARK-17817] [PYSPARK] [FOLLOWUP] PySpark RDD Repartitioning Results in Highly Skewed Partition Sizes

  Show description for 1e35e96
  

  viirya

  authored and

  davies

  committed
  1e35e96

  Copy full SHA for 1e35e96

Pagination

Previous

Next