Commits

Branch selector

 master

User selector

lianhuiwang

Datepicker

All time

Commit History

Commits on Jun 14, 2017

• [SPARK-20986][SQL] Reset table's statistics after PruneFileSourcePartitions rule.

  Show description for 8b5b2e2
  

  lianhuiwang

  authored and

  cloud-fan

  committed
  8b5b2e2

  Copy full SHA for 8b5b2e2

Commits on Sep 2, 2016

• [SPARK-16302][SQL] Set the right number of partitions for reading data from a local collection.

  Show description for 06e3398
  

  lianhuiwang

  authored and

  JoshRosen

  committed
  06e3398

  Copy full SHA for 06e3398

Commits on Jul 12, 2016

• [SPARK-15752][SQL] Optimize metadata only query that has an aggregate whose children are deterministic project or filter operators.

  Show description for 5ad68ba
  

  lianhuiwang

  authored and

  hvanhovell

  committed
  5ad68ba

  Copy full SHA for 5ad68ba

Commits on Jun 4, 2016

• [SPARK-15756][SQL] Support command 'create table stored as orcfile/parquetfile/avrofile'

  Show description for 2ca563c
  

  lianhuiwang

  authored and

  rxin

  committed
  2ca563c

  Copy full SHA for 2ca563c

Commits on Jun 1, 2016

• [SPARK-15664][MLLIB] Replace FileSystem.get(conf) with path.getFileSystem(conf) when removing CheckpointFile in MLlib

  Show description for 6563d72
  

  lianhuiwang

  authored and

  srowen

  committed
  6563d72

  Copy full SHA for 6563d72

Commits on May 31, 2016

• [SPARK-15649][SQL] Avoid to serialize MetastoreRelation in HiveTableScanExec

  Show description for 2bfc4f1
  

  lianhuiwang

  authored and

  rxin

  committed
  2bfc4f1

  Copy full SHA for 2bfc4f1

Commits on May 20, 2016

• [SPARK-15335][SQL] Implement TRUNCATE TABLE Command

  Show description for 09a0051
  

  lianhuiwang

  authored and

  rxin

  committed
  09a0051

  Copy full SHA for 09a0051

Commits on May 11, 2016

• [SPARK-15246][SPARK-4452][CORE] Fix code style and improve volatile for

  Show description for 9f0a642
  

  lianhuiwang

  authored and

  rxin

  committed
  9f0a642

  Copy full SHA for 9f0a642

Commits on Apr 25, 2016

• [SPARK-14731][shuffle]Revert SPARK-12130 to make 2.0 shuffle service compatible with 1.x

  Show description for 6bfe42a
  

  lianhuiwang

  authored and

  Marcelo Vanzin

  committed
  6bfe42a

  Copy full SHA for 6bfe42a

Commits on Apr 21, 2016

• [SPARK-4452] [CORE] Shuffle data structures can starve others on the same thread for memory

  Show description for 4f36917
  

  lianhuiwang

  authored and

  davies

  committed
  4f36917

  Copy full SHA for 4f36917

Commits on Apr 20, 2016

• [SPARK-14705][YARN] support Multiple FileSystem for YARN STAGING DIR

  Show description for 4514aeb
  

  lianhuiwang

  authored and

  Marcelo Vanzin

  committed
  4514aeb

  Copy full SHA for 4514aeb

Commits on Feb 23, 2016

• [SPARK-7729][UI] Executor which has been killed should also be displayed on Executor Tab

  Show description for 9f42633
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  9f42633

  Copy full SHA for 9f42633

Commits on Dec 16, 2015

• [SPARK-12130] Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver

  Show description for 369127f
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  369127f

  Copy full SHA for 369127f

Commits on Nov 10, 2015

• [SPARK-11252][NETWORK] ShuffleClient should release connection after fetching blocks had been completed for external shuffle

  Show description for 6e5fc37
  

  lianhuiwang

  authored and

  Marcelo Vanzin

  committed
  6e5fc37

  Copy full SHA for 6e5fc37

Commits on Oct 13, 2015

• [SPARK-11026] [YARN] spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

  Show description for 626aab7
  

  lianhuiwang

  authored and

  Tom Graves

  committed
  626aab7

  Copy full SHA for 626aab7

Commits on Jul 17, 2015

• [SPARK-8646] PySpark does not run on YARN if master not provided in command line

  Show description for 49351c7
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  49351c7

  Copy full SHA for 49351c7

Commits on Jun 19, 2015

• [SPARK-8430] ExternalShuffleBlockResolver of shuffle service should support UnsafeShuffleManager

  Show description for 9baf093
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  9baf093

  Copy full SHA for 9baf093

Commits on Jun 18, 2015

• [SPARK-8381][SQL]reuse typeConvert when convert Seq[Row] to catalyst type

  Show description for 9db73ec
  

  lianhuiwang

  authored and

  JoshRosen

  committed
  9db73ec

  Copy full SHA for 9db73ec

Commits on May 8, 2015

• [SPARK-6869] [PYSPARK] Add pyspark archives path to PYTHONPATH

  Show description for ebff732
  

  lianhuiwang

  authored and

  tgravescs

  committed
  ebff732

  Copy full SHA for ebff732

Commits on Mar 2, 2015

• [SPARK-6103][Graphx]remove unused class to import in EdgeRDDImpl

  Show description for 49c7a8f
  

  lianhuiwang

  authored and

  srowen

  committed
  49c7a8f

  Copy full SHA for 49c7a8f

Commits on Feb 12, 2015

• [SPARK-5759][Yarn]ExecutorRunnable should catch YarnException while NMClient start contain...

  Show description for 947b8bd
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  947b8bd

  Copy full SHA for 947b8bd

Commits on Feb 6, 2015

• [SPARK-4994][network]Cleanup removed executors' ShuffleInfo in yarn shuffle service

  Show description for 61073f8
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  61073f8

  Copy full SHA for 61073f8

• [SPARK-5593][Core]Replace BlockManagerListener with ExecutorListener in ExecutorAllocationListener

  Show description for 6072fcc
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  6072fcc

  Copy full SHA for 6072fcc

• [SPARK-5653][YARN] In ApplicationMaster rename isDriver to isClusterMode

  Show description for cc6e531
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  cc6e531

  Copy full SHA for cc6e531

• [SPARK-5470][Core]use defaultClassLoader to load classes in KryoSerializer

  Show description for ed3aac7
  

  lianhuiwang

  authored and

  srowen

  committed
  ed3aac7

  Copy full SHA for ed3aac7

Commits on Feb 2, 2015

• [SPARK-5173]support python application running on yarn cluster mode

  Show description for f5e6375
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  f5e6375

  Copy full SHA for f5e6375

Commits on Jan 28, 2015

• [SPARK-4955]With executor dynamic scaling enabled,executor shoude be added or killed in yarn-cluster mode.

  Show description for 81f8f34
  

  lianhuiwang

  authored and

  Andrew Or

  committed
  81f8f34

  Copy full SHA for 81f8f34

Commits on Jan 12, 2015

• [SPARK-5102][Core]subclass of MapStatus needs to be registered with Kryo

  Show description for ef9224e
  

  lianhuiwang

  authored and

  pwendell

  committed
  ef9224e

  Copy full SHA for ef9224e

Commits on Nov 6, 2014

• [SPARK-4249][GraphX]fix a problem of EdgePartitionBuilder in Graphx

  Show description for d15c6e9
  

  lianhuiwang

  authored and

  ankurdave

  committed
  d15c6e9

  Copy full SHA for d15c6e9

Commits on Jul 20, 2014

• [SPARK-2524] missing document about spark.deploy.retainedDrivers

  Show description for 4da01e3
  

  lianhuiwang

  authored and

  pwendell

  committed
  4da01e3

  Copy full SHA for 4da01e3

Commits on Jul 15, 2014

• discarded exceeded completedDrivers

  Show description for 7446f5f
  

  lianhuiwang

  authored and

  rxin

  committed
  7446f5f

  Copy full SHA for 7446f5f

Commits on May 27, 2014

• bugfix worker DriverStateChanged state should match DriverState.FAILED

  Show description for 95e4c9c
  

  lianhuiwang

  authored and

  aarondav

  committed
  95e4c9c

  Copy full SHA for 95e4c9c