Commits

Branch selector

 master

User selector

weixiuli

Datepicker

All time

Commit History

Commits on Jun 29, 2022

• [SPARK-32170][CORE] Improve the speculation through the stage task metrics

  Show description for 6f1046a
  

  weixiuli

  authored and

  Ngone51

  committed
  6f1046a

  Copy full SHA for 6f1046a

Commits on Apr 18, 2022

• [SPARK-38856][SHUFFLE] Fix a rejectedExecutionException error when push-based shuffle is enabled

  Show description for 2a1f976
  

  weixiuli

  authored and

  Mridul Muralidharan

  committed
  2a1f976

  Copy full SHA for 2a1f976

• [MINOR] Improve to update some mutable hash maps

  Show description for 2a667fb
  

  weixiuli

  authored and

  srowen

  committed
  2a667fb

  Copy full SHA for 2a667fb

Commits on Apr 1, 2022

• [SPARK-38683][SHUFFLE] It is unnecessary to release the ShuffleManagedBufferIterator or ShuffleChunkManagedBufferIterator or ManagedBufferIterator buffers when the client channel's connection is te…

  Show description for dc995f2
  

  weixiuli

  authored and

  Ngone51

  committed
  dc995f2

  Copy full SHA for dc995f2

Commits on Mar 16, 2022

• [SPARK-38555][NETWORK][SHUFFLE] Avoid contention and get or create clientPools quickly in the TransportClientFactory

  Show description for 6d3e8eb
  

  weixiuli

  authored and

  Mridul Muralidharan

  committed
  6d3e8eb

  Copy full SHA for 6d3e8eb

Commits on Mar 8, 2022

• [SPARK-38428][SHUFFLE] Check the FetchShuffleBlocks message only once to improve iteration in external shuffle service

  Show description for 8fabd5e
  

  weixiuli

  authored and

  Mridul Muralidharan

  committed
  8fabd5e

  Copy full SHA for 8fabd5e

Commits on Mar 3, 2022

• [SPARK-38191][CORE][FOLLOWUP] The staging directory of write job only needs to be initialized once in HadoopMapReduceCommitProtocol

  Show description for 23db9b4
  

  weixiuli

  authored and

  srowen

  committed
  23db9b4

  Copy full SHA for 23db9b4

Commits on Mar 2, 2022

• [SPARK-38344][SHUFFLE] Avoid to submit task when there are no requests to push up in push-based shuffle

  Show description for 96bcb04
  

  weixiuli

  authored and

  Mridul Muralidharan

  committed
  96bcb04

  Copy full SHA for 96bcb04

Commits on Mar 1, 2022

• [MINOR] Clean up an unnecessary variable

  Show description for 615c5d8
  

  weixiuli

  authored and

  srowen

  committed
  615c5d8

  Copy full SHA for 615c5d8

Commits on Feb 25, 2022

• [SPARK-38191][CORE] The staging directory of write job only needs to be initialized once in HadoopMapReduceCommitProtocol

  Show description for e58872d
  

  weixiuli

  authored and

  srowen

  committed
  e58872d

  Copy full SHA for e58872d

Commits on Feb 10, 2022

• [MINOR][CORE] Fix the method description of refill

  Show description for 344fd5c
  

  weixiuli

  authored and

  srowen

  committed
  344fd5c

  Copy full SHA for 344fd5c

Commits on Jan 24, 2022

• [SPARK-37984][SHUFFLE] Avoid calculating all outstanding requests to improve performance

  Show description for f8ff786
  

  weixiuli

  authored and

  srowen

  committed
  f8ff786

  Copy full SHA for f8ff786

Commits on Dec 23, 2021

• [SPARK-37462][CORE] Avoid unnecessary calculating the number of outstanding fetch requests and RPCS

  Show description for 805e3fb
  

  weixiuli

  authored and

  srowen

  committed
  805e3fb

  Copy full SHA for 805e3fb

Commits on Dec 3, 2021

• [SPARK-37524][SQL] We should drop all tables after testing dynamic partition pruning

  Show description for 2433c94
  

  weixiuli

  authored and

  HyukjinKwon

  committed
  2433c94

  Copy full SHA for 2433c94

Commits on Jun 17, 2021

• [SPARK-35783][SQL] Set the list of read columns in the task configuration to reduce reading of ORC data

  Show description for 947c7ea
  

  weixiuli

  authored and

  dongjoon-hyun

  committed
  947c7ea

  Copy full SHA for 947c7ea

Commits on May 20, 2021

• [SPARK-35424][SHUFFLE] Remove some useless code in the ExternalBlockHandler

  Show description for 4869e43
  

  weixiuli

  authored and

  HyukjinKwon

  committed
  4869e43

  Copy full SHA for 4869e43

Commits on Apr 24, 2021

• [SPARK-35200][CORE] Avoid to recompute the pending speculative tasks in the ExecutorAllocationManager and remove some unnecessary code

  Show description for bcac733
  

  weixiuli

  authored and

  dongjoon-hyun

  committed
  bcac733

  Copy full SHA for bcac733

Commits on Apr 14, 2021

• [SPARK-34834][NETWORK] Fix a potential Netty memory leak in TransportResponseHandler

  Show description for bf9f3b8
  

  weixiuli

  authored and

  srowen

  committed
  bf9f3b8

  Copy full SHA for bf9f3b8

Commits on Mar 19, 2019

• [SPARK-26288][CORE] add initRegisteredExecutorsDB

  Show description for 8b0aa59
  

  weixiuli

  authored and

  squito

  committed
  8b0aa59

  Copy full SHA for 8b0aa59