Commits

Branch selector

 master

User selector

sunchao

Datepicker

All time

Commit History

Commits on Jun 2, 2024

• [SPARK-48392][CORE][FOLLOWUP] Add --load-spark-defaults flag to decide whether to load spark-defaults.conf

  Show description for 8cf3195
  sunchao

  committed
  8cf3195

Commits on May 29, 2024

• [SPARK-48392][CORE] Also load spark-defaults.conf when provided --properties-file

  Show description for eac413a
  sunchao

  committed
  eac413a

Commits on Feb 26, 2024

• [SPARK-46947][CORE] Delay memory manager initialization until Driver plugin is loaded

  Show description for 0ea318f
  sunchao

  committed
  0ea318f

Commits on Nov 9, 2023

• [SPARK-45731][SQL] Also update partition statistics with ANALYZE TABLE command

  Show description for ce818ba
  sunchao

  committed
  ce818ba

Commits on Oct 26, 2023

• [SPARK-45652][SQL] SPJ: Handle empty input partitions after dynamic filtering

  Show description for 8c11804
  sunchao

  committed
  8c11804

Commits on Sep 7, 2023

• [SPARK-45036][FOLLOWUP][SQL] SPJ: Make sure result partitions are sorted according to partition values

  Show description for af1615d
  

  sunchao

  authored and

  LuciferYang

  committed
  af1615d

Commits on Sep 4, 2023

• [SPARK-45036][SQL] SPJ: Simplify the logic to handle partially clustered distribution

  Show description for 9e2aafb
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  9e2aafb

Commits on Sep 2, 2023

• [SPARK-45054][SQL] HiveExternalCatalog.listPartitions should restore partition statistics

  Show description for e9962e8
  sunchao

  committed
  e9962e8

Commits on Aug 8, 2023

• [SPARK-44641][SQL] Incorrect result in certain scenarios when SPJ is not triggered

  Show description for aa1261d
  sunchao

  committed
  aa1261d

Commits on May 24, 2023

• [SPARK-43758][BUILD] Upgrade snappy-java to 1.1.10.0

  Show description for 1e17c86
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  1e17c86

Commits on Feb 7, 2023

• [SPARK-42038][SQL] SPJ: Support partially clustered distribution

  Show description for cf3c02e
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  cf3c02e

Commits on Jan 24, 2023

• [SPARK-41413][FOLLOWUP][SQL][TESTS] More test coverage in KeyGroupedPartitioningSuite

  Show description for 8547046
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  8547046

Commits on Jan 17, 2023

• [SPARK-42039][SQL] SPJ: Remove Option in KeyGroupedPartitioning#partitionValuesOpt

  Show description for bd09a3e
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  bd09a3e

Commits on Dec 22, 2022

• [SPARK-41413][SQL] Avoid shuffle in Storage-Partitioned Join when partition keys mismatch, but join expressions are compatible

  Show description for ebbe0b0
  sunchao

  committed
  ebbe0b0

Commits on Dec 6, 2022

• [SPARK-41398][SQL] Relax constraints on Storage-Partitioned Join when partition keys after runtime filtering do not match

  Show description for 92fea74
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  92fea74

Commits on Oct 15, 2022

• [SPARK-40703][SQL] Introduce shuffle on SinglePartition to improve parallelism

  Show description for bde6423
  

  sunchao

  authored and

  wangyum

  committed
  bde6423

Commits on Sep 16, 2022

• [SPARK-40169][SQL] Don't pushdown Parquet filters with no reference to data schema

  Show description for 4e0fea2
  sunchao

  committed
  4e0fea2

Commits on Aug 9, 2022

• [SPARK-39863][BUILD] Upgrade Hadoop to 3.3.4

  Show description for 8dc1064
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  8dc1064

Commits on Jul 1, 2022

• [SPARK-39657][YARN] YARN AM client should call the non-static setTokensConf method

  Show description for 6624d91
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  6624d91

• Revert "[SPARK-37205][FOLLOWUP] Should call non-static setTokensConf method"

  Show description for 6e466a4
  sunchao

  committed
  6e466a4

• [SPARK-37205][FOLLOWUP] Should call non-static setTokensConf method

  Show description for ded5981
  sunchao

  committed
  ded5981

Commits on Jun 3, 2022

• [SPARK-29260][SQL] Support ALTER DATABASE SET LOCATION if HMS supports

  Show description for 90e5656
  

  sunchao

  authored and

  wangyum

  committed
  90e5656

Commits on May 18, 2022

• [SPARK-39119][BUILD] Upgrade Hadoop to 3.3.3

  Show description for 7ba73bf
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  7ba73bf

Commits on May 4, 2022

• [MINOR] Remove unused import

  Show description for 7c8f702
  sunchao

  committed
  7c8f702

• [SPARK-38891][SQL] Skipping allocating vector for repetition & definition levels when possible

  Show description for c20d519
  sunchao

  committed
  c20d519

Commits on Apr 12, 2022

• [SPARK-34863][SQL][FOLLOWUP] Add benchmark for Parquet & ORC nested column scan

  Show description for 3640772
  sunchao

  committed
  3640772

Commits on Apr 9, 2022

• [SPARK-38840][SQL] Enable spark.sql.parquet.enableNestedColumnVectorizedReader on master by default

  Show description for 233dd98
  

  sunchao

  authored and

  viirya

  committed
  233dd98

Commits on Apr 5, 2022

• [SPARK-37377][SQL] Initial implementation of Storage-Partitioned Join

  Show description for 20ffbf7
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  20ffbf7

Commits on Apr 4, 2022

• [SPARK-34863][SQL][FOLLOWUP] Disable spark.sql.parquet.enableNestedColumnVectorizedReader by default

  Show description for 1b08673
  

  sunchao

  authored and

  viirya

  committed
  1b08673

Commits on Apr 2, 2022

• [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

  Show description for deac8f9
  

  sunchao

  authored and

  viirya

  committed
  deac8f9

Commits on Mar 9, 2022

• [SPARK-37600][BUILD] Upgrade to Hadoop 3.3.2

  Show description for 4da04fc
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  4da04fc

Commits on Feb 10, 2022

• [SPARK-38134][BUILD] Upgrade Apache Arrow to 7.0.0

  Show description for 0ae8c39
  

  sunchao

  authored and

  dongjoon-hyun

  committed
  0ae8c39

Commits on Jan 19, 2022

• [SPARK-37957][SQL] Correctly pass deterministic flag for V2 scalar functions

  Show description for 9ffca0c
  sunchao

  committed
  9ffca0c

Commits on Dec 27, 2021

• [SPARK-35703][SQL] Relax constraint for bucket join and remove HashClusteredDistribution

  Show description for d8920ae
  

  sunchao

  authored and

  cloud-fan

  committed
  d8920ae

Commits on Dec 8, 2021

• [SPARK-37205][YARN] Introduce a new config 'spark.yarn.am.tokenConfRegex' to support renewing delegation tokens in a multi-cluster environment

  Show description for 77a8778
  sunchao

  committed
  77a8778

Pagination

PreviousNext