Commits

Branch selector

 70b4b1d

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 27, 2022

• [SPARK-38979][SQL] Improve error log readability in OrcUtils.requestedColumnIds

  Show description for 70b4b1d
  

  cxzl25

  authored and

  srowen

  committed
  70b4b1d

• [SPARK-39027][SQL] Output SQL statements in error messages in upper case and w/o double quotes

  Show description for 4e84f33
  MaxGekk

  committed
  4e84f33

• [SPARK-39015][SQL] Remove the usage of toSQLValue(v) without an explicit type

  Show description for e49147a
  

  HyukjinKwon

  authored and

  MaxGekk

  committed
  e49147a

• [SPARK-34079][SQL][FOLLOW-UP] Revert some changes in InjectRuntimeFilterSuite

  Show description for d05e01d
  

  peter-toth

  authored and

  cloud-fan

  committed
  d05e01d

• [SPARK-39032][PYTHON][DOCS] Examples' tag for pyspark.sql.functions.when()

  Show description for 5b53bdf
  

  vadim

  authored and

  HyukjinKwon

  committed
  5b53bdf

• [SPARK-38829][SQL] Add a configuration flag to enable TIMESTAMP_NTZ support in Parquet data source

  Show description for 6af121b
  

  sadikovi

  authored and

  gengliangwang

  committed
  6af121b

• [SPARK-38918][SQL] Nested column pruning should filter out attributes that do not belong to the current relation

  Show description for 150434b
  

  allisonwang-db

  authored and

  viirya

  committed
  150434b

• [SPARK-39002][SQL] StringEndsWith/Contains support push down to Parquet

  Show description for 1b7c636
  

  WangGuangxin

  authored and

  viirya

  committed
  1b7c636

• [SPARK-34863][SQL][FOLLOW-UP] Handle IsAllNull in OffHeapColumnVector

  Show description for 0d8ace5
  

  sadikovi

  authored and

  sunchao

  committed
  0d8ace5

• [SPARK-38985][SQL] Add sub error classes

  Show description for 6f4e7b6
  

  srielau

  authored and

  cloud-fan

  committed
  6f4e7b6

• [SPARK-38907][PYTHON] Implement DataFrame.corrwith

  Show description for 8269bcb
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  8269bcb

• [SPARK-38970][CI] Skip build-and-test workflow on forks when scheduled

  Show description for 31c903f
  

  EnricoMi

  authored and

  HyukjinKwon

  committed
  31c903f

• [SPARK-39000][PYTHON] Convert bools to ints in basic statistical functions of GroupBy objects

  Show description for b8cacdf
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  b8cacdf

• [SPARK-38879][PYTHON][TEST] Improve the test coverage for pyspark/rddsampler.py

  Show description for 4fb4648
  

  2 peopleauthored and

  HyukjinKwon

  committed
  4fb4648

• [SPARK-39030][PYTHON] Rename sum to avoid shading the builtin Python function

  Show description for 3821d80
  

  bjornjorgensen

  authored and

  HyukjinKwon

  committed
  3821d80

Commits on Apr 26, 2022

• Revert "[SPARK-38354][SQL] Add hash probes metric for shuffled hash join"

  Show description for 6b5a1f9
  

  c21

  authored and

  dongjoon-hyun

  committed
  6b5a1f9

• [SPARK-39019][TESTS] Use withTempPath to clean up temporary data directory after SPARK-37463: read/write Timestamp ntz to Orc with different time zone

  Show description for 97449d2
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  97449d2

• [SPARK-39028][SQL] Use SparkDateTimeException when casting to datetime types failed

  Show description for ead4588
  

  gengliangwang

  authored and

  MaxGekk

  committed
  ead4588

• [SPARK-39016][TESTS] Fix compilation warnings related to "enum will become a keyword in Scala 3"

  Show description for f66fde8
  

  LuciferYang

  authored and

  srowen

  committed
  f66fde8

• [SPARK-38944][CORE][SQL] Close UnsafeSorterSpillReader before SpillableArrayIterator throw ConcurrentModificationException

  Show description for f1286f3
  

  LuciferYang

  authored and

  srowen

  committed
  f1286f3

• [SPARK-34079][SQL][FOLLOW-UP] Remove debug logging

  Show description for f24c9b0
  

  peter-toth

  authored and

  HyukjinKwon

  committed
  f24c9b0

• [SPARK-38821][PYTHON] Skip nsmall/nlarge nan test under pandas 1.4.[0,1,2]

  Show description for ac5ec64
  

  Yikun

  authored and

  HyukjinKwon

  committed
  ac5ec64

• [SPARK-39014][SQL] Respect ignoreMissingFiles from Data Source options in InMemoryFileIndex

  Show description for 028c472
  

  Yaohua628

  authored and

  HyukjinKwon

  committed
  028c472

• [SPARK-36664][CORE] Log time waiting for cluster resources

  Show description for 148918b
  holdenk

  committed
  148918b

• [SPARK-39001][SQL][DOCS][FOLLOW-UP] Revert the doc changes for dropFieldIfAllNull, prefersDecimal and primitivesAsString (schema_of_json)

  Show description for 5056c6c
  HyukjinKwon

  committed
  5056c6c

• [SPARK-38989][PYTHON] Implement ignore_index of DataFrame/Series.sample

  Show description for e44ff98
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  e44ff98

Commits on Apr 25, 2022

• [SPARK-39008][BUILD] Change ASF as a single author in Spark distribution

  Show description for ce957e2
  HyukjinKwon

  committed
  ce957e2

• [SPARK-38742][SQL][TESTS] Move the tests MISSING_COLUMN from SQLQuerySuite to QueryCompilationErrorsSuite

  Show description for da51dc7
  

  panbingkun

  authored and

  MaxGekk

  committed
  da51dc7

• [SPARK-39001][SQL][DOCS] Document which options are unsupported in CSV and JSON functions

  Show description for 10a643c
  

  HyukjinKwon

  authored and

  MaxGekk

  committed
  10a643c

• [SPARK-38939][SQL] Support DROP COLUMN [IF EXISTS] syntax

  Show description for efa70e4
  

  jackierwzhang

  authored and

  cloud-fan

  committed
  efa70e4

• [SPARK-39007][SQL] Use double quotes for SQL configs in error messages

  Show description for f01bff9
  MaxGekk

  committed
  f01bff9

• [SPARK-38999][SQL] Refactor FileSourceScanExec: file scan physical node

  Show description for 8c80016
  

  utkarsh39

  authored and

  cloud-fan

  committed
  8c80016

• [SPARK-38868][SQL] Don't propagate exceptions from filter predicate when optimizing outer joins

  Show description for e2930b8
  

  bersprockets

  authored and

  cloud-fan

  committed
  e2930b8

• [SPARK-38937][PYTHON] interpolate support param limit_direction

  Show description for 5046b8c
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  5046b8c

• [SPARK-38948][TESTS] Fix DiskRowQueue leak in PythonForeachWriterSuite

  Show description for 9440590
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  9440590

Pagination

Previous

Next