Commits

Branch selector

 master

User selector

sadikovi

Datepicker

All time

Commit History

Commits on Jul 11, 2024

• [SPARK-48863][SQL] Fix ClassCastException when parsing JSON with "spark.sql.json.enablePartialResults" enabled

  Show description for 31d5ea1
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  31d5ea1

Commits on Jun 19, 2024

• [SPARK-48649][SQL] Add "ignoreInvalidPartitionPaths" and "spark.sql.files.ignoreInvalidPartitionPaths" configs to allow ignoring invalid partition paths

  Show description for 5e28e95
  

  sadikovi

  authored and

  cloud-fan

  committed
  5e28e95

Commits on Apr 22, 2024

• [SPARK-47904][SQL] Preserve case in Avro schema when using enableStableIdentifiersForUnionType

  Show description for fc0c855
  

  sadikovi

  authored and

  dongjoon-hyun

  committed
  fc0c855

Commits on Apr 11, 2024

• [SPARK-47704][SQL] JSON parsing fails with "java.lang.ClassCastException" when spark.sql.json.enablePartialResults is enabled

  Show description for a2b7050
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  a2b7050

Commits on Mar 20, 2024

• [SPARK-46990][SQL] Fix loading empty Avro files emitted by event-hubs

  Show description for 7626080
  

  sadikovi

  authored and

  cloud-fan

  committed
  7626080

Commits on Jan 31, 2024

• [SPARK-46930][SQL] Add support for a custom prefix for Union type fields in Avro

  Show description for d49265a
  

  sadikovi

  authored and

  dongjoon-hyun

  committed
  d49265a

Commits on Jan 10, 2024

• [SPARK-46633][SQL] Fix Avro reader to handle zero-length blocks

  Show description for 3a6b9ad
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  3a6b9ad

Commits on Sep 13, 2023

• [SPARK-45139][SQL] Add DatabricksDialect to handle SQL type conversion

  Show description for 2710dbe
  

  sadikovi

  authored and

  dongjoon-hyun

  committed
  2710dbe

Commits on Sep 4, 2023

• [SPARK-44940][SQL] Improve performance of JSON parsing when "spark.sql.json.enablePartialResults" is enabled

  Show description for 74c1f02
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  74c1f02

Commits on Feb 24, 2023

• [SPARK-42534][SQL] Fix DB2Dialect Limit clause

  Show description for f15414e
  

  sadikovi

  authored and

  cloud-fan

  committed
  f15414e

Commits on Feb 17, 2023

• [SPARK-42469][SQL] Update MSSQL Dialect to use parentheses for TOP and add tests for Limit clause

  Show description for 9d87684
  

  sadikovi

  authored and

  dongjoon-hyun

  committed
  9d87684

Commits on Jan 25, 2023

• [SPARK-42176][SQL] Fix cast of a boolean value to timestamp

  Show description for 866343c
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  866343c

Commits on Dec 14, 2022

• [SPARK-41248][SQL] Add "spark.sql.json.enablePartialResults" to enable/disable JSON partial results

  Show description for 5b50834
  

  sadikovi

  authored and

  MaxGekk

  committed
  5b50834

Commits on Nov 22, 2022

• [SPARK-41209][PYTHON] Improve PySpark type inference in _merge_type method

  Show description for 51b0440
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  51b0440

Commits on Nov 10, 2022

• [SPARK-40815][SQL][FOLLOW-UP] Fix record reader in DelegateSymlinkTextInputFormat to avoid Hive ExecMapper.getDone() check

  Show description for 6308f54
  

  sadikovi

  authored and

  cloud-fan

  committed
  6308f54

Commits on Nov 4, 2022

• [SPARK-40815][SQL][FOLLOW-UP] Disable DelegateSymlinkTextInputFormat tests for JDK 9+

  Show description for af66a31
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  af66a31

Commits on Oct 31, 2022

• [SPARK-40815][SQL] Add DelegateSymlinkTextInputFormat to workaround SymlinkTextInputSplit bug

  Show description for 668ab27
  

  sadikovi

  authored and

  dongjoon-hyun

  committed
  668ab27

Commits on Oct 17, 2022

• [SPARK-40646][SQL] Fix returning partial results in JSON data source and JSON functions

  Show description for 31721ba
  

  sadikovi

  authored and

  MaxGekk

  committed
  31721ba

Commits on Sep 23, 2022

• [SPARK-40527][SQL] Keep struct field names or map keys in CreateStruct

  Show description for e5914e1
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  e5914e1

Commits on Sep 21, 2022

• [SPARK-40496][SQL] Fix configs to control "enableDateTimeParsingFallback"

  Show description for a031aaa
  

  sadikovi

  authored and

  cloud-fan

  committed
  a031aaa

Commits on Sep 17, 2022

• [SPARK-40468][SQL] Fix column pruning in CSV when _corrupt_record is selected

  Show description for 0776f9e
  

  sadikovi

  authored and

  MaxGekk

  committed
  0776f9e

Commits on Sep 16, 2022

• [SPARK-40470][SQL] Handle GetArrayStructFields and GetMapValue in "arrays_zip" function

  Show description for 9b0f979
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  9b0f979

Commits on Sep 12, 2022

• [SPARK-40292][SQL] Fix column names in "arrays_zip" function when arrays are referenced from nested structs

  Show description for 443eea9
  

  sadikovi

  authored and

  MaxGekk

  committed
  443eea9

Commits on Aug 26, 2022

• [SPARK-40215][SQL] Add SQL configs to control CSV/JSON date and timestamp parsing behavior

  Show description for 630aa0b
  

  sadikovi

  authored and

  MaxGekk

  committed
  630aa0b

Commits on Aug 21, 2022

• [SPARK-39833][SQL] Disable Parquet column index in DSv1 to fix a correctness issue in the case of overlapping partition and data columns

  Show description for cde71aa
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  cde71aa

Commits on Aug 12, 2022

• [SPARK-40052][SQL] Handle direct byte buffers in VectorizedDeltaBinaryPackedReader

  Show description for c748052
  

  sadikovi

  authored and

  sunchao

  committed
  c748052

Commits on Aug 3, 2022

• [SPARK-39904][SQL] Rename inferDate to prefersDate and clarify semantics of the option in CSV data source

  Show description for 31ab8bc
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  31ab8bc

Commits on Jul 27, 2022

• [SPARK-39731][SQL] Fix issue in CSV and JSON data sources when parsing dates in "yyyyMMdd" format with CORRECTED time parser policy

  Show description for a930445
  

  sadikovi

  authored and

  cloud-fan

  committed
  a930445

Commits on Jun 14, 2022

• [SPARK-39339][SQL] Support TimestampNTZ type in JDBC data source

  Show description for 2349175
  

  sadikovi

  authored and

  gengliangwang

  committed
  2349175

Commits on May 25, 2022

• [SPARK-39252][PYSPARK][TESTS] Remove flaky test_df_is_empty

  Show description for 9823bb3
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  9823bb3

Commits on May 23, 2022

• [SPARK-35378][SQL][FOLLOW-UP] Fix incorrect return type in CommandResultExec.executeCollect()

  Show description for a0decfc
  

  sadikovi

  authored and

  cloud-fan

  committed
  a0decfc

Commits on May 12, 2022

• [SPARK-39086][SQL] Support UDT in Spark Parquet vectorized reader

  Show description for c74506c
  

  sadikovi

  authored and

  sunchao

  committed
  c74506c

Commits on May 2, 2022

• [SPARK-39084][PYSPARK] Fix df.rdd.isEmpty() by using TaskContext to stop iterator on task completion

  Show description for 9305cc7
  

  sadikovi

  authored and

  HyukjinKwon

  committed
  9305cc7

Commits on Apr 27, 2022

• [SPARK-38829][SQL] Add a configuration flag to enable TIMESTAMP_NTZ support in Parquet data source

  Show description for 6af121b
  

  sadikovi

  authored and

  gengliangwang

  committed
  6af121b

• [SPARK-34863][SQL][FOLLOW-UP] Handle IsAllNull in OffHeapColumnVector

  Show description for 0d8ace5
  

  sadikovi

  authored and

  sunchao

  committed
  0d8ace5

Pagination

Previous

Next