Commits

Branch selector

 master

User selector

gengliangwang

Datepicker

All time

Commit History

Commits on May 13, 2019

• [SPARK-27668][SQL] File source V2: support reporting statistics

  Show description for be6d39c
  

  gengliangwang

  authored and

  cloud-fan

  committed
  be6d39c

  Copy full SHA for be6d39c

Commits on May 8, 2019

• [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

  Show description for 78a403f
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  78a403f

  Copy full SHA for 78a403f

Commits on Apr 29, 2019

• [SPARK-27580][SQL] Implement doCanonicalize in BatchScanExec for comparing query plan results

  Show description for 07d07fe
  

  gengliangwang

  authored and

  cloud-fan

  committed
  07d07fe

  Copy full SHA for 07d07fe

Commits on Apr 23, 2019

• [SPARK-27128][SQL] Migrate JSON to File Data Source V2

  Show description for 00f2f31
  

  gengliangwang

  authored and

  cloud-fan

  committed
  00f2f31

  Copy full SHA for 00f2f31

Commits on Apr 19, 2019

• [SPARK-27504][SQL] File source V2: support refreshing metadata cache

  Show description for 31488e1
  

  gengliangwang

  authored and

  cloud-fan

  committed
  31488e1

  Copy full SHA for 31488e1

Commits on Apr 18, 2019

• [SPARK-27460][TESTS][FOLLOWUP] Add HiveClientVersions to parallel test suite list

  Show description for 3748b38
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  3748b38

  Copy full SHA for 3748b38

• [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

  Show description for 9c238b8
  

  gengliangwang

  authored and

  cloud-fan

  committed
  9c238b8

  Copy full SHA for 9c238b8

• [SPARK-27490][SQL] File source V2: return correct result for Dataset.inputFiles()

  Show description for 7d44ba0
  

  gengliangwang

  authored and

  cloud-fan

  committed
  7d44ba0

  Copy full SHA for 7d44ba0

Commits on Apr 16, 2019

• [SPARK-27448][SQL] File source V2 table provider should be compatible with V1 provider

  Show description for f9837d3
  

  gengliangwang

  authored and

  cloud-fan

  committed
  f9837d3

  Copy full SHA for f9837d3

Commits on Apr 15, 2019

• [SPARK-27459][SQL] Revise the exception message of schema inference failure in file source V2

  Show description for 27d625d
  

  gengliangwang

  authored and

  cloud-fan

  committed
  27d625d

  Copy full SHA for 27d625d

Commits on Apr 12, 2019

• [SPARK-27443][SQL] Support UDF input_file_name in file source V2

  Show description for 4eb694c
  

  gengliangwang

  authored and

  cloud-fan

  committed
  4eb694c

  Copy full SHA for 4eb694c

Commits on Apr 11, 2019

• [SPARK-27435][SQL] Support schema pruning in ORC V2

  Show description for 4177292
  

  gengliangwang

  authored and

  cloud-fan

  committed
  4177292

  Copy full SHA for 4177292

Commits on Apr 9, 2019

• [SPARK-27407][SQL] File source V2: Invalidate cache data on overwrite/append

  Show description for 3db117e
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  3db117e

  Copy full SHA for 3db117e

Commits on Apr 8, 2019

• [SPARK-27271][SQL] Migrate Text to File Data Source V2

  Show description for d50603a
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  d50603a

  Copy full SHA for d50603a

• [SPARK-27384][SQL] File source V2: Prune unnecessary partition columns

  Show description for 02e9f93
  

  gengliangwang

  authored and

  cloud-fan

  committed
  02e9f93

  Copy full SHA for 02e9f93

Commits on Apr 5, 2019

• [SPARK-27356][SQL] File source V2: Fix the case that data columns overlap with partition schema

  Show description for 568db94
  

  gengliangwang

  authored and

  cloud-fan

  committed
  568db94

  Copy full SHA for 568db94

Commits on Mar 30, 2019

• [SPARK-27326][SQL] Fall back all v2 file sources in InsertIntoTable to V1 FileFormat

  Show description for 5dab5f6
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  5dab5f6

  Copy full SHA for 5dab5f6

Commits on Mar 27, 2019

• [SPARK-27291][SQL] PartitioningAwareFileIndex: Filter out empty files on listing files

  Show description for 49b0411
  

  gengliangwang

  authored and

  cloud-fan

  committed
  49b0411

  Copy full SHA for 49b0411

• [SPARK-27286][SQL] Handles exceptions on proceeding to next record in FilePartitionReader

  Show description for 6bcd480
  

  gengliangwang

  authored and

  cloud-fan

  committed
  6bcd480

  Copy full SHA for 6bcd480

Commits on Mar 26, 2019

• [SPARK-27269][SQL] File source v2 should validate data schema only

  Show description for 267160b
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  267160b

  Copy full SHA for 267160b

Commits on Mar 23, 2019

• [SPARK-27085][SQL] Migrate CSV to File Data Source V2

  Show description for 6242885
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  6242885

  Copy full SHA for 6242885

Commits on Mar 20, 2019

• [SPARK-27201][WEBUI] Toggle full job description on click

  Show description for ef2d63b
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  ef2d63b

  Copy full SHA for ef2d63b

Commits on Mar 19, 2019

• [SPARK-27162][SQL] Add new method asCaseSensitiveMap in CaseInsensitiveStringMap

  Show description for 28d35c8
  

  gengliangwang

  authored and

  cloud-fan

  committed
  28d35c8

  Copy full SHA for 28d35c8

Commits on Mar 15, 2019

• [SPARK-27132][SQL] Improve file source V2 framework

  Show description for 2a37d6e
  

  gengliangwang

  authored and

  cloud-fan

  committed
  2a37d6e

  Copy full SHA for 2a37d6e

• [SPARK-27136][SQL] Remove data source option check_files_exist

  Show description for 6d22ee3
  

  gengliangwang

  authored and

  cloud-fan

  committed
  6d22ee3

  Copy full SHA for 6d22ee3

Commits on Mar 7, 2019

• [SPARK-27049][SQL] Create util class to support handling partition values in file source V2

  Show description for a543f91
  

  gengliangwang

  authored and

  cloud-fan

  committed
  a543f91

  Copy full SHA for a543f91

Commits on Mar 4, 2019

• [SPARK-27040][SQL] Avoid using unnecessary JoinRow in FileFormat

  Show description for 68fa601
  

  gengliangwang

  authored and

  cloud-fan

  committed
  68fa601

  Copy full SHA for 68fa601

Commits on Feb 27, 2019

• [SPARK-26990][SQL] FileIndex: use user specified field names if possible

  Show description for 95e5572
  

  gengliangwang

  authored and

  cloud-fan

  committed
  95e5572

  Copy full SHA for 95e5572

Commits on Feb 26, 2019

• [SPARK-26673][FOLLOWUP][SQL] File Source V2: check existence of output path before delete it

  Show description for 4baa2d4
  

  gengliangwang

  authored and

  gatorsmile

  committed
  4baa2d4

  Copy full SHA for 4baa2d4

Commits on Feb 16, 2019

• [SPARK-26744][SQL] Support schema validation in FileDataSourceV2 framework

  Show description for 4dce45a
  

  gengliangwang

  authored and

  cloud-fan

  committed
  4dce45a

  Copy full SHA for 4dce45a

• [SPARK-26673][FOLLOWUP][SQL] File source V2: remove duplicated broadcast object in FileWriterFactory

  Show description for 4cabab8
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  4cabab8

  Copy full SHA for 4cabab8

Commits on Feb 15, 2019

• [SPARK-26871][SQL] File Source V2: avoid creating unnecessary FileIndex in the write path

  Show description for 71170e7
  

  gengliangwang

  authored and

  cloud-fan

  committed
  71170e7

  Copy full SHA for 71170e7

Commits on Feb 13, 2019

• [SPARK-26857][SQL] Return UnsafeArrayData for date/timestamp type in ColumnarArray.copy()

  Show description for 72a349a
  

  gengliangwang

  authored and

  maropu

  committed
  72a349a

  Copy full SHA for 72a349a

Commits on Jan 31, 2019

• [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

  Show description for df4c53e
  

  gengliangwang

  authored and

  cloud-fan

  committed
  df4c53e

  Copy full SHA for df4c53e

• [SPARK-26716][SPARK-26765][FOLLOWUP][SQL] Clean up schema validation methods and override toString method in Avro

  Show description for 308996b
  

  gengliangwang

  authored and

  cloud-fan

  committed
  308996b

  Copy full SHA for 308996b

Pagination

Previous

Next