Commits

Branch selector

 master

User selector

gengliangwang

Datepicker

All time

Commit History

Commits on Jun 15, 2019

• [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

  Show description for 23ebd38
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  23ebd38

  Copy full SHA for 23ebd38

Commits on Jun 8, 2019

• [SPARK-27961][SQL] DataSourceV2Relation should not have refresh method

  Show description for db0f6b4
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  db0f6b4

  Copy full SHA for db0f6b4

Commits on Jun 4, 2019

• [SPARK-27926][SQL] Allow altering table add columns with CSVFileFormat/JsonFileFormat provider

  Show description for d1937c1
  

  gengliangwang

  authored and

  gatorsmile

  committed
  d1937c1

  Copy full SHA for d1937c1

Commits on May 30, 2019

• [SPARK-27849][SQL][FOLLOWUP][TEST-MAVEN] Fix the testing regex in DataSourceScanRedactionTest

  Show description for 49e7387
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  49e7387

  Copy full SHA for 49e7387

Commits on May 29, 2019

• [SPARK-27849][SQL] Redact treeString of FileTable and DataSourceV2ScanExecBase

  Show description for c1007c2
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  c1007c2

  Copy full SHA for c1007c2

Commits on May 22, 2019

• [SPARK-27698][SQL] Add new method convertibleFilters for getting pushed down filters in Parquet file reader

  Show description for c3c443c
  

  gengliangwang

  authored and

  cloud-fan

  committed
  c3c443c

  Copy full SHA for c3c443c

Commits on May 17, 2019

• [SPARK-27699][SQL] Partially push down disjunctive predicated in Parquet/ORC

  Show description for e39e97b
  

  gengliangwang

  authored and

  cloud-fan

  committed
  e39e97b

  Copy full SHA for e39e97b

Commits on May 13, 2019

• [SPARK-27668][SQL] File source V2: support reporting statistics

  Show description for be6d39c
  

  gengliangwang

  authored and

  cloud-fan

  committed
  be6d39c

  Copy full SHA for be6d39c

Commits on May 8, 2019

• [SPARK-27627][SQL] Make option "pathGlobFilter" as a general option for all file sources

  Show description for 78a403f
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  78a403f

  Copy full SHA for 78a403f

Commits on Apr 29, 2019

• [SPARK-27580][SQL] Implement doCanonicalize in BatchScanExec for comparing query plan results

  Show description for 07d07fe
  

  gengliangwang

  authored and

  cloud-fan

  committed
  07d07fe

  Copy full SHA for 07d07fe

Commits on Apr 23, 2019

• [SPARK-27128][SQL] Migrate JSON to File Data Source V2

  Show description for 00f2f31
  

  gengliangwang

  authored and

  cloud-fan

  committed
  00f2f31

  Copy full SHA for 00f2f31

Commits on Apr 19, 2019

• [SPARK-27504][SQL] File source V2: support refreshing metadata cache

  Show description for 31488e1
  

  gengliangwang

  authored and

  cloud-fan

  committed
  31488e1

  Copy full SHA for 31488e1

Commits on Apr 18, 2019

• [SPARK-27460][TESTS][FOLLOWUP] Add HiveClientVersions to parallel test suite list

  Show description for 3748b38
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  3748b38

  Copy full SHA for 3748b38

• [SPARK-27460][TESTS] Running slowest test suites in their own forked JVMs for higher parallelism

  Show description for 9c238b8
  

  gengliangwang

  authored and

  cloud-fan

  committed
  9c238b8

  Copy full SHA for 9c238b8

• [SPARK-27490][SQL] File source V2: return correct result for Dataset.inputFiles()

  Show description for 7d44ba0
  

  gengliangwang

  authored and

  cloud-fan

  committed
  7d44ba0

  Copy full SHA for 7d44ba0

Commits on Apr 16, 2019

• [SPARK-27448][SQL] File source V2 table provider should be compatible with V1 provider

  Show description for f9837d3
  

  gengliangwang

  authored and

  cloud-fan

  committed
  f9837d3

  Copy full SHA for f9837d3

Commits on Apr 15, 2019

• [SPARK-27459][SQL] Revise the exception message of schema inference failure in file source V2

  Show description for 27d625d
  

  gengliangwang

  authored and

  cloud-fan

  committed
  27d625d

  Copy full SHA for 27d625d

Commits on Apr 12, 2019

• [SPARK-27443][SQL] Support UDF input_file_name in file source V2

  Show description for 4eb694c
  

  gengliangwang

  authored and

  cloud-fan

  committed
  4eb694c

  Copy full SHA for 4eb694c

Commits on Apr 11, 2019

• [SPARK-27435][SQL] Support schema pruning in ORC V2

  Show description for 4177292
  

  gengliangwang

  authored and

  cloud-fan

  committed
  4177292

  Copy full SHA for 4177292

Commits on Apr 9, 2019

• [SPARK-27407][SQL] File source V2: Invalidate cache data on overwrite/append

  Show description for 3db117e
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  3db117e

  Copy full SHA for 3db117e

Commits on Apr 8, 2019

• [SPARK-27271][SQL] Migrate Text to File Data Source V2

  Show description for d50603a
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  d50603a

  Copy full SHA for d50603a

• [SPARK-27384][SQL] File source V2: Prune unnecessary partition columns

  Show description for 02e9f93
  

  gengliangwang

  authored and

  cloud-fan

  committed
  02e9f93

  Copy full SHA for 02e9f93

Commits on Apr 5, 2019

• [SPARK-27356][SQL] File source V2: Fix the case that data columns overlap with partition schema

  Show description for 568db94
  

  gengliangwang

  authored and

  cloud-fan

  committed
  568db94

  Copy full SHA for 568db94

Commits on Mar 30, 2019

• [SPARK-27326][SQL] Fall back all v2 file sources in InsertIntoTable to V1 FileFormat

  Show description for 5dab5f6
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  5dab5f6

  Copy full SHA for 5dab5f6

Commits on Mar 27, 2019

• [SPARK-27291][SQL] PartitioningAwareFileIndex: Filter out empty files on listing files

  Show description for 49b0411
  

  gengliangwang

  authored and

  cloud-fan

  committed
  49b0411

  Copy full SHA for 49b0411

• [SPARK-27286][SQL] Handles exceptions on proceeding to next record in FilePartitionReader

  Show description for 6bcd480
  

  gengliangwang

  authored and

  cloud-fan

  committed
  6bcd480

  Copy full SHA for 6bcd480

Commits on Mar 26, 2019

• [SPARK-27269][SQL] File source v2 should validate data schema only

  Show description for 267160b
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  267160b

  Copy full SHA for 267160b

Commits on Mar 23, 2019

• [SPARK-27085][SQL] Migrate CSV to File Data Source V2

  Show description for 6242885
  

  gengliangwang

  authored and

  dongjoon-hyun

  committed
  6242885

  Copy full SHA for 6242885

Commits on Mar 20, 2019

• [SPARK-27201][WEBUI] Toggle full job description on click

  Show description for ef2d63b
  

  gengliangwang

  authored and

  HyukjinKwon

  committed
  ef2d63b

  Copy full SHA for ef2d63b

Commits on Mar 19, 2019

• [SPARK-27162][SQL] Add new method asCaseSensitiveMap in CaseInsensitiveStringMap

  Show description for 28d35c8
  

  gengliangwang

  authored and

  cloud-fan

  committed
  28d35c8

  Copy full SHA for 28d35c8

Commits on Mar 15, 2019

• [SPARK-27132][SQL] Improve file source V2 framework

  Show description for 2a37d6e
  

  gengliangwang

  authored and

  cloud-fan

  committed
  2a37d6e

  Copy full SHA for 2a37d6e

• [SPARK-27136][SQL] Remove data source option check_files_exist

  Show description for 6d22ee3
  

  gengliangwang

  authored and

  cloud-fan

  committed
  6d22ee3

  Copy full SHA for 6d22ee3

Commits on Mar 7, 2019

• [SPARK-27049][SQL] Create util class to support handling partition values in file source V2

  Show description for a543f91
  

  gengliangwang

  authored and

  cloud-fan

  committed
  a543f91

  Copy full SHA for a543f91

Commits on Mar 4, 2019

• [SPARK-27040][SQL] Avoid using unnecessary JoinRow in FileFormat

  Show description for 68fa601
  

  gengliangwang

  authored and

  cloud-fan

  committed
  68fa601

  Copy full SHA for 68fa601

Commits on Feb 27, 2019

• [SPARK-26990][SQL] FileIndex: use user specified field names if possible

  Show description for 95e5572
  

  gengliangwang

  authored and

  cloud-fan

  committed
  95e5572

  Copy full SHA for 95e5572

Pagination

Previous

Next