Commits

Branch selector

 e4566f4

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 9, 2023

• [SPARK-42717][BUILD] Upgrade mysql-connector-java from 8.0.31 to 8.0.32

  Show description for e4566f4
  

  panbingkun

  authored and

  yaooqinn

  committed
  e4566f4

  Copy full SHA for e4566f4

• [SPARK-42697][WEBUI] Fix /api/v1/applications to return total uptime instead of 0 for the duration field

  Show description for d3d8fdc
  yaooqinn

  committed
  d3d8fdc

  Copy full SHA for d3d8fdc

• [SPARK-42723][SQL] Support parser data type json "timestamp_ltz" as TimestampType

  Show description for c4756ed
  gengliangwang

  committed
  c4756ed

  Copy full SHA for c4756ed

• [SPARK-42656][CONNECT][FOLLOWUP] Fix the spark-connect script

  Show description for b5243d7
  

  zhenlineo

  authored and

  HyukjinKwon

  committed
  b5243d7

  Copy full SHA for b5243d7

• [SPARK-42722][CONNECT][PYTHON] Python Connect def schema() should not cache the schema

  Show description for a77bb37
  

  amaliujia

  authored and

  HyukjinKwon

  committed
  a77bb37

  Copy full SHA for a77bb37

• [SPARK-42480][SQL] Improve the performance of drop partitions

  Show description for 153ace7
  

  wecharyu

  authored and

  sunchao

  committed
  153ace7

  Copy full SHA for 153ace7

Commits on Mar 8, 2023

• [SPARK-42709][PYTHON] Remove the assumption of __file__ being available

  Show description for f95fc19
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  f95fc19

  Copy full SHA for f95fc19

• [SPARK-42555][CONNECT][FOLLOWUP] Add the new proto msg to support the remaining jdbc API

  Show description for 39a5512
  

  beliefer

  authored and

  hvanhovell

  committed
  39a5512

  Copy full SHA for 39a5512

• [SPARK-42684][SQL] v2 catalog should not allow column default value by default

  Show description for 69dd20b
  cloud-fan

  committed
  69dd20b

  Copy full SHA for 69dd20b

• [SPARK-42713][PYTHON][DOCS] Add '__getattr__' and '__getitem__' of DataFrame and Column to API reference

  Show description for e28f7f3
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  e28f7f3

  Copy full SHA for e28f7f3

• [SPARK-42266][PYTHON] Remove the parent directory in shell.py execution when IPython is used

  Show description for 8e83ab7
  HyukjinKwon

  committed
  8e83ab7

  Copy full SHA for 8e83ab7

• [SPARK-42712][PYTHON][DOC] Improve docstring of mapInPandas and mapInArrow

  Show description for bacab6a
  

  xinrong-meng

  and

  HyukjinKwon

  committed
  bacab6a

  Copy full SHA for bacab6a

• [SPARK-41775][PYTHON][FOLLOW-UP] Updating error message for training using PyTorch functions

  Show description for 5db84b5
  

  rithwik-db

  authored and

  zhengruifeng

  committed
  5db84b5

  Copy full SHA for 5db84b5

• [SPARK-42643][CONNECT][PYTHON] Register Java (aggregate) user-defined functions

  Show description for 92aa087
  xinrong-meng

  committed
  92aa087

  Copy full SHA for 92aa087

• [SPARK-42707][CONNECT][DOCS] Update developer documentation about API stability warning

  Show description for b63c11c
  

  HyukjinKwon

  authored and

  zhengruifeng

  committed
  b63c11c

  Copy full SHA for b63c11c

• [SPARK-42700][BUILD] Add h2 as test dependency of connect-server module

  Show description for aa8b41c
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  aa8b41c

  Copy full SHA for aa8b41c

• [SPARK-42681][SQL] Relax ordering constraint for ALTER TABLE ADD|REPLACE column descriptor

  Show description for c394860
  

  vitaliili-db

  authored and

  gengliangwang

  committed
  c394860

  Copy full SHA for c394860

• [SPARK-39399][CORE][K8S] Fix proxy-user authentication for Spark on k8s in cluster deploy mode

  Show description for b3b3557
  

  shrprasa

  authored and

  yaooqinn

  committed
  b3b3557

  Copy full SHA for b3b3557

• [SPARK-42705][CONNECT] Fix spark.sql to return values from the command

  Show description for 1507a52
  

  ueshin

  authored and

  zhengruifeng

  committed
  1507a52

  Copy full SHA for 1507a52

• [SPARK-42022][CONNECT][PYTHON] Fix createDataFrame to autogenerate missing column names

  Show description for 056ed5d
  

  ueshin

  authored and

  HyukjinKwon

  committed
  056ed5d

  Copy full SHA for 056ed5d

Commits on Mar 7, 2023

• [SPARK-42591][SS][DOCS] Add examples of unblocked workloads after SPARK-42376

  Show description for 27c34bd
  HeartSaVioR

  committed
  27c34bd

  Copy full SHA for 27c34bd

• [SPARK-42692][CONNECT] Implement Dataset.toJSON

  Show description for 51504e4
  

  LuciferYang

  authored and

  hvanhovell

  committed
  51504e4

  Copy full SHA for 51504e4

• [SPARK-42656][SPARK SHELL][CONNECT][FOLLOWUP] Add same ClassNotFoundException catch to repl.Main for Scala 2.13

  Show description for 67328de
  

  LuciferYang

  authored and

  hvanhovell

  committed
  67328de

  Copy full SHA for 67328de

• [SPARK-42656][CONNECT][FOLLOWUP] Spark Connect Shell

  Show description for 2e7207f
  

  zhenlineo

  authored and

  hvanhovell

  committed
  2e7207f

  Copy full SHA for 2e7207f

• [SPARK-42559][CONNECT][TESTS][FOLLOW-UP] Disable ANSI in several tests at DataFrameNaFunctionSuite.scala

  Show description for c3a09e2
  HyukjinKwon

  committed
  c3a09e2

  Copy full SHA for c3a09e2

• [SPARK-42665][CONNECT][TEST] Mute Scala Client UDF test

  Show description for cf3c34b
  

  zhenlineo

  authored and

  HyukjinKwon

  committed
  cf3c34b

  Copy full SHA for cf3c34b

• [SPARK-42376][SS] Introduce watermark propagation among operators

  Show description for 8e3b9d4
  HeartSaVioR

  committed
  8e3b9d4

  Copy full SHA for 8e3b9d4

• [SPARK-42680][CONNECT][TESTS] Create the helper function withSQLConf for connect test framework

  Show description for 201e08c
  

  beliefer

  authored and

  HyukjinKwon

  committed
  201e08c

  Copy full SHA for 201e08c

• [SPARK-42688][CONNECT] Rename Connect proto Request client_id to session_id

  Show description for dfdc4a1
  

  amaliujia

  authored and

  hvanhovell

  committed
  dfdc4a1

  Copy full SHA for dfdc4a1

• [SPARK-42656][CONNECT][FOLLOWUP] Improve the script to start spark-connect server

  Show description for d4818df
  

  zhenlineo

  authored and

  hvanhovell

  committed
  d4818df

  Copy full SHA for d4818df

Commits on Mar 6, 2023

• [SPARK-42579][CONNECT] Part-1: function.lit support Array[_] dataType

  Show description for 0def3de
  

  LuciferYang

  authored and

  hvanhovell

  committed
  0def3de

  Copy full SHA for 0def3de

• [SPARK-42687][SS] Better error message for the unsupport pivot operation in Streaming

  Show description for 46b82c7
  

  huanliwang-db

  authored and

  HeartSaVioR

  committed
  46b82c7

  Copy full SHA for 46b82c7

• [SPARK-42559][CONNECT] Implement DataFrameNaFunctions

  Show description for 9bf174f
  

  panbingkun

  authored and

  hvanhovell

  committed
  9bf174f

  Copy full SHA for 9bf174f

• [SPARK-42673][BUILD] Make build/mvn build Spark only with the verified maven version

  Show description for f70b8cf
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  f70b8cf

  Copy full SHA for f70b8cf

• [SPARK-42668][SS] Catch exception while trying to close compressed stream in HDFSStateStoreProvider abort

  Show description for 252e7a3
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  252e7a3

  Copy full SHA for 252e7a3

Pagination

Previous

Next