Commits

Branch selector

 54e62a1

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 26, 2024

• [SPARK-49800][BUILD][K8S] Upgrade kubernetes-client to 6.13.4

  Show description for 54e62a1
  

  bjornjorgensen

  authored and

  dongjoon-hyun

  committed
  54e62a1

• [SPARK-49444][SQL] Modified UnivocityParser to throw runtime exceptions caused by ArrayIndexOutOfBounds with more user-oriented messages

  Show description for 624eda5
  

  vladanvasi-db

  authored and

  cloud-fan

  committed
  624eda5

• [SPARK-49797][INFRA] Align the running OS image of maven_test.yml to ubuntu-latest

  Show description for 87b5ffb
  

  panbingkun

  authored and

  dongjoon-hyun

  committed
  87b5ffb

• [MINOR][SQL][TESTS] Use formatString.format(value) instead of value.formatted(formatString)

  Show description for 218051a
  

  panbingkun

  authored and

  LuciferYang

  committed
  218051a

• [SPARK-49286][CONNECT][SQL] Move Avro/Protobuf functions to sql/api

  Show description for 7b20e58
  hvanhovell

  committed
  7b20e58

• [SPARK-49416][CONNECT][SQL] Add Shared DataStreamReader interface

  Show description for a116a5b
  hvanhovell

  committed
  a116a5b

• [SPARK-49656][SS] Add support for state variables with value state collection types and read change feed options

  Show description for fe1cf32
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  fe1cf32

• [SPARK-49784][PYTHON][TESTS] Add more test for spark.sql

  Show description for 913a0f7
  zhengruifeng

  committed
  913a0f7

• [SPARK-49786][K8S] Lower KubernetesClusterSchedulerBackend.onDisconnected log level to debug

  Show description for 5629779
  dongjoon-hyun

  committed
  5629779

• [SPARK-49609][PYTHON][TESTS][FOLLOW-UP] Avoid import connect modules when connect dependencies not installed

  Show description for c0984e7
  HyukjinKwon

  committed
  c0984e7

Commits on Sep 25, 2024

• [SPARK-48195][FOLLOWUP] Accumulator reset() no longer needed in CollectMetricsExec.doExecute()

  Show description for 80d6651
  

  Julek Sompolski

  authored and

  cloud-fan

  committed
  80d6651

• [SPARK-49775][SQL][FOLLOW-UP] Use SortedSet instead of Array with sorting

  Show description for 09209f0
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  09209f0

• [SPARK-49731][K8S] Support K8s volume mount.subPathExpr and hostPath volume type

  Show description for 1f2e7b8
  

  EnricoMi

  authored and

  dongjoon-hyun

  committed
  1f2e7b8

• [SPARK-49746][BUILD] Upgrade Scala to 2.13.15

  Show description for 983f6f4
  

  2 peopleauthored and

  dongjoon-hyun

  committed
  983f6f4

• [SPARK-49745][SS] Add change to read registered timers through state data source reader

  Show description for d230232
  

  anishshri-db

  and

  HeartSaVioR

  committed
  d230232

• [SPARK-49609][PYTHON][FOLLOWUP] Correct the typehint for filter and where

  Show description for 0ccf53a
  zhengruifeng

  committed
  0ccf53a

• [SPARK-49775][SQL][TESTS] Make tests of INVALID_PARAMETER_VALUE.CHARSET deterministic

  Show description for c362d50
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  c362d50

• [SPARK-49767][PS][CONNECT] Refactor the internal function invocation

  Show description for e1b2ac5
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  e1b2ac5

• [SPARK-49764][PYTHON][CONNECT] Support area plots

  Show description for 7f0ecd4
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  7f0ecd4

• [SPARK-49609][PYTHON][TESTS][FOLLOW-UP] Skip Spark Connect tests if dependencies are not found

  Show description for 46c5acc
  

  HyukjinKwon

  authored and

  itholic

  committed
  46c5acc

• [SPARK-49765][DOCS][PYTHON] Adjust documentation of "spark.sql.pyspark.plotting.max_rows"

  Show description for 5134c68
  

  xinrong-meng

  authored and

  HyukjinKwon

  committed
  5134c68

• [SPARK-49772][SS] Remove ColumnFamilyOptions and add configs directly to dbOptions in RocksDB

  Show description for 9aa11d1
  

  liviazhu-db

  and

  HeartSaVioR

  committed
  9aa11d1

• [SPARK-49552][PYTHON] Add DataFrame API support for new 'randstr' and 'uniform' SQL functions

  Show description for e2d2ab5
  

  dtenedor

  authored and

  zhengruifeng

  committed
  e2d2ab5

• [SPARK-49743][SQL] OptimizeCsvJsonExpr should not change schema fields when pruning GetArrayStructFields

  Show description for a4fb6cb
  

  nikhilsheoran-db

  authored and

  cloud-fan

  committed
  a4fb6cb

• [SPARK-49463] Support ListState for TransformWithStateInPandas

  Show description for 828b1f9
  

  bogao007

  authored and

  HeartSaVioR

  committed
  828b1f9

• [SPARK-49369][CONNECT][SQL] Add implicit Column conversions

  Show description for 0c234bb
  hvanhovell

  committed
  0c234bb

• [SPARK-49282][CONNECT][SQL] Create a shared SparkSessionBuilder interface

  Show description for 5fb0ff9
  hvanhovell

  committed
  5fb0ff9

Commits on Sep 24, 2024

• [SPARK-49688][CONNECT] Fix a data race between interrupt and execute plan

  Show description for 29ed272
  

  changgyoopark-db

  authored and

  HyukjinKwon

  committed
  29ed272

• [SPARK-49585][CONNECT] Replace executions map in SessionHolder with operationID set

  Show description for 0a7b985
  

  changgyoopark-db

  authored and

  HyukjinKwon

  committed
  0a7b985

• [SPARK-49771][PYTHON] Improve Pandas Scalar Iter UDF error when output rows exceed input rows

  Show description for afe8bf9
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  afe8bf9

• [SPARK-49713][PYTHON][FOLLOWUP] Make function count_min_sketch accept long seed

  Show description for 55d0233
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  55d0233

• [SPARK-49750][DOC] Mention delegation token support in K8s mode

  Show description for dedf5aa
  

  pan3793

  authored and

  dongjoon-hyun

  committed
  dedf5aa

• [SPARK-49630][SS] Add flatten option to process collection types with state data source reader

  Show description for 73d6bd7
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  73d6bd7

• [SPARK-49609][PYTHON][CONNECT] Add API compatibility check between Classic and Connect

  Show description for 982028e
  itholic

  committed
  982028e

• [SPARK-49694][PYTHON][CONNECT] Support scatter plots

  Show description for 6bdd151
  xinrong-meng

  committed
  6bdd151

Pagination

Previous

Next