Commits

Breadcrumbs

History for

on5151b5b

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 21, 2023

• [SPARK-40178][SQL][COONECT] Support coalesce hints with ease for PySpark and R

  Show description for 3d5a7d9
  

  advancedxy

  authored and

  HyukjinKwon

  committed
  3d5a7d9

  Copy full SHA for 3d5a7d9

Commits on Aug 17, 2023

• [SPARK-44433][3.5X] Terminate foreach batch runner when streaming query terminates

  Show description for 6771d9d
  

  Raghu Angadi

  authored and

  hvanhovell

  committed
  6771d9d

  Copy full SHA for 6771d9d

• [SPARK-44849] Expose SparkConnectExecutionManager.listActiveExecutions

  Show description for 047b224
  

  juliuszsompolski

  authored and

  hvanhovell

  committed
  047b224

  Copy full SHA for 047b224

• [SPARK-44806][CONNECT] Move internal client spark-connect-common to be able to test real in-process server with a real RPC client

  Show description for 72a4668
  

  juliuszsompolski

  authored and

  hvanhovell

  committed
  72a4668

  Copy full SHA for 72a4668

• [SPARK-44721][CONNECT] Revamp retry logic and make retries run for 10 minutes

  Show description for 4952a03
  

  cdkrot

  authored and

  HyukjinKwon

  committed
  4952a03

  Copy full SHA for 4952a03

Commits on Aug 16, 2023

• [SPARK-44829][CONNECT] Expose uploadAllArtifactClasses in ArtifactManager to sql package

  Show description for 6ae4f4f
  

  vsevolodstep-db

  authored and

  hvanhovell

  committed
  6ae4f4f

  Copy full SHA for 6ae4f4f

• [SPARK-44807][CONNECT] Add Dataset.metadataColumn to Scala Client

  Show description for 80118e2
  hvanhovell

  committed
  80118e2

  Copy full SHA for 80118e2

• [SPARK-44799][CONNECT] Fix outer scopes resolution on the executor side

  Show description for cb8c653
  hvanhovell

  committed
  cb8c653

  Copy full SHA for cb8c653

• [SPARK-44795][CONNECT][TESTS][FOLLOWUP] Fix test case REPL class in UDF for Scala 2.13

  Show description for ed906e0
  LuciferYang

  committed
  ed906e0

  Copy full SHA for ed906e0

• [SPARK-44824][CONNECT][TESTS] Reset ammoniteOut in the afterEach method of ReplE2ESuite

  Show description for 7d96f12
  LuciferYang

  committed
  7d96f12

  Copy full SHA for 7d96f12

Commits on Aug 15, 2023

• [SPARK-42664][CONNECT] Support bloomFilter function for DataFrameStatFunctions

  Show description for b9f1114
  

  LuciferYang

  authored and

  hvanhovell

  committed
  b9f1114

  Copy full SHA for b9f1114

• [SPARK-44794][CONNECT] Make Streaming Queries work with Connect's artifact management

  Show description for 2ab404f
  hvanhovell

  committed
  2ab404f

  Copy full SHA for 2ab404f

• [SPARK-44653][SQL][FOLLOWUP] ResolveUnion should not combine Unions

  Show description for a53a9e9
  

  cloud-fan

  authored and

  yaooqinn

  committed
  a53a9e9

  Copy full SHA for a53a9e9

• [SPARK-44791][CONNECT][TESTS][FOLLOWUP] Fix test case Collect REPL generated class for Scala 2.13

  Show description for 6c85ec3
  LuciferYang

  committed
  6c85ec3

  Copy full SHA for 6c85ec3

• [SPARK-43380][SQL] Revert Fix Avro data type conversion issues

  Show description for 46580ab
  

  zeruibao

  authored and

  gengliangwang

  committed
  46580ab

  Copy full SHA for 46580ab

• [SPARK-44795][CONNECT] CodeGenerator Cache should be classloader specific

  Show description for 1d56290
  hvanhovell

  committed
  1d56290

  Copy full SHA for 1d56290

Commits on Aug 14, 2023

• [SPARK-44749][SQL][PYTHON] Support named arguments in Python UDTF

  Show description for d462956
  ueshin

  committed
  d462956

  Copy full SHA for d462956

• Revert "Add test"

  Show description for 4815463
  hvanhovell

  committed
  4815463

  Copy full SHA for 4815463

• Add test

  hvanhovell

  committed
  2c465f6

  Copy full SHA for 2c465f6

• [SPARK-44791][CONNECT] Make ArrowDeserializer work with REPL generated classes

  Show description for dcf3d58
  hvanhovell

  committed
  dcf3d58

  Copy full SHA for dcf3d58

Commits on Aug 13, 2023

• [SPARK-44736][CONNECT] Add Dataset.explode to Spark Connect Scala Client

  Show description for f496cd1
  

  32 peoplecommitted
  f496cd1

  Copy full SHA for f496cd1

Commits on Aug 11, 2023

• [SPARK-44422][FOLLOWUP][CONNECT] Fix typo in ProtoUtils

  Show description for 3ed9920
  

  juliuszsompolski

  authored and

  HyukjinKwon

  committed
  3ed9920

  Copy full SHA for 3ed9920

• [SPARK-44625][CONNECT][FOLLOWUP] Make initialization of SparkConnectExecutionManager lazy

  Show description for 3c5f6a2
  

  juliuszsompolski

  authored and

  HyukjinKwon

  committed
  3c5f6a2

  Copy full SHA for 3c5f6a2

• [SPARK-44625][CONNECT] SparkConnectExecutionManager to track all executions

  Show description for 84dbe84
  

  juliuszsompolski

  authored and

  hvanhovell

  committed
  84dbe84

  Copy full SHA for 84dbe84

• [SPARK-44761][CONNECT] Support DataStreamWriter.foreachBatch(VoidFunction2)

  Show description for 5a27dc9
  

  hvanhovell

  and

  HyukjinKwon

  committed
  5a27dc9

  Copy full SHA for 5a27dc9

• [SPARK-44770][WEBUI] Add a displayOrder variable to WebUITab to specify the order in which tabs appear

  Show description for 92f2d65
  

  jasonli-db

  authored and

  yaooqinn

  committed
  92f2d65

  Copy full SHA for 92f2d65

• [SPARK-44765][CONNECT] Simplify retries of ReleaseExecute

  Show description for 9bde882
  

  juliuszsompolski

  authored and

  HyukjinKwon

  committed
  9bde882

  Copy full SHA for 9bde882

• [SPARK-43032][FOLLOWUP][SS][CONNECT] StreamingQueryManager bug fix

  Show description for 42eb422
  

  WweiL

  authored and

  HyukjinKwon

  committed
  42eb422

  Copy full SHA for 42eb422

Commits on Aug 10, 2023

• [SPARK-44747][CONNECT] Add missing SparkSession.Builder methods

  Show description for d27496e
  

  hvanhovell

  authored and

  HyukjinKwon

  committed
  d27496e

  Copy full SHA for d27496e

Commits on Aug 9, 2023

• [SPARK-44740][CONNECT] Support specifying session_id in SPARK_REMOTE connection string

  Show description for 7af4e35
  

  grundprinzip

  authored and

  HyukjinKwon

  committed
  7af4e35

  Copy full SHA for 7af4e35

• [SPARK-44720][CONNECT] Make Dataset use Encoder instead of AgnosticEncoder

  Show description for be9ffb3
  hvanhovell

  committed
  be9ffb3

  Copy full SHA for be9ffb3

• [SPARK-43429][CONNECT] Deflake SparkSessionSuite

  Show description for 27c5a1f
  

  hvanhovell

  authored and

  HyukjinKwon

  committed
  27c5a1f

  Copy full SHA for 27c5a1f

Commits on Aug 8, 2023

• [SPARK-44722][CONNECT] ExecutePlanResponseReattachableIterator._call_iter: AttributeError: 'NoneType' object has no attribute 'message'

  Show description for ea00ecd
  

  juliuszsompolski

  authored and

  HyukjinKwon

  committed
  ea00ecd

  Copy full SHA for ea00ecd

• [SPARK-44709][CONNECT] Run ExecuteGrpcResponseSender in reattachable execute in new thread to fix flow control

  Show description for 418bba5
  

  juliuszsompolski

  authored and

  hvanhovell

  committed
  418bba5

  Copy full SHA for 418bba5

• [SPARK-44715][CONNECT] Bring back callUdf and udf function

  Show description for 8c444f4
  hvanhovell

  committed
  8c444f4

  Copy full SHA for 8c444f4

Pagination

Previous

Next