Commits

Branch selector

 master

User selector

bogao007

Datepicker

All time

Commit History

Commits on Dec 14, 2024

• [SPARK-50540][PYTHON][SS] Fix string schema for StatefulProcessorHandle

  Show description for 5538d85
  

  bogao007

  authored and

  HeartSaVioR

  committed
  5538d85

  Copy full SHA for 5538d85

Commits on Dec 12, 2024

• [SPARK-50428][SS][PYTHON] Support TransformWithStateInPandas in batch queries

  Show description for d84b2d4
  

  bogao007

  authored and

  HeartSaVioR

  committed
  d84b2d4

  Copy full SHA for d84b2d4

Commits on Nov 11, 2024

• [SPARK-50275][SS][PYTHON] Enable test_pandas_transform_with_state unit test

  Show description for 7dbd17d
  

  bogao007

  authored and

  HeartSaVioR

  committed
  7dbd17d

  Copy full SHA for 7dbd17d

Commits on Nov 9, 2024

• [SPARK-50270][SS][PYTHON] Added custom state metrics for TransformWithStateInPandas

  Show description for 8f5d8d4
  

  bogao007

  authored and

  HeartSaVioR

  committed
  8f5d8d4

  Copy full SHA for 8f5d8d4

Commits on Nov 8, 2024

• [SPARK-49899][PYTHON][SS] Support deleteIfExists for TransformWithStateInPandas

  Show description for e4638c8
  

  bogao007

  authored and

  HeartSaVioR

  committed
  e4638c8

  Copy full SHA for e4638c8

Commits on Oct 21, 2024

• [SPARK-49821][SS][PYTHON] Implement MapState and TTL support for TransformWithStateInPandas

  Show description for c1198fa
  

  bogao007

  authored and

  HeartSaVioR

  committed
  c1198fa

  Copy full SHA for c1198fa

Commits on Oct 6, 2024

• [SPARK-49744][SS][PYTHON] Implement TTL support for ListState in TransformWithStateInPandas

  Show description for 06a8f6b
  

  bogao007

  authored and

  HeartSaVioR

  committed
  06a8f6b

  Copy full SHA for 06a8f6b

Commits on Sep 25, 2024

• [SPARK-49463] Support ListState for TransformWithStateInPandas

  Show description for 828b1f9
  

  bogao007

  authored and

  HeartSaVioR

  committed
  828b1f9

  Copy full SHA for 828b1f9

Commits on Aug 22, 2024

• [SPARK-49301][SS] Chunk arrow data passed to Python worker

  Show description for e93c5fb
  

  bogao007

  authored and

  HyukjinKwon

  committed
  e93c5fb

  Copy full SHA for e93c5fb

Commits on Aug 15, 2024

• [SPARK-48755][SS][PYTHON] transformWithState pyspark base implementation and ValueState support

  Show description for def42d4
  

  2 peopleauthored and

  HeartSaVioR

  committed
  def42d4

  Copy full SHA for def42d4

Commits on Aug 13, 2024

• [SPARK-49146][SS] Move assertion errors related to watermark missing in append mode streaming queries to error framework

  Show description for 2e96fc2
  

  bogao007

  authored and

  HeartSaVioR

  committed
  2e96fc2

  Copy full SHA for 2e96fc2

Commits on May 3, 2024

• [SPARK-48048][CONNECT][SS] Added client side listener support for Scala

  Show description for f156db2
  

  bogao007

  authored and

  HyukjinKwon

  committed
  f156db2

  Copy full SHA for f156db2

Commits on Feb 13, 2024

• [SPARK-47004][CONNECT] Added more tests to ClientStreamingQuerySuite to increase Scala client test coverage

  Show description for 7acc156
  

  bogao007

  authored and

  HyukjinKwon

  committed
  7acc156

  Copy full SHA for 7acc156

Commits on Sep 20, 2023

• [SPARK-44463][SS][CONNECT] Improve error handling for Connect steaming Python worker

  Show description for d62a8e6
  

  bogao007

  authored and

  HyukjinKwon

  committed
  d62a8e6

  Copy full SHA for d62a8e6

Commits on Aug 21, 2023

• [SPARK-44877][CONNECT][PYTHON] Support python protobuf functions for Spark Connect

  Show description for 5151b5b
  

  bogao007

  authored and

  zhengruifeng

  committed
  5151b5b

  Copy full SHA for 5151b5b

Commits on Aug 2, 2023

• [SPARK-44626][SS][CONNECT] Followup on streaming query termination when client session is timed out for Spark Connect

  Show description for 79938ee
  

  bogao007

  authored and

  HyukjinKwon

  committed
  79938ee

  Copy full SHA for 79938ee

Commits on Jul 30, 2023

• [SPARK-44432][SS][CONNECT] Terminate streaming queries when a session times out in Spark Connect

  Show description for 4d3fb62
  

  bogao007

  authored and

  HyukjinKwon

  committed
  4d3fb62

  Copy full SHA for 4d3fb62

Commits on Jul 17, 2023

• [SPARK-44439][CONNECT][SS] Fixed listListeners to only send ids back to client

  Show description for 61b9236
  

  bogao007

  authored and

  HyukjinKwon

  committed
  61b9236

  Copy full SHA for 61b9236

Commits on Jul 14, 2023

• [SPARK-44201][CONNECT][SS] Add support for Streaming Listener in Scala for Spark Connect

  Show description for fd518da
  

  bogao007

  authored and

  HyukjinKwon

  committed
  fd518da

  Copy full SHA for fd518da

Commits on Jun 22, 2023

• [SPARK-44136][SS] Fixed an issue that StateManager may get materialized in executor instead of driver in FlatMapGroupsWithStateExec

  Show description for fb4d6d9
  

  bogao007

  authored and

  HyukjinKwon

  committed
  fb4d6d9

  Copy full SHA for fb4d6d9

Commits on Jun 21, 2023

• [SPARK-43511][CONNECT][SS] Implemented MapGroupsWithState and FlatMapGroupsWithState APIs for Spark Connect

  Show description for 8a16aed
  

  bogao007

  authored and

  HyukjinKwon

  committed
  8a16aed

  Copy full SHA for 8a16aed

Commits on May 15, 2023

• [MINOR][CONNECT][SS][TESTS] Increase timeout to 30s for tests in StreamingQuerySuite

  Show description for 81b93e9
  

  bogao007

  authored and

  HeartSaVioR

  committed
  81b93e9

  Copy full SHA for 81b93e9

Commits on Apr 22, 2023

• [SPARK-43046][SS][CONNECT] Implemented Python API dropDuplicatesWithinWatermark for Spark Connect

  Show description for 4d76511
  

  bogao007

  authored and

  HyukjinKwon

  committed
  4d76511

  Copy full SHA for 4d76511