Commits

Branch selector

 master

User selector

anishshri-db

Datepicker

All time

Commit History

Commits on Apr 13, 2023

• [SPARK-43120][SS] Add support for tracking pinned blocks memory usage for RocksDB state store

  Show description for ace85f2
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  ace85f2

  Copy full SHA for ace85f2

Commits on Apr 10, 2023

• [SPARK-43056][SS] RocksDB state store commit should continue background work only if its paused

  Show description for 5becb89
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  5becb89

  Copy full SHA for 5becb89

Commits on Mar 30, 2023

• [SPARK-42968][SS] Add option to skip commit coordinator as part of StreamingWrite API for DSv2 sources/sinks

  Show description for 122a88c
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  122a88c

  Copy full SHA for 122a88c

Commits on Mar 16, 2023

• [SPARK-42819][SS] Add support for setting max_write_buffer_number and write_buffer_size for RocksDB used in streaming

  Show description for bafb953
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  bafb953

  Copy full SHA for bafb953

Commits on Mar 15, 2023

• [SPARK-42792][SS] Add support for WRITE_FLUSH_BYTES for RocksDB used in streaming stateful operators

  Show description for 6259b97
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  6259b97

  Copy full SHA for 6259b97

Commits on Mar 6, 2023

• [SPARK-42668][SS] Catch exception while trying to close compressed stream in HDFSStateStoreProvider abort

  Show description for 252e7a3
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  252e7a3

  Copy full SHA for 252e7a3

• [SPARK-42676][SS] Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

  Show description for 8eb8de1
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  8eb8de1

  Copy full SHA for 8eb8de1

Commits on Feb 25, 2023

• [SPARK-42567][SS][SQL] Track load time for state store provider and log warning if it exceeds threshold

  Show description for 6b71f71
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  6b71f71

  Copy full SHA for 6b71f71

Commits on Jan 12, 2023

• [SPARK-41996][SQL][SS] Fix kafka test to verify lost partitions to account for slow Kafka operations

  Show description for 3d7a5fd
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  3d7a5fd

  Copy full SHA for 3d7a5fd

Commits on Jul 15, 2022

• [SPARK-39781][SS] Add support for providing max_open_files to rocksdb state store provider

  Show description for c05d0fd
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  c05d0fd

  Copy full SHA for c05d0fd

Commits on May 24, 2022

• [SPARK-39264][SS] Fix type check and conversion to longOffset for awaitOffset fix

  Show description for ea21527
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  ea21527

  Copy full SHA for ea21527

Commits on May 22, 2022

• [SPARK-39242][SS] Fix awaitOffset to wait for committedOffset to reach at-least expected offset for longOffset and fix RateStreamProvider test

  Show description for 230c2dd
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  230c2dd

  Copy full SHA for 230c2dd

Commits on Apr 8, 2022

• [SPARK-38809][SS] Implement option to skip null values in symmetric hash implementation of stream-stream joins

  Show description for 61c489e
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  61c489e

  Copy full SHA for 61c489e

Commits on Apr 6, 2022

• [SPARK-38787][SS] Replace found value with non-null element in the remaining list for key and remove remaining null elements from values in keyWithIndexToValue store for stream-stream joins

  Show description for 6d9bfb6
  

  anishshri-db

  authored and

  HeartSaVioR

  committed
  6d9bfb6

  Copy full SHA for 6d9bfb6