Commits

Branch selector

 master

User selector

tdas

Datepicker

All time

Commit History

Commits on Oct 8, 2018

• [SPARK-25639][DOCS] Added docs for foreachBatch, python foreach and multiple watermarks

  Show description for f9935a3
  tdas

  committed
  f9935a3

Commits on Aug 22, 2018

• [SPARK-25184][SS] Fixed race condition in StreamExecution that caused flaky test in FlatMapGroupsWithState

  Show description for 3106324
  tdas

  committed
  3106324

• [MINOR] Added import to fix compilation

  Show description for a998e9d
  tdas

  committed
  a998e9d

Commits on Jul 23, 2018

• [SPARK-24699][SS] Make watermarks work with Trigger.Once by saving updated watermark to commit log

  Show description for 61f0ca4
  tdas

  committed
  61f0ca4

Commits on Jul 19, 2018

• [SPARK-22187][SS] Update unsaferow format for saved state in flatMapGroupsWithState to allow timeouts with deleted state

  Show description for b3d88ac
  tdas

  committed
  b3d88ac

Commits on Jul 11, 2018

• [SPARK-24697][SS] Fix the reported start offsets in streaming query progress

  Show description for ff7f6ef
  tdas

  committed
  ff7f6ef

• [SPARK-24730][SS] Add policy to choose max as global watermark when streaming query has multiple watermarks

  Show description for 6078b89
  tdas

  committed
  6078b89

Commits on Jun 19, 2018

• [SPARK-24565][SS] Add API for in Structured Streaming for exposing output rows of each microbatch as a DataFrame

  Show description for 2cb9763
  

  tdas

  authored and

  zsxwing

  committed
  2cb9763

Commits on Jun 15, 2018

• [SPARK-24396][SS][PYSPARK] Add Structured Streaming ForeachWriter for python

  Show description for b5ccf0d
  tdas

  committed
  b5ccf0d

Commits on Jun 5, 2018

• [SPARK-24453][SS] Fix error recovering from the failure in a no-data batch

  Show description for 2c2a86b
  tdas

  committed
  2c2a86b

Commits on May 31, 2018

• [SPARK-24397][PYSPARK] Added TaskContext.getLocalProperty(key) in Python

  Show description for 223df5d
  tdas

  committed
  223df5d

Commits on May 18, 2018

• [SPARK-24159][SS] Enable no-data micro batches for streaming mapGroupswithState

  Show description for 807ba44
  

  tdas

  authored and

  zsxwing

  committed
  807ba44

Commits on May 16, 2018

• [SPARK-24158][SS] Enable no-data batches for streaming joins

  Show description for 991726f
  tdas

  committed
  991726f

Commits on May 4, 2018

• [SPARK-24157][SS] Enabled no-data batches in MicroBatchExecution for streaming aggregation and deduplication.

  Show description for 47b5b68
  tdas

  committed
  47b5b68

Commits on Apr 26, 2018

• [SPARK-24094][SS][MINOR] Change description strings of v2 streaming sources to reflect the change

  Show description for d1eb8d3
  tdas

  committed
  d1eb8d3

Commits on Apr 25, 2018

• [SPARK-24050][SS] Calculate input / processing rates correctly for DataSourceV2 streaming sources

  Show description for 396938e
  tdas

  committed
  396938e

Commits on Apr 24, 2018

• [SPARK-24056][SS] Make consumer creation lazy in Kafka source for Structured streaming

  Show description for 7b1e652
  tdas

  committed
  7b1e652

Commits on Apr 23, 2018

• [SPARK-23004][SS] Ensure StateStore.commit is called only once in a streaming aggregation task

  Show description for 770add8
  tdas

  committed
  770add8

Commits on Apr 13, 2018

• [SPARK-23966][SS] Refactoring all checkpoint file writing logic in a common CheckpointFileManager interface

  Show description for cbb41a0
  tdas

  committed
  cbb41a0

Commits on Mar 30, 2018

• [SPARK-23827][SS] StreamingJoinExec should ensure that input data is partitioned into specific number of partitions

  Show description for 15298b9
  tdas

  committed
  15298b9

Commits on Mar 16, 2018

• [SPARK-23623][SS] Avoid concurrent use of cached consumers in CachedKafkaConsumer

  Show description for bd201bf
  

  tdas

  authored and

  zsxwing

  committed
  bd201bf

Commits on Mar 3, 2018

• [SPARK-23541][SS] Allow Kafka source to read data with greater parallelism than the number of topic-partitions

  Show description for 486f99e
  tdas

  committed
  486f99e

Commits on Feb 23, 2018

• [SPARK-23408][SS] Synchronize successive AddData actions in Streaming*JoinSuite

  Show description for 855ce13
  tdas

  committed
  855ce13

Commits on Feb 21, 2018

• [SPARK-23484][SS] Fix possible race condition in KafkaContinuousReader

  Show description for 3fd0ccb
  tdas

  committed
  3fd0ccb

• [SPARK-23454][SS][DOCS] Added trigger information to the Structured Streaming programming guide

  Show description for 601d653
  tdas

  committed
  601d653

Commits on Feb 16, 2018

• [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

  Show description for 0a73aa3
  tdas

  committed
  0a73aa3

Commits on Feb 14, 2018

• [SPARK-23406][SS] Enable stream-stream self-joins

  Show description for 658d9d9
  tdas

  committed
  658d9d9

Commits on Feb 7, 2018

• [SPARK-23092][SQL] Migrate MemoryStream to DataSourceV2 APIs

  Show description for 30295bf
  tdas

  committed
  30295bf

Commits on Feb 3, 2018

• [SPARK-23064][SS][DOCS] Stream-stream joins Documentation - follow up

  Show description for eaf35de
  tdas

  committed
  eaf35de

Commits on Jan 24, 2018

• [SPARK-23197][DSTREAMS] Increased timeouts to resolve flakiness

  Show description for 15adcc8
  tdas

  committed
  15adcc8

Commits on Jan 19, 2018

• [SPARK-23142][SS][DOCS] Added docs for continuous processing

  Show description for 4cd2ecc
  tdas

  committed
  4cd2ecc

Commits on Jan 18, 2018

• [SPARK-23144][SS] Added console sink for continuous processing

  Show description for bf34d66
  tdas

  committed
  bf34d66

• [SPARK-23143][SS][PYTHON] Added python API for setting continuous trigger

  Show description for 2d41f04
  tdas

  committed
  2d41f04

• [SPARK-23064][DOCS][SS] Added documentation for stream-stream joins

  Show description for 1002bd6
  

  tdas

  authored and

  zsxwing

  committed
  1002bd6

• [SPARK-23119][SS] Minor fixes to V2 streaming APIs

  Show description for bac0d66
  

  tdas

  authored and

  zsxwing

  committed
  bac0d66

Pagination

Previous

Next