Skip to content

Commit

Permalink
[BEAM-11754] Update docs about EOS support
Browse files Browse the repository at this point in the history
  • Loading branch information
mxm authored and Maximilian Michels committed May 5, 2021

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
1 parent d9da8a4 commit 00c5cd2
Showing 1 changed file with 2 additions and 4 deletions.
Original file line number Diff line number Diff line change
@@ -2197,10 +2197,8 @@ public WriteRecords<K, V> withPublishTimestampFunction(
* transform ties checkpointing semantics in compatible Beam runners and transactions in Kafka
* (version 0.11+) to ensure a record is written only once. As the implementation relies on
* runners checkpoint semantics, not all the runners are compatible. The sink throws an
* exception during initialization if the runner is not explicitly allowed. Flink runner is one
* of the runners whose checkpoint semantics are not compatible with current implementation
* (hope to provide a solution in near future). Dataflow runner and Spark runners are
* compatible.
* exception during initialization if the runner is not explicitly allowed. The Dataflow, Flink,
* and Spark runners are compatible.
*
* <p>Note on performance: Exactly-once sink involves two shuffles of the records. In addition
* to cost of shuffling the records among workers, the records go through 2

0 comments on commit 00c5cd2

Please sign in to comment.