Commits

Branch selector

 master

User selector

peihe

Datepicker

All time

Commit History

Commits on Jun 26, 2015

• Implement GroupAlsoByWindowsAndCombineDoFn

  Show description for c4b7682
  

  peihe

  authored and

  lukecwik

  committed
  c4b7682

  Copy full SHA for c4b7682

• PTransform.getName() refactoring and fixes for readable names in UI

  Show description for 3e846b5
  

  peihe

  authored and

  lukecwik

  committed
  3e846b5

  Copy full SHA for 3e846b5

Commits on Jun 18, 2015

• Fix a typo in Aggregator java doc

  Show description for 192c350
  

  peihe

  authored and

  davorbonaci

  committed
  192c350

  Copy full SHA for 192c350

Commits on Jun 12, 2015

• Update ExamplePubsubTopicOptions to use pubsub v1beta2 format

  Show description for a3d2c8e
  

  peihe

  authored and

  davorbonaci

  committed
  a3d2c8e

  Copy full SHA for a3d2c8e

Commits on May 28, 2015

• Updated KMean to do Windowing, and be able to run in streaming.

  Show description for 8aa7849
  

  peihe

  authored and

  davorbonaci

  committed
  8aa7849

  Copy full SHA for 8aa7849

Commits on May 21, 2015

• Mark PCollections as bounded or unbounded

  Show description for af42f3a
  

  peihe

  authored and

  davorbonaci

  committed
  af42f3a

  Copy full SHA for af42f3a

Commits on May 14, 2015

• Only invoke waitToFinish() when DataflowPipelineJob is provided.

  Show description for 98357fb
  

  peihe

  authored and

  davorbonaci

  committed
  98357fb

  Copy full SHA for 98357fb

Commits on May 12, 2015

• Move GroupByKey expansion to the backend.

  Show description for 2eff826
  

  peihe

  authored and

  davorbonaci

  committed
  2eff826

  Copy full SHA for 2eff826

• Set maxTimestamp of GlobalWindow to be one day before max.

  Show description for e2e2ac6
  

  peihe

  authored and

  davorbonaci

  committed
  e2e2ac6

  Copy full SHA for e2e2ac6

• Improve the getSideInputWindow behavior for windowed side inputs.

  Show description for fa36a56
  

  peihe

  authored and

  davorbonaci

  committed
  fa36a56

  Copy full SHA for fa36a56

• FIX the condition of invoking ProcessElement for individual window.

  Show description for c8b366b
  

  peihe

  authored and

  davorbonaci

  committed
  c8b366b

  Copy full SHA for c8b366b

• StreamingWordExtract: sets up and tears down the pipeline automatically with

  Show description for ee36c40
  

  peihe

  authored and

  davorbonaci

  committed
  ee36c40

  Copy full SHA for ee36c40

• Fix a typo in Window java doc.

  Show description for 480fbbf
  

  peihe

  authored and

  davorbonaci

  committed
  480fbbf

  Copy full SHA for 480fbbf

Commits on Apr 14, 2015

• Fix AutoComplete example, and uses DataflowExampleUtils to set up and tear down the example pipeline.

  Show description for b885f61
  

  peihe

  authored and

  davorbonaci

  committed
  b885f61

  Copy full SHA for b885f61

Commits on Apr 11, 2015

• Allows empty value for String, String Array, and Collection in PipelineOptions, added the validation for other types.

  Show description for 035742e
  

  peihe

  authored and

  davorbonaci

  committed
  035742e

  Copy full SHA for 035742e

• Update "Traffic" Streaming Examples instructions.

  Show description for 621e842
  

  peihe

  authored and

  davorbonaci

  committed
  621e842

  Copy full SHA for 621e842

• fix the typos in the Traffic example java docs.

  Show description for af805e6
  

  peihe

  authored and

  davorbonaci

  committed
  af805e6

  Copy full SHA for af805e6

• fix the typo in the Traffic example java docs.

  Show description for 1f46717
  

  peihe

  authored and

  davorbonaci

  committed
  1f46717

  Copy full SHA for 1f46717

Commits on Apr 8, 2015

• Created a basic DataflowExampleUtils class to handle pubsub, bigquery setups and

  Show description for 3e0fe06
  

  peihe

  authored and

  davorbonaci

  committed
  3e0fe06

  Copy full SHA for 3e0fe06

• FIX a bug in PipelineOptions Serializer to support serializing/deserializing a PipelineOptions multiple times, which is required by cloneAs() use cases.

  Show description for 77f7c23
  

  peihe

  authored and

  davorbonaci

  committed
  77f7c23

  Copy full SHA for 77f7c23

• 1. Update SDK major version to "3" to enable groupAlsoByWindows combiner lifting. 2. pass in windowFn in GroupByKeyOnly to move the batch GroupByKey expansion to the backend. It enables combiner li…

  Show description for 6fd6506
  

  peihe

  authored and

  davorbonaci

  committed
  6fd6506

  Copy full SHA for 6fd6506

• Small fixes for CombiningWindowSet 1. use deleteTagList() for tags created by TagList. 2. prevent NullPointerException when reading a not-yet-written tag

  Show description for 2a3a699
  

  peihe

  authored and

  davorbonaci

  committed
  2a3a699

  Copy full SHA for 2a3a699

Commits on Apr 6, 2015

• Add cloneAs() to PipelineOptions to support running multiple pipelines with different PipelineOptions.

  Show description for b47d851
  

  peihe

  authored and

  davorbonaci

  committed
  b47d851

  Copy full SHA for b47d851

• Pass additional information from SDK to Dataflow backend: whether GroupByKeyOnly disallowCombinerLifting. It will allow Dataflow backend to choose a proper optimization.

  Show description for c48e733
  

  peihe

  authored and

  davorbonaci

  committed
  c48e733

  Copy full SHA for c48e733

• Fix a bug that introduces duplicated window in batch activeWindowManager, add check to prevent infinite loop, and add an regression test.

  Show description for c941cad
  

  peihe

  authored and

  davorbonaci

  committed
  c941cad

  Copy full SHA for c941cad

• Create additional local_dataflow_runner_test for Combine.globally in streaming, and add Count.globallyWithoutDefaults().

  Show description for 60b52ea
  

  peihe

  authored and

  davorbonaci

  committed
  60b52ea

  Copy full SHA for 60b52ea

Commits on Mar 23, 2015

• Create separate factory methods for different generics types in

  Show description for 3cc7dfc
  

  peihe

  authored and

  davorbonaci

  committed
  3cc7dfc

  Copy full SHA for 3cc7dfc

Commits on Mar 21, 2015

• BundedSource: use GlobalWindows as the default in GroupAlsoByWindowsParDoFn,

  Show description for 4bedd06
  

  peihe

  authored and

  davorbonaci

  committed
  4bedd06

  Copy full SHA for 4bedd06

Commits on Mar 13, 2015

• FIX: windmill uses kint64max usec as the timer max timestamp, keep the Java side in

  Show description for 4e0ecff
  

  peihe

  authored and

  davorbonaci

  committed
  4e0ecff

  Copy full SHA for 4e0ecff

Commits on Mar 9, 2015

• Create: java sdk code and integration test for supporting Create in streaming.

  Show description for 2993690
  

  peihe

  authored and

  davorbonaci

  committed
  2993690

  Copy full SHA for 2993690

• Explicitly check cached mapTaskExecutor's all operations could restart. Previously it fails at operation level.

  Show description for 70b0005
  

  peihe

  authored and

  davorbonaci

  committed
  70b0005

  Copy full SHA for 70b0005

Commits on Mar 6, 2015

• Windowing: java worker code to handle CombineFn in batch GroupAlsoByWindowsDoFn.

  Show description for bc188f0
  

  peihe

  authored and

  davorbonaci

  committed
  bc188f0

  Copy full SHA for bc188f0

• FIX: sideinput expects WindowedValues, update BigQueryReader to support BigqueryIO directly as sideinput.

  Show description for e8da55c
  

  peihe

  authored and

  davorbonaci

  committed
  e8da55c

  Copy full SHA for e8da55c

• CL resubmit:

  Show description for 636b387
  

  peihe

  authored and

  davorbonaci

  committed
  636b387

  Copy full SHA for 636b387

Commits on Feb 27, 2015

• Mark PartialGroupByKeyOperation can restart.

  Show description for b76455f
  

  peihe

  authored and

  davorbonaci

  committed
  b76455f

  Copy full SHA for b76455f

Pagination

Previous

Next