Commits

Branch selector

 master

User selector

jkff

Datepicker

All time

Commit History

Commits on Apr 8, 2015

• Renames the ReadSource transform to Read for consistency with Write.

  Show description for 36778d8
  

  jkff

  authored and

  davorbonaci

  committed
  36778d8

  Copy full SHA for 36778d8

Commits on Apr 6, 2015

• * Introduces Reader.getCurrentTimestamp() to support producing timestamps

  Show description for 0579165
  

  jkff

  authored and

  davorbonaci

  committed
  0579165

  Copy full SHA for 0579165

• * Updates SDK to use renamed protos after the shard=>bundle and fork=>split rename

  Show description for 291eb75
  

  jkff

  authored and

  davorbonaci

  committed
  291eb75

  Copy full SHA for 291eb75

• Fixes the flakiness of CounterTest because of reliance on order of iteration in a HashSet.

  Show description for 6c6748c
  

  jkff

  authored and

  davorbonaci

  committed
  6c6748c

  Copy full SHA for 6c6748c

• SDK support for progress estimation and dynamic work rebalancing in custom sources:

  Show description for e07ed2f
  

  jkff

  authored and

  davorbonaci

  committed
  e07ed2f

  Copy full SHA for e07ed2f

• * Makes Source<T> yield values simply of type T and renames createBasicReader

  Show description for d5bdfb5
  

  jkff

  authored and

  davorbonaci

  committed
  d5bdfb5

  Copy full SHA for d5bdfb5

• Makes Source<T> yield values simply of type T and renames createBasicReader to createReader.

  Show description for 08f8bf7
  

  jkff

  authored and

  davorbonaci

  committed
  08f8bf7

  Copy full SHA for 08f8bf7

Commits on Mar 24, 2015

• Renames fork => dynamic split in the Dataflow Java SDK.

  Show description for 7cbc12a
  

  jkff

  authored and

  davorbonaci

  committed
  7cbc12a

  Copy full SHA for 7cbc12a

Commits on Mar 23, 2015

• Renaming shard => bundle in the Java custom source API.

  Show description for 2a8d571
  

  jkff

  authored and

  davorbonaci

  committed
  2a8d571

  Copy full SHA for 2a8d571

Commits on Mar 21, 2015

• Minor improvements related to custom sources:

  Show description for fb62173
  

  jkff

  authored and

  davorbonaci

  committed
  fb62173

  Copy full SHA for fb62173

Commits on Mar 13, 2015

• Makes a few ReaderIterator classes treat the condition "requestFork at a position below the current stop position" as normal (but of course not fork-inducing), rather than throw an exception.

  Show description for f0d7151
  

  jkff

  authored and

  davorbonaci

  committed
  f0d7151

  Copy full SHA for f0d7151

• Improves error messages in AvroReader and FileBasedReader when filepattern matches

  Show description for ca2e7da
  

  jkff

  authored and

  davorbonaci

  committed
  ca2e7da

  Copy full SHA for ca2e7da

Commits on Mar 6, 2015

• Downgrades a very chatty GCS message from info to debug.

  Show description for 77c939e
  

  jkff

  authored and

  davorbonaci

  committed
  77c939e

  Copy full SHA for 77c939e

Commits on Feb 27, 2015

• Rollback the change to slightly improve invalid bucket name error message.

  Show description for 92d06eb
  

  jkff

  authored and

  davorbonaci

  committed
  92d06eb

  Copy full SHA for 92d06eb

Commits on Feb 11, 2015

• Don't log the whole classpath at INFO, but log how many files will be staged and how to see what they are.

  Show description for 914fc7c
  

  jkff

  authored and

  davorbonaci

  committed
  914fc7c

  Copy full SHA for 914fc7c

• Generalizes updateStopPosition to requestFork, which can potentially return something

  Show description for f42c13c
  

  jkff

  authored and

  davorbonaci

  committed
  f42c13c

  Copy full SHA for f42c13c

Commits on Feb 6, 2015

• Logging which stop position was unreported, when tearing down a task which has an unreported stop position.

  Show description for 3872228
  

  jkff

  authored and

  davorbonaci

  committed
  3872228

  Copy full SHA for 3872228

Commits on Jan 27, 2015

• * High-level API for defining basic custom sources (doesn't support any of the

  Show description for 4549ebc
  

  jkff

  authored and

  davorbonaci

  committed
  4549ebc

  Copy full SHA for 4549ebc

Commits on Jan 9, 2015

• Renames Source -> Reader (ergo in associated classes such as SourceIterator, SourceFactory, tests, local variables etc.).

  Show description for 7c27fb6
  

  jkff

  authored and

  lukecwik

  committed
  7c27fb6

  Copy full SHA for 7c27fb6

• Avoids creating a thread in ReadOperation if progress estimation is not enabled or is continuous.

  Show description for 3be5a2a
  

  jkff

  authored and

  lukecwik

  committed
  3be5a2a

  Copy full SHA for 3be5a2a

• * Raise logging level of non-retryable HTTP request URLs to warning.

  Show description for 623b6b7
  

  jkff

  authored and

  lukecwik

  committed
  623b6b7

  Copy full SHA for 623b6b7