Commits

Branch selector

 master

User selector

chamikaramj

Datepicker

All time

Commit History

Commits on Jun 26, 2015

• Fixes the flaky test XmlSourceTest.testSplitAtFraction.

  Show description for ed24a8e
  

  chamikaramj

  authored and

  lukecwik

  committed
  ed24a8e

  Copy full SHA for ed24a8e

Commits on Jun 17, 2015

• Updates XmlSourceTest so that it passes for non-english locales.

  Show description for b4adcdb
  

  chamikaramj

  authored and

  davorbonaci

  committed
  b4adcdb

  Copy full SHA for b4adcdb

Commits on Jun 12, 2015

• Update BigQueryTableRowIterator so that it retries BigQuery requests several

  Show description for 4d7a085
  

  chamikaramj

  authored and

  davorbonaci

  committed
  4d7a085

  Copy full SHA for 4d7a085

• Adds ConcatReader - a Reader that may encapsulate one or more Dataflow Readers.

  Show description for d9243e2
  

  chamikaramj

  authored and

  davorbonaci

  committed
  d9243e2

  Copy full SHA for d9243e2

Commits on May 12, 2015

• Updated BigQueryReader so that BigQuery values of type TIMESTAMP are formatted similarly for local and service-based runs. This change updates the TIMESTAMP values produced in

  Show description for 18c82ad
  

  chamikaramj

  authored and

  davorbonaci

  committed
  18c82ad

  Copy full SHA for 18c82ad

• Updated XML integration test to work for non-GCS paths as well.

  Show description for 22a5113
  

  chamikaramj

  authored and

  davorbonaci

  committed
  22a5113

  Copy full SHA for 22a5113

Commits on Apr 7, 2015

• Fix FileBasedSource.testSplitAtFraction() test so that it does not depend on

  Show description for 1028330
  

  chamikaramj

  authored and

  davorbonaci

  committed
  1028330

  Copy full SHA for 1028330

• Rename XMLSource to XmlSource and XmlFileBasedSink to XmlSink.

  Show description for c842dba
  

  chamikaramj

  authored and

  davorbonaci

  committed
  c842dba

  Copy full SHA for c842dba

Commits on Apr 6, 2015

• Remove variable 'charset' of XMLSource since it is not serializable.

  Show description for bfd7dc0
  

  chamikaramj

  authored and

  davorbonaci

  committed
  bfd7dc0

  Copy full SHA for bfd7dc0

• Make GCS channel close() method idempotent.

  Show description for 3d4ad3e
  

  chamikaramj

  authored and

  davorbonaci

  committed
  3d4ad3e

  Copy full SHA for 3d4ad3e

• A file based custom source for reading XML files and creating PCollections of JAXB annotated Java objects.

  Show description for 6b8fcc0
  

  chamikaramj

  authored and

  davorbonaci

  committed
  6b8fcc0

  Copy full SHA for 6b8fcc0

Commits on Mar 24, 2015

• Updated TestFileBasedSource.TestReader so that lines are read properly when running on Windows.

  Show description for d24cb94
  

  chamikaramj

  authored and

  davorbonaci

  committed
  d24cb94

  Copy full SHA for d24cb94

Commits on Mar 23, 2015

• Updated TestFileBasedSourceTest to use File.separator instead of "/".

  Show description for 4d7ae28
  

  chamikaramj

  authored and

  davorbonaci

  committed
  4d7ae28

  Copy full SHA for 4d7ae28

Commits on Mar 21, 2015

• Updated the FileBasedSourceTest so that it does not depend on the size of the new line character (it was failing on Windows due to this).

  Show description for 38b3685
  

  chamikaramj

  authored and

  davorbonaci

  committed
  38b3685

  Copy full SHA for 38b3685

• GcsUtil.expand() should not check for the existance of single files since

  Show description for 4fea8a7
  

  chamikaramj

  authored and

  davorbonaci

  committed
  4fea8a7

  Copy full SHA for 4fea8a7

Commits on Mar 13, 2015

• Introduces FileBasedSource<T>, a custom source that implements functionality common to all file-based custom sources. Also introduces ByteOffsetBasedSource<T> as the parent of FileBasedSource<T>. F…

  Show description for b9f4384
  

  chamikaramj

  authored and

  davorbonaci

  committed
  b9f4384

  Copy full SHA for b9f4384

Commits on Mar 9, 2015

• Adds a method to IOChannelFactory that can be used to efficiently determine if a read channel created using the factory is seekable.

  Show description for 6d0d1cd
  

  chamikaramj

  authored and

  davorbonaci

  committed
  6d0d1cd

  Copy full SHA for 6d0d1cd

Commits on Mar 6, 2015

• Adds a start() method to custom source Reader.

  Show description for b49483e
  

  chamikaramj

  authored and

  davorbonaci

  committed
  b49483e

  Copy full SHA for b49483e

Commits on Feb 23, 2015

• Fix following bugs in direct runner GCS file pattern expansion.

  Show description for 0212438
  

  chamikaramj

  authored and

  davorbonaci

  committed
  0212438

  Copy full SHA for 0212438

Commits on Feb 3, 2015

• Updated DataStoreWordCount so that it can be adapted as an integration test for

  Show description for a46c40d
  

  chamikaramj

  authored and

  davorbonaci

  committed
  a46c40d

  Copy full SHA for a46c40d

Commits on Jan 9, 2015

• We now mostly support wildcard matching for GCS paths so removing the checks. We still do not support recursive wildcards so adding a check for that.

  Show description for d54dcd1
  

  chamikaramj

  authored and

  lukecwik

  committed
  d54dcd1

  Copy full SHA for d54dcd1