Commits

Branch selector

 dev

User selector

tdas

Datepicker

All time

Commit History

Commits on Dec 10, 2015

• [SPARK-12244][SPARK-12245][STREAMING] Rename trackStateByKey to mapWithState and change tracking function signature

  Show description for bd2cd4f
  

  tdas

  authored and

  zsxwing

  committed
  bd2cd4f

Commits on Dec 7, 2015

• [SPARK-11932][STREAMING] Partition previous TrackStateRDD if partitioner not present

  Show description for 5d80d8c
  tdas

  committed
  5d80d8c

Commits on Dec 4, 2015

• [SPARK-12122][STREAMING] Prevent batches from being submitted twice after recovering StreamingContext from checkpoint

  Show description for 4106d80
  tdas

  committed
  4106d80

Commits on Dec 3, 2015

• [FLAKY-TEST-FIX][STREAMING][TEST] Make sure StreamingContexts are shutdown after test

  Show description for a02d472
  tdas

  committed
  a02d472

Commits on Dec 2, 2015

• [SPARK-12087][STREAMING] Create new JobConf for every batch in saveAsHadoopFiles

  Show description for 8a75a30
  

  tdas

  authored and

  zsxwing

  committed
  8a75a30

Commits on Dec 1, 2015

• [SPARK-12004] Preserve the RDD partitioner through RDD checkpointing

  Show description for 60b541e
  

  tdas

  authored and

  Andrew Or

  committed
  60b541e

Commits on Nov 25, 2015

• [SPARK-11979][STREAMING] Empty TrackStateRDD cannot be checkpointed and recovered from checkpoint file

  Show description for 2169886
  

  tdas

  authored and

  zsxwing

  committed
  2169886

Commits on Nov 20, 2015

• [SPARK-11845][STREAMING][TEST] Added unit test to verify TrackStateRDD is correctly checkpointed

  Show description for b2cecb8
  

  tdas

  authored and

  Andrew Or

  committed
  b2cecb8

Commits on Nov 19, 2015

• [SPARK-11814][STREAMING] Add better default checkpoint duration

  Show description for a402c92
  tdas

  committed
  a402c92

Commits on Nov 13, 2015

• [SPARK-11681][STREAMING] Correctly update state timestamp even when state is not updated

  Show description for e4e46b2
  tdas

  committed
  e4e46b2

Commits on Nov 11, 2015

• [SPARK-11290][STREAMING] Basic implementation of trackStateByKey

  Show description for 99f5f98
  tdas

  committed
  99f5f98

• [SPARK-11361][STREAMING] Show scopes of RDD operations inside DStream.foreachRDD and DStream.transform in DAG viz

  Show description for 6600786
  

  tdas

  authored and

  Andrew Or

  committed
  6600786

Commits on Sep 23, 2015

• [SPARK-10652] [SPARK-10742] [STREAMING] Set meaningful job descriptions for all streaming jobs

  Show description for 5548a25
  tdas

  committed
  5548a25

Commits on Sep 21, 2015

• [SPARK-10649] [STREAMING] Prevent inheriting job group and irrelevant job description in streaming jobs

  Show description for 7286988
  tdas

  committed
  7286988

Commits on Sep 8, 2015

• [SPARK-10492] [STREAMING] [DOCUMENTATION] Update Streaming documentation about rate limiting and backpressure

  Show description for 52b24a6
  tdas

  committed
  52b24a6

Commits on Sep 5, 2015

• [SPARK-10440] [STREAMING] [DOCS] Update python API stuff in the programming guides and python docs

  Show description for 7a4f326
  

  tdas

  authored and

  rxin

  committed
  7a4f326

Commits on Aug 25, 2015

• [SPARK-10210] [STREAMING] Filter out non-existent blocks before creating BlockRDD

  Show description for 1fc3758
  tdas

  committed
  1fc3758

Commits on Aug 24, 2015

• [SPARK-9791] [PACKAGE] Change private class to private class to prevent unnecessary classes from showing up in the docs

  Show description for 7478c8b
  tdas

  committed
  7478c8b

• [SPARK-10142] [STREAMING] Made python checkpoint recovery handle non-local checkpoint paths and existing SparkContexts

  Show description for 053d94f
  tdas

  committed
  053d94f

Commits on Aug 20, 2015

• [SPARK-10128] [STREAMING] Used correct classloader to deserialize WAL data

  Show description for b762f99
  tdas

  committed
  b762f99

Commits on Aug 19, 2015

• [SPARK-9967] [SPARK-10099] [STREAMING] Renamed conf spark.streaming.backpressure.{enable-->enabled} and fixed deprecated annotations

  Show description for bc9a0e0
  tdas

  committed
  bc9a0e0

• [SPARK-10072] [STREAMING] BlockGenerator can deadlock when the queue of generate blocks fills up to capacity

  Show description for 1aeae05
  tdas

  committed
  1aeae05

• [SPARK-10098] [STREAMING] [TEST] Cleanup active context after test in FailureSuite

  Show description for 9108eff
  tdas

  committed
  9108eff

Commits on Aug 14, 2015

• [SPARK-9968] [STREAMING] Reduced time spent within synchronized block to prevent lock starvation

  Show description for 18a761e
  tdas

  committed
  18a761e

• [SPARK-9966] [STREAMING] Handle couple of corner cases in PIDRateEstimator

  Show description for f3bfb71
  tdas

  committed
  f3bfb71

Commits on Aug 11, 2015

• [SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate() in Python

  Show description for 5b8bb1b
  tdas

  committed
  5b8bb1b

• [SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to be more consistent

  Show description for 600031e
  tdas

  committed
  600031e

• [SPARK-9640] [STREAMING] [TEST] Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated

  Show description for 0f90d60
  tdas

  committed
  0f90d60

Commits on Aug 6, 2015

• [SPARK-9556] [SPARK-9619] [SPARK-9624] [STREAMING] Make BlockGenerator more robust and make all BlockGenerators subscribe to rate limit updates

  Show description for 0a07830
  tdas

  committed
  0a07830

Commits on Aug 5, 2015

• [SPARK-9217] [STREAMING] Make the kinesis receiver reliable by recording sequence numbers

  Show description for c2a71f0
  tdas

  committed
  c2a71f0

Commits on Jul 30, 2015

• [STREAMING] [TEST] [HOTFIX] Fixed Kinesis test to not throw weird errors when Kinesis tests are enabled without AWS keys

  Show description for 1afdeb7
  tdas

  committed
  1afdeb7

Commits on Jul 28, 2015

• [STREAMING] [HOTFIX] Ignore ReceiverTrackerSuite flaky test

  Show description for c5ed369
  tdas

  committed
  c5ed369

Commits on Jul 24, 2015

• [SPARK-9216] [STREAMING] Define KinesisBackedBlockRDDs

  Show description for d249636
  tdas

  committed
  d249636

Commits on Jul 20, 2015

• [SPARK-9030] [STREAMING] [HOTFIX] Make sure that no attempts to create Kinesis streams is made when no enabled

  Show description for 93eb2ac
  tdas

  committed
  93eb2ac

Commits on Jul 17, 2015

• [SPARK-9030] [STREAMING] Add Kinesis.createStream unit tests that actual sends data

  Show description for b13ef77
  tdas

  committed
  b13ef77

Pagination

PreviousNext