Commits

Branch selector

 master

User selector

davies

Datepicker

All time

Commit History

Commits on Apr 10, 2015

• [SPARK-3074] [PySpark] support groupByKey() with single huge key

  Show description for b5c51c8
  

  davies

  authored and

  JoshRosen

  committed
  b5c51c8

  Copy full SHA for b5c51c8

Commits on Nov 3, 2014

• [SPARK-3594] [PySpark] [SQL] take more rows to infer schema or sampling

  Show description for 24544fb
  

  davies

  authored and

  marmbrus

  committed
  24544fb

  Copy full SHA for 24544fb

Commits on Oct 24, 2014

• [SPARK-3993] [PySpark] fix bug while reuse worker after take()

  Show description for e595c8d
  

  davies

  authored and

  JoshRosen

  committed
  e595c8d

  Copy full SHA for e595c8d

Commits on Oct 19, 2014

• [SPARK-3952] [Streaming] [PySpark] add Python examples in Streaming Programming Guide

  Show description for 05db2da
  

  davies

  authored and

  JoshRosen

  committed
  05db2da

  Copy full SHA for 05db2da

Commits on Oct 16, 2014

• [SPARK-3971] [MLLib] [PySpark] hotfix: Customized pickler should work in cluster mode

  Show description for 091d32c
  

  davies

  authored and

  mengxr

  committed
  091d32c

  Copy full SHA for 091d32c

Commits on Oct 10, 2014

• [SPARK-3886] [PySpark] use AutoBatchedSerializer by default

  Show description for 72f36ee
  

  davies

  authored and

  JoshRosen

  committed
  72f36ee

  Copy full SHA for 72f36ee

Commits on Oct 8, 2014

• [SPARK-3412] [PySpark] Replace Epydoc with Sphinx to generate Python API docs

  Show description for 798ed22
  

  davies

  authored and

  JoshRosen

  committed
  798ed22

  Copy full SHA for 798ed22

Commits on Oct 7, 2014

• [SPARK-3731] [PySpark] fix memory leak in PythonRDD

  Show description for bc87cc4
  

  davies

  authored and

  JoshRosen

  committed
  bc87cc4

  Copy full SHA for bc87cc4

• [SPARK-3762] clear reference of SparkEnv after stop

  Show description for 6550329
  

  davies

  authored and

  mateiz

  committed
  6550329

  Copy full SHA for 6550329

Commits on Oct 6, 2014

• [SPARK-3786] [PySpark] speedup tests

  Show description for 4f01265
  

  davies

  authored and

  JoshRosen

  committed
  4f01265

  Copy full SHA for 4f01265

Commits on Oct 1, 2014

• [SPARK-3749] [PySpark] fix bugs in broadcast large closure of RDD

  Show description for abf588f
  

  davies

  authored and

  JoshRosen

  committed
  abf588f

  Copy full SHA for abf588f

• [SPARK-3478] [PySpark] Profile the Python tasks

  Show description for c5414b6
  

  davies

  authored and

  JoshRosen

  committed
  c5414b6

  Copy full SHA for c5414b6

Commits on Sep 27, 2014

• [SPARK-3681] [SQL] [PySpark] fix serialization of List and Map in SchemaRDD

  Show description for 0d8cdf0
  

  davies

  authored and

  marmbrus

  committed
  0d8cdf0

  Copy full SHA for 0d8cdf0

Commits on Sep 26, 2014

• [SPARK-3478] [PySpark] Profile the Python tasks

  Show description for 1aa549b
  

  davies

  authored and

  JoshRosen

  committed
  1aa549b

  Copy full SHA for 1aa549b

Commits on Sep 24, 2014

• [SPARK-3679] [PySpark] pickle the exact globals of functions

  Show description for bb96012
  

  davies

  authored and

  JoshRosen

  committed
  bb96012

  Copy full SHA for bb96012

• [SPARK-3634] [PySpark] User's module should take precedence over system modules

  Show description for c854b9f
  

  davies

  authored and

  JoshRosen

  committed
  c854b9f

  Copy full SHA for c854b9f

Commits on Sep 19, 2014

• [SPARK-3592] [SQL] [PySpark] support applySchema to RDD of Row

  Show description for a95ad99
  

  davies

  authored and

  marmbrus

  committed
  a95ad99

  Copy full SHA for a95ad99

• [SPARK-3491] [MLlib] [PySpark] use pickle to serialize data in MLlib

  Show description for fce5e25
  

  davies

  authored and

  mengxr

  committed
  fce5e25

  Copy full SHA for fce5e25

• [SPARK-3554] [PySpark] use broadcast automatically for large closure

  Show description for e77fa81
  

  davies

  authored and

  JoshRosen

  committed
  e77fa81

  Copy full SHA for e77fa81

Commits on Sep 16, 2014

• [SPARK-3430] [PySpark] [Doc] generate PySpark API docs using Sphinx

  Show description for ec1adec
  

  davies

  authored and

  JoshRosen

  committed
  ec1adec

  Copy full SHA for ec1adec

• [SPARK-2951] [PySpark] support unpickle array.array for Python 2.6

  Show description for da33acb
  

  davies

  authored and

  JoshRosen

  committed
  da33acb

  Copy full SHA for da33acb

Commits on Sep 14, 2014

• [SPARK-3463] [PySpark] aggregate and show spilled bytes in Python

  Show description for 4e3fbe8
  

  davies

  authored and

  JoshRosen

  committed
  4e3fbe8

  Copy full SHA for 4e3fbe8

Commits on Sep 13, 2014

• [SPARK-3030] [PySpark] Reuse Python worker

  Show description for 2aea0da
  

  davies

  authored and

  JoshRosen

  committed
  2aea0da

  Copy full SHA for 2aea0da

• [SPARK-3500] [SQL] use JavaSchemaRDD as SchemaRDD._jschema_rdd

  Show description for 885d162
  

  davies

  authored and

  JoshRosen

  committed
  885d162

  Copy full SHA for 885d162

• [SPARK-3094] [PySpark] compatitable with PyPy

  Show description for 71af030
  

  davies

  authored and

  JoshRosen

  committed
  71af030

  Copy full SHA for 71af030

Commits on Sep 12, 2014

• [SPARK-3465] fix task metrics aggregation in local mode

  Show description for 42904b8
  

  davies

  authored and

  andrewor14

  committed
  42904b8

  Copy full SHA for 42904b8

Commits on Sep 11, 2014

• [SPARK-3047] [PySpark] add an option to use str in textFileRDD

  Show description for 1ef656e
  

  davies

  authored and

  JoshRosen

  committed
  1ef656e

  Copy full SHA for 1ef656e

Commits on Sep 6, 2014

• [SPARK-2334] fix AttributeError when call PipelineRDD.id()

  Show description for 110fb8b
  

  davies

  authored and

  JoshRosen

  committed
  110fb8b

  Copy full SHA for 110fb8b

Commits on Sep 4, 2014

• [SPARK-3335] [SQL] [PySpark] support broadcast in Python UDF

  Show description for c5cbc49
  

  davies

  authored and

  marmbrus

  committed
  c5cbc49

  Copy full SHA for c5cbc49

Commits on Sep 3, 2014

• [SPARK-3309] [PySpark] Put all public API in __all__

  Show description for 6481d27
  

  davies

  authored and

  JoshRosen

  committed
  6481d27

  Copy full SHA for 6481d27

Commits on Sep 2, 2014

• [SPARK-2871] [PySpark] add countApproxDistinct() API

  Show description for e2c901b
  

  davies

  authored and

  JoshRosen

  committed
  e2c901b

  Copy full SHA for e2c901b

Commits on Aug 29, 2014

• [SPARK-3307] [PySpark] Fix doc string of SparkContext.broadcast()

  Show description for e248328
  

  davies

  authored and

  JoshRosen

  committed
  e248328

  Copy full SHA for e248328

Commits on Aug 27, 2014

• [SPARK-2871] [PySpark] add RDD.lookup(key)

  Show description for 4fa2fda
  

  davies

  authored and

  JoshRosen

  committed
  4fa2fda

  Copy full SHA for 4fa2fda

Commits on Aug 26, 2014

• [SPARK-3073] [PySpark] use external sort in sortBy() and sortByKey()

  Show description for f1e71d4
  

  davies

  authored and

  mateiz

  committed
  f1e71d4

  Copy full SHA for f1e71d4

• [SPARK-2871] [PySpark] add histgram() API

  Show description for 3cedc4f
  

  davies

  authored and

  JoshRosen

  committed
  3cedc4f

  Copy full SHA for 3cedc4f

Pagination

Previous

Next