Commits

Breadcrumbs

History for

onbranch-0.8

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 30, 2013

• More doc improvements + better warnings when you haven't built Spark

  mateiz

  committed
  f3a9648

  Copy full SHA for f3a9648

• Don't use SPARK_LAUNCH_WITH_SCALA in pyspark

  mateiz

  committed
  d7dec93

  Copy full SHA for d7dec93

• Find assembly correctly in pyspark

  mateiz

  committed
  3ff105f

  Copy full SHA for 3ff105f

• Fix PySpark for assembly run and include it in dist

  mateiz

  committed
  ab0e625

  Copy full SHA for ab0e625

Commits on Jul 29, 2013

• Two fixes to IPython support:

  Show description for 72ff62a
  mateiz

  committed
  72ff62a

  Copy full SHA for 72ff62a

Commits on Jul 17, 2013

• Add Apache license headers and LICENSE and NOTICE files

  mateiz

  committed
  af3c9d5

  Copy full SHA for af3c9d5

Commits on Feb 7, 2013

• Adding IPYTHON environment variable support for launching pyspark using ipython shell

  MLnick

  committed
  21d3946

  Copy full SHA for 21d3946

Commits on Jan 17, 2013

• Warn users if they run pyspark or spark-shell without compiling Spark

  mateiz

  committed
  892c32a

  Copy full SHA for 892c32a

Commits on Jan 2, 2013

• Add pyspark script to replace the other scripts.

  Show description for ce9f1bb
  JoshRosen

  committed
  ce9f1bb

  Copy full SHA for ce9f1bb

Commits on Jan 1, 2013

• Rename top-level 'pyspark' directory to 'python'

  JoshRosen

  committed
  b58340d

  Copy full SHA for b58340d

• Minor documentation and style fixes for PySpark.

  JoshRosen

  committed
  170e451

  Copy full SHA for 170e451

Commits on Dec 31, 2012

• Launch with scala by default in run-pyspark

  JoshRosen

  committed
  6f6a6b7

  Copy full SHA for 6f6a6b7

Commits on Dec 30, 2012

• Port LR example to PySpark using numpy.

  Show description for 099898b
  JoshRosen

  committed
  099898b

  Copy full SHA for 099898b

• Add test for pyspark.RDD.saveAsTextFile().

  JoshRosen

  committed
  39dd953

  Copy full SHA for 39dd953

• Update PySpark for compatibility with TaskContext.

  JoshRosen

  committed
  59195c6

  Copy full SHA for 59195c6

Commits on Dec 29, 2012

• Use batching in pyspark parallelize(); fix cartesian()

  JoshRosen

  committed
  26186e2

  Copy full SHA for 26186e2

• Fix bug in pyspark.serializers.batch; add .gitignore.

  JoshRosen

  committed
  6ee1ff2

  Copy full SHA for 6ee1ff2

• Add documentation for Python API.

  JoshRosen

  committed
  c2b105a

  Copy full SHA for c2b105a

• Fix bug (introduced by batching) in PySpark take()

  JoshRosen

  committed
  7ec3595

  Copy full SHA for 7ec3595

Commits on Dec 28, 2012

• Mark api.python classes as private; echo Java output to stderr.

  JoshRosen

  committed
  fbadb1c

  Copy full SHA for fbadb1c

• Simplify PySpark installation.

  Show description for 665466d
  JoshRosen

  committed
  665466d

  Copy full SHA for 665466d

• Use addFile() to ship code to cluster in PySpark.

  Show description for ac32447
  JoshRosen

  committed
  ac32447

  Copy full SHA for ac32447

• Add epydoc API documentation for PySpark.

  JoshRosen

  committed
  85b8f2c

  Copy full SHA for 85b8f2c

Commits on Dec 27, 2012

• Add IPython support to pyspark-shell.

  Show description for 2d98fff
  JoshRosen

  committed
  2d98fff

  Copy full SHA for 2d98fff

• Add support for batched serialization of Python objects in PySpark.

  JoshRosen

  committed
  e2dad15

  Copy full SHA for e2dad15

Commits on Dec 25, 2012

• Use filesystem to collect RDDs in PySpark.

  Show description for 4608902
  JoshRosen

  committed
  4608902

  Copy full SHA for 4608902

Commits on Dec 24, 2012

• Reduce object overhead in Pyspark shuffle and collect

  JoshRosen

  committed
  ccd075c

  Copy full SHA for ccd075c

Commits on Oct 29, 2012

• Fix PySpark hash partitioning bug.

  Show description for 2ccf3b6
  JoshRosen

  committed
  2ccf3b6

  Copy full SHA for 2ccf3b6

Commits on Oct 28, 2012

• Bump required Py4J version and add test for large broadcast variables.

  JoshRosen

  committed
  7859879

  Copy full SHA for 7859879

Commits on Oct 22, 2012

• Remove PYTHONPATH from SparkContext's executorEnvs.

  Show description for d4f2e5b
  JoshRosen

  committed
  d4f2e5b

  Copy full SHA for d4f2e5b

Commits on Oct 20, 2012

• Add PySpark README and run scripts.

  JoshRosen

  committed
  c23bf1a

  Copy full SHA for c23bf1a

Commits on Oct 19, 2012

• Update Python API for v0.6.0 compatibility.

  JoshRosen

  committed
  52989c8

  Copy full SHA for 52989c8

Commits on Sep 17, 2012

• Fix Python 2.6 compatibility in Python API.

  JoshRosen

  committed
  9abdfa6

  Copy full SHA for 9abdfa6

Commits on Aug 27, 2012

• Fix minor bugs in Python API examples.

  JoshRosen

  committed
  4143678

  Copy full SHA for 4143678

• Add pipe(), saveAsTextFile(), sc.union() to Python API.

  JoshRosen

  committed
  bff6a46

  Copy full SHA for bff6a46

Pagination

Previous

Next