Commits

Breadcrumbs

History for

on565136c

User selector

All users

Datepicker

All time

Commit History

Commits on Feb 21, 2016

• Add note on DataFrame recomme^Cation over RDD

  donnemartin

  committed
  138cd10

  Copy full SHA for 138cd10

• Add more Spark DataFrame examples

  donnemartin

  committed
  34889ce

  Copy full SHA for 34889ce

• Move DataFrames before RDDs

  donnemartin

  committed
  e4e1284

  Copy full SHA for e4e1284

Commits on Feb 20, 2016

• Added DataFrames section and cleared outputs

  amarrella

  committed
  b15edb7

  Copy full SHA for b15edb7

• Added DataFrames section

  amarrella

  committed
  d445057

  Copy full SHA for d445057

Commits on Nov 1, 2015

• Fixed notebook author and license info no longer rendering properly on nbviewer.

  donnemartin

  committed
  2690450

  Copy full SHA for 2690450

Commits on Aug 12, 2015

• Added simplified Spark installation instructions from the repo: https://github.com/donnemartin/dev-setup.

  donnemartin

  committed
  9195809

  Copy full SHA for 9195809

Commits on Jun 24, 2015

• Updated IPython Notebook Setup section to link to Python 3 and Spark 1.4 setup. Labeled Python 2 setup links.

  donnemartin

  committed
  1405875

  Copy full SHA for 1405875

• Tweaked RDD collect() description to be more descriptive.

  donnemartin

  committed
  e8b32cf

  Copy full SHA for e8b32cf

Commits on Jun 19, 2015

• Added author and GitHub repo link to notebooks.

  donnemartin

  committed
  26349da

  Copy full SHA for 26349da

Commits on Jun 9, 2015

• Added instructions link to configure IPython Notebook and PySpark.

  donnemartin

  committed
  2f7866d

  Copy full SHA for 2f7866d

• Added more info about the spark shell, context, and RDDs.

  donnemartin

  committed
  2d1f1e8

  Copy full SHA for 2d1f1e8

Commits on May 24, 2015

• Updated notebook to v3.

  donnemartin

  committed
  c240bde

  Copy full SHA for c240bde

• Updated notebook to v3.

  donnemartin

  committed
  2106acc

  Copy full SHA for 2106acc

Commits on Apr 1, 2015

• Added Spark accumulators snippets.

  donnemartin

  committed
  011747c

  Copy full SHA for 011747c

Commits on Mar 30, 2015

• Added Spark broadcast variables snippets.

  donnemartin

  committed
  7195c5b

  Copy full SHA for 7195c5b

Commits on Mar 29, 2015

• Added Spark streaming with states snippets.

  donnemartin

  committed
  b3fb4ae

  Copy full SHA for b3fb4ae

Commits on Mar 16, 2015

• Added Spark streaming snippets.

  donnemartin

  committed
  10d63ef

  Copy full SHA for 10d63ef

Commits on Mar 13, 2015

• Added snippets for configuring Spark applications.

  donnemartin

  committed
  ce605a6

  Copy full SHA for ce605a6

• Prefixed Spark commands with ! so they can be executed within IPython Notebook.

  donnemartin

  committed
  53789e0

  Copy full SHA for 53789e0

• Prefixed HDFS commands with ! so they can be executed within IPython Notebook.

  donnemartin

  committed
  87b017f

  Copy full SHA for 87b017f

Commits on Mar 12, 2015

• Added snippets to demonstrate writing and running a Spark app.

  donnemartin

  committed
  1c4e215

  Copy full SHA for 1c4e215

Commits on Mar 8, 2015

• Added snippets to checkpoint RDDs in Spark.

  donnemartin

  committed
  1815c9a

  Copy full SHA for 1815c9a

• Added snippets to cache RDDs in Spark.

  donnemartin

  committed
  0481497

  Copy full SHA for 0481497

Commits on Mar 7, 2015

• Added discussion and snippet for working with partitions in Spark.

  donnemartin

  committed
  404676a

  Copy full SHA for 404676a

Commits on Mar 6, 2015

• Added discussion on viewing the Spark application UI.

  donnemartin

  committed
  bef3dfc

  Copy full SHA for bef3dfc

Commits on Mar 5, 2015

• Added snippets to run Spark on a cluster.

  donnemartin

  committed
  72cf3af

  Copy full SHA for 72cf3af

Commits on Mar 4, 2015

• Added Spark pair RDDs snippets.

  donnemartin

  committed
  a5a3da5

  Copy full SHA for a5a3da5

Commits on Mar 3, 2015

• Added snippets for basic RDD operations.

  donnemartin

  committed
  e8b481f

  Copy full SHA for e8b481f

• Added Spark IPython Notebook, currently contains snippets for starting the pyspark shell and viewing the spark context.

  donnemartin

  committed
  6c7e7b5

  Copy full SHA for 6c7e7b5

Commits on Feb 28, 2015

• Added __init__.py files to spark and aws folders.

  donnemartin

  committed
  ee4d38a

  Copy full SHA for ee4d38a

• Added IPython Notebook containing HDFS snippets.

  donnemartin

  committed
  87402ca

  Copy full SHA for 87402ca

Loading