Skip to content

Commit 5621283

Browse files
author
Andrew Or
committed
[SPARK-4771][Docs] Document standalone cluster supervise mode
tdas looks like streaming already refers to the supervise mode. The link from there is broken though. Author: Andrew Or <[email protected]> Closes apache#3627 from andrewor14/document-supervise and squashes the following commits: 9ca0908 [Andrew Or] Wording changes 2b55ed2 [Andrew Or] Document standalone cluster supervise mode
1 parent 0fc637b commit 5621283

File tree

1 file changed

+10
-1
lines changed

1 file changed

+10
-1
lines changed

docs/spark-standalone.md

+10-1
Original file line numberDiff line numberDiff line change
@@ -257,7 +257,7 @@ To run an interactive Spark shell against the cluster, run the following command
257257

258258
You can also pass an option `--total-executor-cores <numCores>` to control the number of cores that spark-shell uses on the cluster.
259259

260-
# Launching Compiled Spark Applications
260+
# Launching Spark Applications
261261

262262
The [`spark-submit` script](submitting-applications.html) provides the most straightforward way to
263263
submit a compiled Spark application to the cluster. For standalone clusters, Spark currently
@@ -272,6 +272,15 @@ should specify them through the `--jars` flag using comma as a delimiter (e.g. `
272272
To control the application's configuration or execution environment, see
273273
[Spark Configuration](configuration.html).
274274

275+
Additionally, standalone `cluster` mode supports restarting your application automatically if it
276+
exited with non-zero exit code. To use this feature, you may pass in the `--supervise` flag to
277+
`spark-submit` when launching your application. Then, if you wish to kill an application that is
278+
failing repeatedly, you may do so through:
279+
280+
./bin/spark-class org.apache.spark.deploy.Client kill <master url> <driver ID>
281+
282+
You can find the driver ID through the standalone Master web UI at `http://<master url>:8080`.
283+
275284
# Resource Scheduling
276285

277286
The standalone cluster mode currently only supports a simple FIFO scheduler across applications.

0 commit comments

Comments
 (0)