Skip to content

Commit 3fd3ee0

Browse files
bomengsrowen
bomeng
authored andcommitted
[SPARK-15781][DOCUMENTATION] remove deprecated environment variable doc
## What changes were proposed in this pull request? Like `SPARK_JAVA_OPTS` and `SPARK_CLASSPATH`, we will remove the document for `SPARK_WORKER_INSTANCES` to discourage user not to use them. If they are actually used, SparkConf will show a warning message as before. ## How was this patch tested? Manually tested. Author: bomeng <[email protected]> Closes apache#13533 from bomeng/SPARK-15781.
1 parent 8cc22b0 commit 3fd3ee0

File tree

1 file changed

+0
-9
lines changed

1 file changed

+0
-9
lines changed

docs/spark-standalone.md

-9
Original file line numberDiff line numberDiff line change
@@ -133,15 +133,6 @@ You can optionally configure the cluster further by setting environment variable
133133
<td><code>SPARK_WORKER_WEBUI_PORT</code></td>
134134
<td>Port for the worker web UI (default: 8081).</td>
135135
</tr>
136-
<tr>
137-
<td><code>SPARK_WORKER_INSTANCES</code></td>
138-
<td>
139-
Number of worker instances to run on each machine (default: 1). You can make this more than 1 if
140-
you have have very large machines and would like multiple Spark worker processes. If you do set
141-
this, make sure to also set <code>SPARK_WORKER_CORES</code> explicitly to limit the cores per worker,
142-
or else each worker will try to use all the cores.
143-
</td>
144-
</tr>
145136
<tr>
146137
<td><code>SPARK_WORKER_DIR</code></td>
147138
<td>Directory to run applications in, which will include both logs and scratch space (default: SPARK_HOME/work).</td>

0 commit comments

Comments
 (0)