Skip to content

Commit

Permalink
Fixing config option "retained_stages" => "retainedStages".
Browse files Browse the repository at this point in the history
This is a very esoteric option and it's out of sync with the style we use.
So it seems fitting to fix it for 0.9.0.
  • Loading branch information
pwendell committed Jan 9, 2014
1 parent 04d83fc commit 112c0a1
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ import org.apache.spark.scheduler._
*/
private[spark] class JobProgressListener(val sc: SparkContext) extends SparkListener {
// How many stages to remember
val RETAINED_STAGES = sc.conf.get("spark.ui.retained_stages", "1000").toInt
val RETAINED_STAGES = sc.conf.get("spark.ui.retainedStages", "1000").toInt
val DEFAULT_POOL_NAME = "default"

val stageIdToPool = new HashMap[Int, String]()
Expand Down
2 changes: 1 addition & 1 deletion docs/configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -130,7 +130,7 @@ Apart from these, the following properties are also available, and may be useful
</td>
</tr>
<tr>
<td>spark.ui.retained_stages</td>
<td>spark.ui.retainedStages</td>
<td>1000</td>
<td>
How many stages the Spark UI remembers before garbage collecting.
Expand Down

0 comments on commit 112c0a1

Please sign in to comment.