Skip to content

Commit

Permalink
[SPARK-6278][MLLIB] Mention the change of objective in linear regression
Browse files Browse the repository at this point in the history
As discussed in the RC3 vote thread, we should mention the change of objective in linear regression in the migration guide. srowen

Author: Xiangrui Meng <[email protected]>

Closes apache#4978 from mengxr/SPARK-6278 and squashes the following commits:

fb3bbe6 [Xiangrui Meng] mention regularization parameter
bfd6cff [Xiangrui Meng] Merge remote-tracking branch 'apache/master' into SPARK-6278
375fd09 [Xiangrui Meng] address Sean's comments
f87ae71 [Xiangrui Meng] mention step size change
  • Loading branch information
mengxr committed Mar 13, 2015
1 parent dc4abd4 commit 7f13434
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions docs/mllib-guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -102,6 +102,8 @@ In the `spark.mllib` package, there were several breaking changes. The first ch
* In `DecisionTree`, the deprecated class method `train` has been removed. (The object/static `train` methods remain.)
* In `Strategy`, the `checkpointDir` parameter has been removed. Checkpointing is still supported, but the checkpoint directory must be set before calling tree and tree ensemble training.
* `PythonMLlibAPI` (the interface between Scala/Java and Python for MLlib) was a public API but is now private, declared `private[python]`. This was never meant for external use.
* In linear regression (including Lasso and ridge regression), the squared loss is now divided by 2.
So in order to produce the same result as in 1.2, the regularization parameter needs to be divided by 2 and the step size needs to be multiplied by 2.

## Previous Spark Versions

Expand Down

0 comments on commit 7f13434

Please sign in to comment.