Skip to content

Conversation

@yanboliang
Copy link
Contributor

What changes were proposed in this pull request?

  • The default value of regParam of PySpark MLlib LogisticRegressionWithLBFGS should be consistent with Scala which is 0.0. (This is also consistent with ML LogisticRegression.)
  • BTW, if we use a known updater(L1 or L2) for binary classification, LogisticRegressionWithLBFGS will call the ML implementation. We should update the API doc to clarifying numCorrections will have no effect if we fall into that route.
  • Make a pass for all parameters of LogisticRegressionWithLBFGS, others are set properly.

cc @mengxr @dbtsai

How was this patch tested?

No new tests, it should pass all current tests.

@yanboliang yanboliang changed the title [SPARK-13545] [MLlib] [PySpark] Make MLlib LR's default parameters consistent in Scala and Python [SPARK-13545] [MLlib] [PySpark] Make MLlib LogisticRegressionWithLBFGS's default parameters consistent in Scala and Python Feb 29, 2016
@SparkQA
Copy link

SparkQA commented Feb 29, 2016

Test build #52170 has finished for PR 11424 at commit fc370c0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dbtsai
Copy link
Member

dbtsai commented Feb 29, 2016

Thanks. Merged into master.

@asfgit asfgit closed this in d81a713 Feb 29, 2016
@yanboliang yanboliang deleted the spark-13545 branch February 29, 2016 09:14
roygao94 pushed a commit to roygao94/spark that referenced this pull request Mar 22, 2016
…s default parameters consistent in Scala and Python

## What changes were proposed in this pull request?
* The default value of ```regParam``` of PySpark MLlib ```LogisticRegressionWithLBFGS``` should be consistent with Scala which is ```0.0```. (This is also consistent with ML ```LogisticRegression```.)
* BTW, if we use a known updater(L1 or L2) for binary classification, ```LogisticRegressionWithLBFGS``` will call the ML implementation. We should update the API doc to clarifying ```numCorrections``` will have no effect if we fall into that route.
* Make a pass for all parameters of ```LogisticRegressionWithLBFGS```, others are set properly.

cc mengxr dbtsai
## How was this patch tested?
No new tests, it should pass all current tests.

Author: Yanbo Liang <[email protected]>

Closes apache#11424 from yanboliang/spark-13545.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants