Skip to content

Conversation

@wojtek-szymanski
Copy link
Contributor

What changes were proposed in this pull request?

Motivation:
org.apache.spark.ml.Pipeline.copy(extra: ParamMap) does not create an instance with the same UID. It does not conform to the method specification from its base class org.apache.spark.ml.param.Params.copy(extra: ParamMap)

Solution:

  • fix for Pipeline UID
  • introduced new tests for org.apache.spark.ml.Pipeline.copy
  • minor improvements in test for org.apache.spark.ml.PipelineModel.copy

How was this patch tested?

Introduced new unit test: org.apache.spark.ml.PipelineSuite."Pipeline.copy"
Improved existing unit test: org.apache.spark.ml.PipelineSuite."PipelineModel.copy"

@wojtek-szymanski wojtek-szymanski changed the title Bug fix: Pipeline.copy does not create an instance with the same UID Pipeline.copy does not create an instance with the same UID Nov 3, 2016
@wojtek-szymanski wojtek-szymanski changed the title Pipeline.copy does not create an instance with the same UID [SPARK-18210][ML]Pipeline.copy does not create an instance with the same UID Nov 3, 2016
@wojtek-szymanski wojtek-szymanski changed the title [SPARK-18210][ML]Pipeline.copy does not create an instance with the same UID [SPARK-18210][ML] Pipeline.copy does not create an instance with the same UID Nov 3, 2016
@SparkQA
Copy link

SparkQA commented Nov 3, 2016

Test build #3412 has finished for PR 15759 at commit 8764e36.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yanboliang
Copy link
Contributor

LGTM, merged into master and branch-2.1. Thanks!

asfgit pushed a commit that referenced this pull request Nov 6, 2016
…same UID

## What changes were proposed in this pull request?

Motivation:
`org.apache.spark.ml.Pipeline.copy(extra: ParamMap)` does not create an instance with the same UID. It does not conform to the method specification from its base class `org.apache.spark.ml.param.Params.copy(extra: ParamMap)`

Solution:
- fix for Pipeline UID
- introduced new tests for `org.apache.spark.ml.Pipeline.copy`
- minor improvements in test for `org.apache.spark.ml.PipelineModel.copy`

## How was this patch tested?

Introduced new unit test: `org.apache.spark.ml.PipelineSuite."Pipeline.copy"`
Improved existing unit test: `org.apache.spark.ml.PipelineSuite."PipelineModel.copy"`

Author: Wojciech Szymanski <[email protected]>

Closes #15759 from wojtek-szymanski/SPARK-18210.

(cherry picked from commit b89d055)
Signed-off-by: Yanbo Liang <[email protected]>
@asfgit asfgit closed this in b89d055 Nov 6, 2016
@wojtek-szymanski
Copy link
Contributor Author

My pleasure, thanks.

uzadude pushed a commit to uzadude/spark that referenced this pull request Jan 27, 2017
…same UID

## What changes were proposed in this pull request?

Motivation:
`org.apache.spark.ml.Pipeline.copy(extra: ParamMap)` does not create an instance with the same UID. It does not conform to the method specification from its base class `org.apache.spark.ml.param.Params.copy(extra: ParamMap)`

Solution:
- fix for Pipeline UID
- introduced new tests for `org.apache.spark.ml.Pipeline.copy`
- minor improvements in test for `org.apache.spark.ml.PipelineModel.copy`

## How was this patch tested?

Introduced new unit test: `org.apache.spark.ml.PipelineSuite."Pipeline.copy"`
Improved existing unit test: `org.apache.spark.ml.PipelineSuite."PipelineModel.copy"`

Author: Wojciech Szymanski <[email protected]>

Closes apache#15759 from wojtek-szymanski/SPARK-18210.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants