Skip to content

[SPARK-6948][MLLIB] compress vectors in VectorAssembler #5985

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

[SPARK-6948][MLLIB] compress vectors in VectorAssembler #5985

wants to merge 2 commits into from

Conversation

@mengxr
Copy link
Contributor

@mengxr mengxr commented May 7, 2015

The compression is based on storage. @brkyvz

@AmplabJenkins
Copy link

AmplabJenkins commented May 7, 2015

Merged build triggered.

@AmplabJenkins
Copy link

AmplabJenkins commented May 7, 2015

Merged build started.

@SparkQA
Copy link

SparkQA commented May 7, 2015

Test build #32139 has started for PR 5985 at commit df56a00.

@SparkQA
Copy link

SparkQA commented May 7, 2015

Test build #32139 has finished for PR 5985 at commit df56a00.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class StringArrayParam(parent: Params, name: String, doc: String, isValid: Array[String] => Boolean)
    • class VectorAssembler(JavaTransformer, HasInputCols, HasOutputCol):
    • class HasInputCols(Params):
    • class RegressionMetrics(JavaModelWrapper):

@AmplabJenkins
Copy link

AmplabJenkins commented May 7, 2015

Merged build finished. Test PASSed.

@AmplabJenkins
Copy link

AmplabJenkins commented May 7, 2015

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/32139/
Test PASSed.

@brkyvz
Copy link
Contributor

brkyvz commented May 7, 2015

LGTM

@mengxr
Copy link
Contributor Author

mengxr commented May 7, 2015

Merged into master and branch-1.4.

@asfgit asfgit closed this in e43803b May 7, 2015
asfgit pushed a commit that referenced this pull request May 7, 2015
@mengxr
[SPARK-6948] [MLLIB] compress vectors in VectorAssembler
475143a 
The compression is based on storage. brkyvz

Author: Xiangrui Meng <[email protected]>

Closes #5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler

(cherry picked from commit e43803b)
Signed-off-by: Xiangrui Meng <[email protected]>
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request May 28, 2015
@mengxr @jeanlyn
[SPARK-6948] [MLLIB] compress vectors in VectorAssembler
547722a 
The compression is based on storage. brkyvz

Author: Xiangrui Meng <[email protected]>

Closes apache#5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler
jeanlyn pushed a commit to jeanlyn/spark that referenced this pull request Jun 12, 2015
@mengxr @jeanlyn
[SPARK-6948] [MLLIB] compress vectors in VectorAssembler
035774e 
The compression is based on storage. brkyvz

Author: Xiangrui Meng <[email protected]>

Closes apache#5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler
nemccarthy pushed a commit to nemccarthy/spark that referenced this pull request Jun 19, 2015
@mengxr @nemccarthy
[SPARK-6948] [MLLIB] compress vectors in VectorAssembler
8939d77 
The compression is based on storage. brkyvz

Author: Xiangrui Meng <[email protected]>

Closes apache#5985 from mengxr/SPARK-6948 and squashes the following commits:

df56a00 [Xiangrui Meng] update python tests
6d90d45 [Xiangrui Meng] compress vectors in VectorAssembler
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@mengxr @AmplabJenkins @SparkQA @brkyvz