Skip to content

Conversation

@kayousterhout
Copy link
Contributor

Prior to this change, the unit test for SPARK-3426 did not clone the
original SparkConf, which meant that that test did not use the options
set by suites that subclass ShuffleSuite.scala. This commit fixes that
problem.

@JoshRosen would be great if you could take a look at this, since you wrote this
test originally.

Prior to this change, the unit test for SPARK-3426 did not clone the
original SparkConf, which meant that that test did not use the options
set by suites that subclass ShuffleSuite.scala. This commit fixes that
problem.
@JoshRosen
Copy link
Contributor

LGTM; thanks!

@SparkQA
Copy link

SparkQA commented Apr 7, 2015

Test build #29810 has finished for PR 5401 at commit 368c540.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.
  • This patch does not change any dependencies.

@JoshRosen
Copy link
Contributor

I'm going to merge this into master (1.4.0), branch-1.3 (1.3.2), branch-1.2 (1.2.3), and branch-1.1 (1.1.2) since that will cover all branches containing this test. Since this is a test-only fix, it should be a low-risk backport. Thanks again!

asfgit pushed a commit that referenced this pull request Apr 8, 2015
Prior to this change, the unit test for SPARK-3426 did not clone the
original SparkConf, which meant that that test did not use the options
set by suites that subclass ShuffleSuite.scala. This commit fixes that
problem.

JoshRosen would be great if you could take a look at this, since you wrote this
test originally.

Author: Kay Ousterhout <[email protected]>

Closes #5401 from kayousterhout/SPARK-6753 and squashes the following commits:

368c540 [Kay Ousterhout] [SPARK-6753] Clone SparkConf in ShuffleSuite tests

(cherry picked from commit 9d44ddc)
Signed-off-by: Josh Rosen <[email protected]>
asfgit pushed a commit that referenced this pull request Apr 8, 2015
Prior to this change, the unit test for SPARK-3426 did not clone the
original SparkConf, which meant that that test did not use the options
set by suites that subclass ShuffleSuite.scala. This commit fixes that
problem.

JoshRosen would be great if you could take a look at this, since you wrote this
test originally.

Author: Kay Ousterhout <[email protected]>

Closes #5401 from kayousterhout/SPARK-6753 and squashes the following commits:

368c540 [Kay Ousterhout] [SPARK-6753] Clone SparkConf in ShuffleSuite tests

(cherry picked from commit 9d44ddc)
Signed-off-by: Josh Rosen <[email protected]>
asfgit pushed a commit that referenced this pull request Apr 8, 2015
Prior to this change, the unit test for SPARK-3426 did not clone the
original SparkConf, which meant that that test did not use the options
set by suites that subclass ShuffleSuite.scala. This commit fixes that
problem.

JoshRosen would be great if you could take a look at this, since you wrote this
test originally.

Author: Kay Ousterhout <[email protected]>

Closes #5401 from kayousterhout/SPARK-6753 and squashes the following commits:

368c540 [Kay Ousterhout] [SPARK-6753] Clone SparkConf in ShuffleSuite tests

(cherry picked from commit 9d44ddc)
Signed-off-by: Josh Rosen <[email protected]>
@asfgit asfgit closed this in 9d44ddc Apr 8, 2015
@kayousterhout
Copy link
Contributor Author

Thanks Josh!

On Wed, Apr 8, 2015 at 10:28 AM, asfgit [email protected] wrote:

Closed #5401 #5401 via 9d44ddc
9d44ddc
.


Reply to this email directly or view it on GitHub
#5401 (comment).

markhamstra pushed a commit to markhamstra/spark that referenced this pull request Apr 15, 2015
Prior to this change, the unit test for SPARK-3426 did not clone the
original SparkConf, which meant that that test did not use the options
set by suites that subclass ShuffleSuite.scala. This commit fixes that
problem.

JoshRosen would be great if you could take a look at this, since you wrote this
test originally.

Author: Kay Ousterhout <[email protected]>

Closes apache#5401 from kayousterhout/SPARK-6753 and squashes the following commits:

368c540 [Kay Ousterhout] [SPARK-6753] Clone SparkConf in ShuffleSuite tests

(cherry picked from commit 9d44ddc)
Signed-off-by: Josh Rosen <[email protected]>
@kayousterhout kayousterhout deleted the SPARK-6753 branch April 12, 2017 00:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants