Skip to content

Conversation

@JoshRosen
Copy link
Contributor

This patch fixes an issue where the spark.sql.TungstenAggregate.testFallbackStartsAt SQLConf setting was not properly reset / cleared at the end of TungstenAggregationQueryWithControlledFallbackSuite. This ended up causing test failures in HiveCompatibilitySuite in Maven builds by causing spilling to occur way too frequently.

This configuration leak was inadvertently introduced during test cleanup in #9618.

@JoshRosen
Copy link
Contributor Author

The failing HiveCompatibilitySuite test, mapjoin_mapjoin, has passed in the Maven pull request builder, and the modified TungstenAggregationQueryWithControlledFallbackSuite also passed tests, so I'm going to merge this now so that the overnight Maven builds have the opportunity to exhibit new test failures now that this one has been fixed.

@JoshRosen JoshRosen changed the title [SPARK-11877][test-maven] Prevent agg. fallback conf. from leaking across test suites [SPARK-11877] Prevent agg. fallback conf. from leaking across test suites Nov 20, 2015
asfgit pushed a commit that referenced this pull request Nov 20, 2015
…ites

This patch fixes an issue where the `spark.sql.TungstenAggregate.testFallbackStartsAt` SQLConf setting was not properly reset / cleared at the end of `TungstenAggregationQueryWithControlledFallbackSuite`. This ended up causing test failures in HiveCompatibilitySuite in Maven builds by causing spilling to occur way too frequently.

This configuration leak was inadvertently introduced during test cleanup in #9618.

Author: Josh Rosen <[email protected]>

Closes #9857 from JoshRosen/clear-fallback-prop-in-test-teardown.

(cherry picked from commit a66142d)
Signed-off-by: Josh Rosen <[email protected]>
@asfgit asfgit closed this in a66142d Nov 20, 2015
@JoshRosen JoshRosen deleted the clear-fallback-prop-in-test-teardown branch November 20, 2015 08:48
@SparkQA
Copy link

SparkQA commented Nov 20, 2015

Test build #46402 has finished for PR 9857 at commit ffe29f7.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants