Skip to content

Conversation

neyama
Copy link

@neyama neyama commented Nov 15, 2024

Which issue does this PR close?

Closes #18 .

Rationale for this change

  • Calling spark.catalog.clearCache() clears the cached tables.
  • We can execute each query without side effect.

What changes are included in this PR?

  • Call spark.catalog.clearCache() when executing each query beforehand.

How are these changes tested?

  • By running tpcbench.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Avoid side effects by cached state
1 participant