-
Notifications
You must be signed in to change notification settings - Fork 40
Remove critical_passages
stream from initial_state
in global_ocean
test group
#207
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove critical_passages
stream from initial_state
in global_ocean
test group
#207
Conversation
We do not deepen critical passages in any mesh configuration, so the critical_passages mask is not needed during init. Requiring the file in `stream.ocean` makes it difficult to swap the mesh used in `initial_state` for another mesh (e.g. one generated on a different machine or with a previous version of compass).
@xylar I'm trying to test this on chrysalis with the WC14. I've set up the init phase and pointed at meshes already made on chrysalis in the inputdata server. This is what I was trying to do that I mentioned over slack. However when I do this, I get an error I did not get before
It's likely this is unrelated but am confused why the init test is looking for these files. They aren't in the streams or any links I see. Could you offer some advice on this? |
@vanroekel, I'm happy to take a closer look tomorrow but it looks like you didn't set up the test case that creates the mesh. The initial state test case can't run without it. Could you try setting up both and see if it works? |
Sorry for the false alarm. I did indeed try that and once I set it up and ran the mesh test things were fine even if I pointed at a different mesh, just didn't get a chance to post back to this issue. I'll approve this works great. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
approving based on visual inspection and testing on chrysalis. Thanks @xylar!
@vanroekel, I'm sorry, I read your first message quickly and didn't take the time to understand the problem you were facing. One of these cases where I'm trying to give a quick response when I don't really have time for a thorough one. Obviously, that's not always very helpful. I understand the issue. Each step of a test case keeps its inputs. These need to be absolute paths to the original files, not local symlinks because Parsl will use these absolute paths to determine when the inputs are available and the step can run. However, this is confusing and creates needless extra work in the specific case you're working with in which you want to replace the mesh (and graph file) with another one. The simplest solution I can come up with for this particular case at the moment will involve #184 (which I will merge soon). Instead of computing the mesh, you would set up the cached version of it. That still might involve a needless download, depending on the machine you're running on, but shouldn't require a half hour to create a mesh you're going to throw away. |
TestingI ran this branch with the ocean nightly test suite on Chrysalis with intel/impi and everything was bit-for-bit with previous tests, suggesting that even the QU240 mesh was, indeed, not deepening critical passages. I also set up the EC30to60 test cases as follows:
This creates a cached version of the
Then, I added/replaced the following config options in
I ran the @vanroekel, that's the workflow I would suggest in the future. Perhaps that's what you are already doing, with the exception that I am using the cached version of the |
We do not deepen critical passages in any mesh configuration, so the critical_passages mask is not needed during init. Requiring the file in
stream.ocean
makes it difficult to swap the mesh used ininitial_state
for another mesh (e.g. one generated on a different machine or with a previous version of compass).closes #204