Skip to content

Conversation

@boegel
Copy link
Contributor

@boegel boegel commented Jan 15, 2023

Fix for errors that pop up when creating the tarball because "whiteout" files are accidentally picked up, like:

tar: 2021.12/software/linux/x86_64/amd/zen2/modules/all/CaDiCaL/.wh..wh..opq: Cannot stat: No such file or directory

(starting seeing this in some cases when using updated build container, cfr. #219)

if [ -d ${pilot_version}/software/${os}/${cpu_arch_subdir}/modules ]; then
# module files
find ${pilot_version}/software/${os}/${cpu_arch_subdir}/modules -type f >> ${files_list}
find ${pilot_version}/software/${os}/${cpu_arch_subdir}/modules -type f | grep -v '/\.wh\.' >> ${files_list}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wonder if it would make sense to collect a list of files which have been filtered out and add that to the metadata when uploading the tarball? This would allow the human overseeing the ingestion procedure to double-check if anything had been removed that shouldn't.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These .wh* files are temporary files created by fuse-overlayfs. Although we see them when compiling the list of files to include in the tarball, they're no longer there by the time we create the tarball.
Also, they're useless to us anyway...

@trz42 trz42 merged commit b4fd3b0 into EESSI:main Jan 15, 2023
trz42 pushed a commit to trz42/software-layer that referenced this pull request Jan 15, 2023
…nhancement/unified_script_to_access_EESSI

Pulling in changes until PR EESSI#221.
trz42 pushed a commit to trz42/software-layer that referenced this pull request Jan 15, 2023
…nhancement/single_src_for_defaults

Pulling in updates until PR EESSI#221.
trz42 pushed a commit to trz42/software-layer that referenced this pull request Jan 16, 2024
…y_structure

moved easystack files to new directory structure
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants