Skip to content

{2023.06}[system] EasyBuild v4.9.1 #314

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Apr 10, 2024
Merged

{2023.06}[system] EasyBuild v4.9.1 #314

merged 1 commit into from
Apr 10, 2024

Conversation

@trz42
Copy link
Collaborator

@trz42 trz42 commented Apr 10, 2024 •
edited
Loading

PR to add EasyBuild 4.9.1

SPDX license identifier: GPL-2.0-only

Also used to verify if building still works after #312 has been merged.

Plus used as a trial for building some (or all) aarch64/generic software on AWS.

@trz42
Copy link
Collaborator Author

trz42 commented Apr 10, 2024

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell

  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2

  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic

  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited by trz42
Loading

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_314/5764528

date job status comment
Apr 10 19:36:54 UTC 2024 submitted job id 5764528 awaits release by job manager
Apr 10 19:37:47 UTC 2024 released job awaits launch by Slurm scheduler
Apr 10 19:38:49 UTC 2024 running job 5764528 is running
Apr 10 19:42:54 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5764528.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gzsize: 20 MiB (20982472 bytes)
entries: 32611
modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/intel/broadwell/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/intel/broadwell
no other files in tarball
Apr 10 19:42:54 UTC 2024 test result (no tests yet)
Apr 10 20:43:46 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz to S3 bucket succeeded
Apr 10 20:52:30 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz to S3 bucket succeeded
Apr 10 20:58:17 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz to S3 bucket succeeded
Apr 10 21:28:12 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz to S3 bucket succeeded
Apr 10 10:20:09 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz downloaded to Stratum-0
Apr 10 10:20:53 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/119 to approve ingest
Apr 10 10:26:43 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/119
Apr 10 10:32:21 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712778139.tar.gz successfully ingested at 2023.06/software/linux/x86_64/intel/broadwell/

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited by trz42
Loading

New job on instance AWS-MC-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_314/9280

  • failed with 
    == FAILED: Installation ended unsuccessfully (build directory: /tmp/tmp.GhoI8Ls8fG/build/CUDA/12.1.1/system-system): build failed (first 300 chars):
Sanity check failed: loading fake module failed: "Module command '/cvmfs/pilot.nessi.no/versions/2023.06/compat/linux/aarch64/usr/share/Lmod/libexec/lmod python load CUDA/12.1.1' failed with exit code 1; stderr: Lmod has detected the following error:\nYou requested to load CUDA  but while the module (took 5 mins 19 secs)
== Results of the build can be found in the log file(s) /tmp/eb-f9almw2x/easybuild-CUDA-12.1.1-20240410.194554.HSAEy.log
ERROR: Build of /cvmfs/pilot.nessi.no/versions/2023.06/software/linux/aarch64/generic/software/EasyBuild/4.9.0/easybuild/easyconfigs/c/CUDA/CUDA-12.1.1.eb failed (err: 'build failed (first 300 chars): Sanity check failed: loading fake module failed: "Module command \'/cvmfs/pilot.nessi.no/versions/2023.06/compat/linux/aarch64/usr/share/Lmod/libexec/lmod python load CUDA/12.1.1\' failed with exit code 1; stderr: Lmod has detected the following error:\\nYou requested to load CUDA  but while the module')
ESC[31mERROR: CUDA installation failed, please check EasyBuild logs easybuild-ck0u4k0s.log...ESC[0m
date job status comment
Apr 10 19:36:54 UTC 2024 submitted job id 9280 awaits release by job manager
Apr 10 19:37:10 UTC 2024 released job awaits launch by Slurm scheduler
Apr 10 19:42:24 UTC 2024 running job 9280 is running
Apr 10 19:56:44 UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-9280.out
❌ found message matching ERROR:
❌ found message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gzsize: 19 MiB (20879875 bytes)
entries: 32611
modules under 2023.06/software/linux/aarch64/generic/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/aarch64/generic/software
EasyBuild/4.9.1
other under 2023.06/software/linux/aarch64/generic
no other files in tarball
Apr 10 19:56:44 UTC 2024 test result (no tests yet)
Apr 10 20:43:40 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz to S3 bucket succeeded
Apr 10 20:52:31 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz to S3 bucket succeeded
Apr 10 20:58:19 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz to S3 bucket succeeded
Apr 10 21:28:13 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz to S3 bucket succeeded
Apr 10 10:19:59 PM UTC 2024 staged tarball eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz downloaded to Stratum-0
Apr 10 10:20:22 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/115 to approve ingest
Apr 10 10:26:35 PM UTC 2024 rejected 👎 tarball eessi-2023.06-software-linux-aarch64-generic-1712778944.tar.gz rejected, see PR https://github.com/NorESSI/2024-staging/pull/115

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited by trz42
Loading

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_314/9281

date job status comment
Apr 10 19:36:58 UTC 2024 submitted job id 9281 awaits release by job manager
Apr 10 19:37:12 UTC 2024 released job awaits launch by Slurm scheduler
Apr 10 19:38:16 UTC 2024 running job 9281 is running
Apr 10 19:44:31 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9281.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gzsize: 19 MiB (20922641 bytes)
entries: 32611
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/amd/zen2
no other files in tarball
Apr 10 19:44:31 UTC 2024 test result (no tests yet)
Apr 10 20:44:00 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz to S3 bucket succeeded
Apr 10 20:52:52 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz to S3 bucket succeeded
Apr 10 20:58:39 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz to S3 bucket succeeded
Apr 10 21:28:33 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz to S3 bucket succeeded
Apr 10 10:20:04 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz downloaded to Stratum-0
Apr 10 10:20:38 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/117 to approve ingest
Apr 10 10:26:39 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/117
Apr 10 10:29:45 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712778206.tar.gz successfully ingested at 2023.06/software/linux/x86_64/amd/zen2/

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited by trz42
Loading

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_314/9282

date job status comment
Apr 10 19:37:01 UTC 2024 submitted job id 9282 awaits release by job manager
Apr 10 19:37:14 UTC 2024 released job awaits launch by Slurm scheduler
Apr 10 19:38:17 UTC 2024 running job 9282 is running
Apr 10 19:44:32 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9282.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gzsize: 19 MiB (20911671 bytes)
entries: 32611
modules under 2023.06/software/linux/x86_64/generic/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/generic/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/generic
no other files in tarball
Apr 10 19:44:32 UTC 2024 test result (no tests yet)
Apr 10 20:44:21 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz to S3 bucket succeeded
Apr 10 20:53:13 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz to S3 bucket succeeded
Apr 10 20:58:59 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz to S3 bucket succeeded
Apr 10 21:28:54 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz to S3 bucket succeeded
Apr 10 10:20:07 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz downloaded to Stratum-0
Apr 10 10:20:46 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/118 to approve ingest
Apr 10 10:26:41 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/118
Apr 10 10:31:12 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-generic-1712778206.tar.gz successfully ingested at 2023.06/software/linux/x86_64/generic/

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024

Instance eX3-NESSI is configured to build:

  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024

Instance AWS-MC-NESSI is configured to build:

  • arch x86_64/generic for repo nessi-2022.11-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/skylake_avx512 for repo nessi-2022.11-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
  • arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2022.11-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024

Instance Fram-NESSI is configured to build:

  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/broadwell for repo nessi-2023.06-cl
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024

Instance Saga-NESSI is configured to build:

  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/broadwell for repo nessi-2023.06-cl
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11
  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited by trz42
Loading

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_314/11139889

date job status comment
Apr 10 07:37:13 PM UTC 2024 submitted job id 11139889 awaits release by job manager
Apr 10 07:37:21 PM UTC 2024 released job awaits launch by Slurm scheduler
Apr 10 07:38:23 PM UTC 2024 running job 11139889 is running
Apr 10 07:44:30 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11139889.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gzsize: 20 MiB (21029172 bytes)
entries: 32611
modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
EasyBuild/4.9.1
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
no other files in tarball
Apr 10 07:44:30 PM UTC 2024 test result (no tests yet)
Apr 10 08:43:49 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz to S3 bucket succeeded
Apr 10 08:52:33 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz to S3 bucket succeeded
Apr 10 08:58:22 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz to S3 bucket succeeded
Apr 10 09:28:19 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz to S3 bucket succeeded
Apr 10 10:20:12 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz downloaded to Stratum-0
Apr 10 10:21:02 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/120 to approve ingest
Apr 10 10:26:46 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/120
Apr 10 10:33:21 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712778218.tar.gz successfully ingested at 2023.06/software/linux/x86_64/intel/skylake_avx512/

@trz42 trz42 mentioned this pull request Apr 10, 2024
Open
51 tasks
@trz42
Copy link
Collaborator Author

trz42 commented Apr 10, 2024

bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance AWS-MC-NESSI (click for details)

  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance eX3-NESSI (click for details)

  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance Fram-NESSI (click for details)

  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited
Loading

Updates by the bot instance Saga-NESSI (click for details)

  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 10, 2024 •
edited by trz42
Loading

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_314/166838

date job status comment
Apr 10 08:12:07 PM UTC 2024 submitted job id 166838 awaits release by job manager
Apr 10 08:12:54 PM UTC 2024 released job awaits launch by Slurm scheduler
Apr 10 08:13:56 PM UTC 2024 running job 166838 is running
Apr 10 08:20:09 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-166838.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gzsize: 20 MiB (21015508 bytes)
entries: 32611
modules under 2023.06/software/linux/aarch64/generic/modules/all
EasyBuild/4.9.1.lua
software under 2023.06/software/linux/aarch64/generic/software
EasyBuild/4.9.1
other under 2023.06/software/linux/aarch64/generic
no other files in tarball
Apr 10 08:20:09 PM UTC 2024 test result (no tests yet)
Apr 10 08:49:16 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz to S3 bucket succeeded
Apr 10 08:56:59 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz to S3 bucket succeeded
Apr 10 09:04:16 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz to S3 bucket succeeded
Apr 10 09:37:14 PM UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz to S3 bucket failed
Apr 10 10:20:01 PM UTC 2024 staged tarball eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz downloaded to Stratum-0
Apr 10 10:20:30 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/116 to approve ingest
Apr 10 10:26:36 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/116
Apr 10 10:28:51 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-aarch64-generic-1712780360.tar.gz successfully ingested at 2023.06/software/linux/aarch64/generic/

@trz42
Copy link
Collaborator Author

trz42 commented Apr 10, 2024 •
edited
Loading

Checklist before starting deployment (setting bot:deploy label):

  • Check if the SPDX license identifier is provided
  • Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
  • Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
  • Assess if all requested changes are sound (checking files changed on github.com)
  • Verify that all easyconfig/s being built are included with the EB version used (if not why not)
  • Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)

@trz42
Copy link
Collaborator Author

trz42 commented Apr 10, 2024 •
edited by poksumdo
Loading

Target architectures

  • x86_64-intel-broadwell
  • x86_64-intel-skylake_avx512
  • x86_64-amd-zen2
  • x86_64-generic
  • aarch64-generic

Checklist for deployment/ingestion

  • at least one tarball for each architecture has been uploaded
    • two tarballs for aarch64/generic (despite one FAILURE for build on AWS)
    • first upload from eX3 failed
    • second upload from eX3 failed
    • several attempts failed
      • put workaround in place that uploads files from a compute node which apparently instantly connects to the Minio server
  • at least one tarball for each architecture has been staged
  • for each staged tarball was a PR for approval/rejection opened
  • for each architecture one and only one tarball has been approved
  • for each architecture one and only one tarball was ingested
  • all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
  • has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)
command & log

command

cd /cvmfs/pilot.nessi.no/versions/2023.06/software/linux ; \
ls -l \
      x86_64/{generic,amd/zen2,intel/[bsc]*}/{software,modules/all}/EasyBuild/4.9.1* \
      aarch64/generic/{software,modules/all}/EasyBuild/4.9.1*

log

-rw-r--r--. 1 cvmfs cvmfs 1223 Apr 10 20:16 aarch64/generic/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1222 Apr 10 19:42 x86_64/amd/zen2/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1221 Apr 10 19:42 x86_64/generic/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1229 Apr 10 19:40 x86_64/intel/broadwell/modules/all/EasyBuild/4.9.1.lua
-rw-rw-r--. 1 cvmfs cvmfs 1234 Apr 10 19:41 x86_64/intel/skylake_avx512/modules/all/EasyBuild/4.9.1.lua

aarch64/generic/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 20:15 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 20:15 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 20:18 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 20:15 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 20:15 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 20:16 lib64 -> lib

x86_64/amd/zen2/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:42 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:41 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:41 lib64 -> lib

x86_64/generic/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:42 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:41 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:41 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:41 lib64 -> lib

x86_64/intel/broadwell/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:41 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:40 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:40 lib64 -> lib

x86_64/intel/skylake_avx512/software/EasyBuild/4.9.1:
total 23
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 bin
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 contrib
dr-xr-xr-x. 5 cvmfs cvmfs 4096 Apr 10 19:42 easybuild
dr-xr-xr-x. 2 cvmfs cvmfs 4096 Apr 10 19:40 etc
dr-xr-xr-x. 3 cvmfs cvmfs 4096 Apr 10 19:40 lib
lrwxrwxrwx. 1 cvmfs cvmfs    3 Apr 10 19:41 lib64 -> lib

poksumdo
poksumdo approved these changes Apr 10, 2024
View reviewed changes
Copy link

@poksumdo poksumdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All ingested. Will be interesting to see if workaround on eX3 works from bot too. (For this PR the upload script was run from the command line.)

@poksumdo poksumdo merged commit cc6c6a6 into NorESSI:nessi.no-2023.06 Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@poksumdo poksumdo poksumdo approved these changes

Assignees

No one assigned

Labels

bot:deploy NESSI/2023.06

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@trz42 @poksumdo @truib