add `{pre,post}_prepare_hook` for LLVM to solve A64FX build issue by changing `optarch` #97

bedroge · 2025-10-01T09:29:34Z

Still doing an interactive test build with this file to test it, please don't deploy/merge it yet.

bedroge · 2025-10-01T12:50:38Z

Tested interactively with EESSI-extend on an A64FX node by overriding $EASYBUILD_HOOKS:

== COMPLETED: Installation ended successfully (took 3 hours 36 mins 39 secs)
== Results of the build can be found in the log file(s) 
/home/eessibot/eessi/versions/2023.06/software/linux/aarch64/a64fx/software/LLVM/15.0.5-GCCcore-12.2.0/easybuild/easybuild-LLVM-15.0.5-20251001.133852.log.bz2

== Build succeeded for 1 out of 1
== Temporary log file(s) /tmp/eb-fkv3lq55/easybuild-e6uc9mkm.log* have been removed.
== Temporary directory /tmp/eb-fkv3lq55 has been removed.

So, should be good to go.

bedroge · 2025-10-03T07:02:22Z

Since the same workaround should also solve the Rust 1.65.0 issue, I've applied it for that application as well, and removed the hook added by #86. We should be able to do a rebuild of Rust 1.65.0 now.

bedroge · 2025-10-03T07:10:39Z

Added easystacks for both LLVM 15 and (a rebuild of) Rust 1.65.0, so we can try the hook here. If it works, we could even deploy them from here, remove the easystacks from the PR, and open a PR in software-layer with the same easystacks (CI should pass right away).

bedroge · 2025-10-03T07:11:02Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

eessi-bot-deucalion · 2025-10-03T07:11:10Z

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.10/pr_97/568947

date	job status	comment
Oct 03 07:11:08 UTC 2025	submitted	job id `568947` awaits release by job manager
Oct 03 07:11:36 UTC 2025	released	job awaits launch by Slurm scheduler
Oct 03 07:12:38 UTC 2025	running	job `568947` is running
Oct 03 07:22:57 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-568947.out` ✅ no message matching `FATAL:` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ❌ found message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-a64fx-17594757950.tar.gz` size: 0 MiB (21322 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/a64fx/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/a64fx/software no software packages in tarball reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod no reprod directories in tarball other under 2023.06/software/linux/aarch64/a64fx `2023.06/init/easybuild/eb_hooks.py`
Oct 03 07:22:57 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ SKIP ] ( 1/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 2/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 3/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 4/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ OK ] ( 5/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:aarch64_a64fx+default P: perf: 579.07 timesteps/s (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default P: perf: 581.806 timesteps/s (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default P: latency: 1.66 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default P: latency: 1.69 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default P: bandwidth: 8312.93 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default P: bandwidth: 8524.65 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 6/10 test case(s) from 10 check(s) (0 failure(s), 4 skipped, 0 aborted) Details ✅ job output file `slurm-568947.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

bedroge · 2025-10-03T07:20:45Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

eessi-bot-deucalion · 2025-10-03T07:20:53Z

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.10/pr_97/568949

date	job status	comment
Oct 03 07:20:52 UTC 2025	submitted	job id `568949` awaits release by job manager
Oct 03 07:21:53 UTC 2025	released	job awaits launch by Slurm scheduler
Oct 03 07:22:56 UTC 2025	running	job `568949` is running
Oct 03 11:24:58 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-568949.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-a64fx-17594901780.tar.gz` size: 318 MiB (333812423 bytes) entries: 39773 modules under 2023.06/software/linux/aarch64/a64fx/modules/all `LLVM/15.0.5-GCCcore-12.2.0.lua` `Rust/1.65.0-GCCcore-12.2.0.lua` software under 2023.06/software/linux/aarch64/a64fx/software `LLVM/15.0.5-GCCcore-12.2.0` `Rust/1.65.0-GCCcore-12.2.0` reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod no reprod directories in tarball other under 2023.06/software/linux/aarch64/a64fx `2023.06/init/easybuild/eb_hooks.py`
Oct 03 11:24:58 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ SKIP ] ( 1/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 2/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 3/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 4/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ OK ] ( 5/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:aarch64_a64fx+default P: perf: 581.785 timesteps/s (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default P: perf: 87.971 timesteps/s (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default P: latency: 1.68 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default P: latency: 1.74 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default P: bandwidth: 8447.21 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default P: bandwidth: 8334.12 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 6/10 test case(s) from 10 check(s) (0 failure(s), 4 skipped, 0 aborted) Details ✅ job output file `slurm-568949.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

ocaisa

LGTM, we need to build the hooks for both EESSI versions,so will need to open a PR in the software-layer repo for the easystack files

bedroge · 2025-10-03T12:24:59Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx
bot: build repo:eessi.io-2025.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

eessi-bot-deucalion · 2025-10-03T12:25:07Z

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.10/pr_97/569453

date	job status	comment
Oct 03 12:25:06 UTC 2025	submitted	job id `569453` awaits release by job manager
Oct 03 12:25:20 UTC 2025	released	job awaits launch by Slurm scheduler
Oct 03 12:26:22 UTC 2025	running	job `569453` is running
Oct 03 12:33:36 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-569453.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-a64fx-17594944840.tar.gz` size: 0 MiB (21327 bytes) entries: 1 modules under 2023.06/software/linux/aarch64/a64fx/modules/all no module files in tarball software under 2023.06/software/linux/aarch64/a64fx/software no software packages in tarball reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod no reprod directories in tarball other under 2023.06/software/linux/aarch64/a64fx `2023.06/init/easybuild/eb_hooks.py`
Oct 03 12:33:36 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ SKIP ] ( 1/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 2/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 3/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ SKIP ] ( 4/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed [ OK ] ( 5/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:aarch64_a64fx+default P: perf: 581.156 timesteps/s (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default P: perf: 583.295 timesteps/s (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default P: latency: 1.71 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default P: latency: 1.68 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default P: bandwidth: 8696.63 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default P: bandwidth: 8192.02 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 6/10 test case(s) from 10 check(s) (0 failure(s), 4 skipped, 0 aborted) Details ✅ job output file `slurm-569453.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
Oct 03 12:34:48 UTC 2025	uploaded	transfer of `eessi-2023.06-software-linux-aarch64-a64fx-17594944840.tar.gz` to S3 bucket succeeded

eessi-bot-deucalion · 2025-10-03T12:25:12Z

New job on instance eessi-bot-deucalion for repository eessi.io-2025.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.10/pr_97/569454

date	job status	comment
Oct 03 12:25:11 UTC 2025	submitted	job id `569454` awaits release by job manager
Oct 03 12:25:17 UTC 2025	released	job awaits launch by Slurm scheduler
Oct 03 12:26:24 UTC 2025	running	job `569454` is running
Oct 03 12:27:27 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-569454.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2025.06-software-linux-aarch64-a64fx-17594943600.tar.gz` size: 0 MiB (21327 bytes) entries: 1 modules under 2025.06/software/linux/aarch64/a64fx/modules/all no module files in tarball software under 2025.06/software/linux/aarch64/a64fx/software no software packages in tarball reprod directories under 2025.06/software/linux/aarch64/a64fx/reprod no reprod directories in tarball other under 2025.06/software/linux/aarch64/a64fx `2025.06/init/easybuild/eb_hooks.py`
Oct 03 12:27:27 UTC 2025	test result	😢 FAILURE (click triangle for details) Reason EESSI test suite was not run, test step itself failed to execute. Details ✅ job output file `slurm-569454.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
Oct 03 12:34:57 UTC 2025	uploaded	transfer of `eessi-2025.06-software-linux-aarch64-a64fx-17594943600.tar.gz` to S3 bucket succeeded

ocaisa

LGTM

add pre+post prepare hooks for LLVM to solve A64FX build issue

6505024

bedroge changed the title ~~add {pre,post}prepare_hook for LLVM to solve A64FX build issue by changing optarch~~ add {pre,post}_prepare_hook for LLVM to solve A64FX build issue by changing optarch Oct 1, 2025

bedroge added 2 commits October 3, 2025 08:59

apply the LLVM pre/post prepare hook to Rust as well

ee61746

remove hook that disabled Rust 1.65.0 and replaced it by 1.75.0

1d6db72

bedroge added 2 commits October 3, 2025 09:09

add easystack for rebuild Rust 1.65.0

0e92f39

add easystack that adds LLVM 15

f14aa67

fix name of pre prepare hook for LLVM

1ddd58e

ocaisa requested changes Oct 3, 2025

View reviewed changes

remove easystacks again

c7eb036

ocaisa approved these changes Oct 3, 2025

View reviewed changes

bedroge mentioned this pull request Oct 3, 2025

{2023.06}[2022b, a64fx] LLVM 15.0.5 EESSI/software-layer#1214

Merged

ocaisa added the bot:deploy label Oct 3, 2025

This was referenced Oct 3, 2025

{2023.06}[2022b, a64fx] Rebuild Rust 1.65.0 and Python 3.10.8 EESSI/software-layer#1215

Merged

LLVM 14.0.6 and 15.0.5 builds fail on A64FX EESSI/software-layer#1213

Closed

ocaisa merged commit 81d2779 into EESSI:main Oct 3, 2025
66 of 68 checks passed

bedroge deleted the a64fx_llvm_optarch branch October 3, 2025 14:14

add {pre,post}_prepare_hook for LLVM to solve A64FX build issue by changing optarch #97

add {pre,post}_prepare_hook for LLVM to solve A64FX build issue by changing optarch #97

Uh oh!

Conversation

bedroge commented Oct 1, 2025

Uh oh!

bedroge commented Oct 1, 2025

Uh oh!

bedroge commented Oct 3, 2025

Uh oh!

bedroge commented Oct 3, 2025

Uh oh!

bedroge commented Oct 3, 2025

Uh oh!

eessi-bot-deucalion bot commented Oct 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

bedroge commented Oct 3, 2025

Uh oh!

eessi-bot-deucalion bot commented Oct 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ocaisa left a comment

Choose a reason for hiding this comment

Uh oh!

bedroge commented Oct 3, 2025

Uh oh!

eessi-bot-deucalion bot commented Oct 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

eessi-bot-deucalion bot commented Oct 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ocaisa left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

add `{pre,post}_prepare_hook` for LLVM to solve A64FX build issue by changing `optarch` #97

add `{pre,post}_prepare_hook` for LLVM to solve A64FX build issue by changing `optarch` #97

eessi-bot-deucalion bot commented Oct 3, 2025 •

edited

Loading

eessi-bot-deucalion bot commented Oct 3, 2025 •

edited

Loading

eessi-bot-deucalion bot commented Oct 3, 2025 •

edited

Loading

eessi-bot-deucalion bot commented Oct 3, 2025 •

edited

Loading