Skip to content

Conversation

@hvelab
Copy link
Contributor

@hvelab hvelab commented Aug 13, 2025

Based on #989

@hvelab
Copy link
Contributor Author

hvelab commented Aug 13, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion architecture:aarch64/a64fx

@eessi-bot-deucalion
Copy link

eessi-bot-deucalion bot commented Aug 13, 2025

New job on instance eessi-bot-deucalion for CPU micro-architecture aarch64-a64fx for repository eessi.io-2023.06-software in job dir /home/eessibot/new-bot/jobs/2025.08/pr_1151/513054

date job status comment
Aug 13 12:54:01 UTC 2025 submitted job id 513054 awaits release by job manager
Aug 13 12:54:46 UTC 2025 released job awaits launch by Slurm scheduler
Aug 13 12:55:48 UTC 2025 running job 513054 is running
Aug 13 13:07:06 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-513054.out
✅ no message matching FATAL:
❌ found message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-17550901390.tar.gzsize: 11 MiB (12383007 bytes)
entries: 135
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
dlb/3.4-gompi-2023b.lua
software under 2023.06/software/linux/aarch64/a64fx/software
dlb/3.4-gompi-2023b
reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod
no reprod directories in tarball
other under 2023.06/software/linux/aarch64/a64fx
no other files in tarball
Aug 13 13:07:06 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ SKIP ] (1/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (2/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (3/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (4/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ OK ] (5/9) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default
P: perf: 583.327 timesteps/s (r:0, l:None, u:None)
[ OK ] (6/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default
P: latency: 1.72 us (r:0, l:None, u:None)
[ OK ] (7/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default
P: latency: 1.73 us (r:0, l:None, u:None)
[ OK ] (8/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8705.19 MB/s (r:0, l:None, u:None)
[ OK ] (9/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8670.66 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 5/9 test case(s) from 9 check(s) (0 failure(s), 4 skipped, 0 aborted)
Details
✅ job output file slurm-513054.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@boegel boegel added 2023.06-software.eessi.io 2023.06 version of software.eessi.io a64fx labels Aug 19, 2025
@hvelab
Copy link
Contributor Author

hvelab commented Aug 22, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion architecture:aarch64/a64fx

@boegel
Copy link
Contributor

boegel commented Aug 22, 2025

@hvelab We have updated the bot on Deucalion to v0.9.0, which includes a breaking change w.r.t. build commands.
Using arch: will no longer work, you should use for: instead, see updated docs at https://www.eessi.io/docs/bot/#building

So use for:arch=aarch64/a64fx instead architecture:aarch64/a64fx (or arch:aarch64/a64fx).

It's probably wise to hold off on re-triggering builds for A64FX until this fix is merged:

@hvelab
Copy link
Contributor Author

hvelab commented Sep 1, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

@eessi-bot-deucalion
Copy link

eessi-bot-deucalion bot commented Sep 1, 2025

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.09/pr_1151/528529

date job status comment
Sep 01 10:10:43 UTC 2025 submitted job id 528529 awaits release by job manager
Sep 01 10:11:10 UTC 2025 released job awaits launch by Slurm scheduler
Sep 01 10:12:14 UTC 2025 running job 528529 is running
Sep 01 10:18:40 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-528529.out
✅ no message matching FATAL:
❌ found message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-17567216270.tar.gzsize: 0 MiB (45 bytes)
entries: 0
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/a64fx/software
no software packages in tarball
reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod
no reprod directories in tarball
other under 2023.06/software/linux/aarch64/a64fx
no other files in tarball
Sep 01 10:18:40 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ SKIP ] (1/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (2/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (3/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (4/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ OK ] (5/9) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default
P: perf: 584.499 timesteps/s (r:0, l:None, u:None)
[ OK ] (6/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default
P: latency: 1.67 us (r:0, l:None, u:None)
[ OK ] (7/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default
P: latency: 1.72 us (r:0, l:None, u:None)
[ OK ] (8/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8690.76 MB/s (r:0, l:None, u:None)
[ OK ] (9/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8126.96 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 5/9 test case(s) from 9 check(s) (0 failure(s), 4 skipped, 0 aborted)
Details
✅ job output file slurm-528529.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@hvelab
Copy link
Contributor Author

hvelab commented Sep 2, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

@eessi-bot-deucalion
Copy link

eessi-bot-deucalion bot commented Sep 2, 2025

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.09/pr_1151/529934

date job status comment
Sep 02 12:38:34 UTC 2025 submitted job id 529934 awaits release by job manager
Sep 02 12:38:50 UTC 2025 released job awaits launch by Slurm scheduler
Sep 02 12:39:53 UTC 2025 running job 529934 is running
Sep 02 23:37:22 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-529934.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-17568557760.tar.gzsize: 326 MiB (342361339 bytes)
entries: 25370
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
ATK/2.38.0-GCCcore-13.2.0.lua
Brunsli/0.1-GCCcore-13.2.0.lua
Extrae/4.2.0-gompi-2023b.lua
FLAC/1.4.3-GCCcore-13.2.0.lua
FriBidi/1.0.13-GCCcore-13.2.0.lua
GDAL/3.9.0-foss-2023b.lua
GEOS/3.12.1-GCC-13.2.0.lua
GLPK/5.0-GCCcore-13.2.0.lua
GTK3/3.24.39-GCCcore-13.2.0.lua
Ghostscript/10.02.1-GCCcore-13.2.0.lua
HDF/4.2.16-2-GCCcore-13.2.0.lua
HPL/2.3-foss-2023b.lua
HTSlib/1.19.1-GCC-13.2.0.lua
ImageMagick/7.1.1-34-GCCcore-13.2.0.lua
Imath/3.1.9-GCCcore-13.2.0.lua
LAME/3.100-GCCcore-13.2.0.lua
LERC/4.0.0-GCCcore-13.2.0.lua
MPC/1.3.1-GCCcore-13.2.0.lua
NLopt/2.7.1-GCCcore-13.2.0.lua
OpenEXR/3.2.0-GCCcore-13.2.0.lua
PAPI/7.1.0-GCCcore-13.2.0.lua
Pango/1.51.0-GCCcore-13.2.0.lua
PostgreSQL/16.1-GCCcore-13.2.0.lua
R/4.4.1-gfbf-2023b.lua
STAR/2.7.11b-GCC-13.2.0.lua
SWIG/4.1.1-GCCcore-13.2.0.lua
Xerces-C++/3.2.5-GCCcore-13.2.0.lua
Xvfb/21.1.9-GCCcore-13.2.0.lua
at-spi2-atk/2.38.0-GCCcore-13.2.0.lua
at-spi2-core/2.50.0-GCCcore-13.2.0.lua
dlb/3.4-gompi-2023b.lua
elfutils/0.190-GCCcore-13.2.0.lua
gmpy2/2.1.5-GCC-13.2.0.lua
json-c/0.17-GCCcore-13.2.0.lua
libdwarf/0.9.2-GCCcore-13.2.0.lua
libepoxy/1.5.10-GCCcore-13.2.0.lua
libgeotiff/1.7.3-GCCcore-13.2.0.lua
libgit2/1.7.2-GCCcore-13.2.0.lua
libogg/1.3.5-GCCcore-13.2.0.lua
libopus/1.5.2-GCCcore-13.2.0.lua
libsndfile/1.2.2-GCCcore-13.2.0.lua
libtirpc/1.3.4-GCCcore-13.2.0.lua
libvorbis/1.3.7-GCCcore-13.2.0.lua
nettle/3.9.1-GCCcore-13.2.0.lua
pystencils/1.3.4-gfbf-2023b.lua
sympy/1.12-gfbf-2023b.lua
xxd/9.1.0307-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/a64fx/software
ATK/2.38.0-GCCcore-13.2.0
Brunsli/0.1-GCCcore-13.2.0
Extrae/4.2.0-gompi-2023b
FLAC/1.4.3-GCCcore-13.2.0
FriBidi/1.0.13-GCCcore-13.2.0
GDAL/3.9.0-foss-2023b
GEOS/3.12.1-GCC-13.2.0
GLPK/5.0-GCCcore-13.2.0
GTK3/3.24.39-GCCcore-13.2.0
Ghostscript/10.02.1-GCCcore-13.2.0
HDF/4.2.16-2-GCCcore-13.2.0
HPL/2.3-foss-2023b
HTSlib/1.19.1-GCC-13.2.0
ImageMagick/7.1.1-34-GCCcore-13.2.0
Imath/3.1.9-GCCcore-13.2.0
LAME/3.100-GCCcore-13.2.0
LERC/4.0.0-GCCcore-13.2.0
MPC/1.3.1-GCCcore-13.2.0
NLopt/2.7.1-GCCcore-13.2.0
OpenEXR/3.2.0-GCCcore-13.2.0
PAPI/7.1.0-GCCcore-13.2.0
Pango/1.51.0-GCCcore-13.2.0
PostgreSQL/16.1-GCCcore-13.2.0
R/4.4.1-gfbf-2023b
STAR/2.7.11b-GCC-13.2.0
SWIG/4.1.1-GCCcore-13.2.0
Xerces-C++/3.2.5-GCCcore-13.2.0
Xvfb/21.1.9-GCCcore-13.2.0
at-spi2-atk/2.38.0-GCCcore-13.2.0
at-spi2-core/2.50.0-GCCcore-13.2.0
dlb/3.4-gompi-2023b
elfutils/0.190-GCCcore-13.2.0
gmpy2/2.1.5-GCC-13.2.0
json-c/0.17-GCCcore-13.2.0
libdwarf/0.9.2-GCCcore-13.2.0
libepoxy/1.5.10-GCCcore-13.2.0
libgeotiff/1.7.3-GCCcore-13.2.0
libgit2/1.7.2-GCCcore-13.2.0
libogg/1.3.5-GCCcore-13.2.0
libopus/1.5.2-GCCcore-13.2.0
libsndfile/1.2.2-GCCcore-13.2.0
libtirpc/1.3.4-GCCcore-13.2.0
libvorbis/1.3.7-GCCcore-13.2.0
nettle/3.9.1-GCCcore-13.2.0
pystencils/1.3.4-gfbf-2023b
sympy/1.12-gfbf-2023b
xxd/9.1.0307-GCCcore-13.2.0
reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod
no reprod directories in tarball
other under 2023.06/software/linux/aarch64/a64fx
no other files in tarball
Sep 02 23:37:22 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ SKIP ] (1/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (2/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (3/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (4/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ OK ] (5/9) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default
P: perf: 13.645 timesteps/s (r:0, l:None, u:None)
[ OK ] (6/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default
P: latency: 1.68 us (r:0, l:None, u:None)
[ OK ] (7/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default
P: latency: 1.7 us (r:0, l:None, u:None)
[ OK ] (8/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8811.2 MB/s (r:0, l:None, u:None)
[ OK ] (9/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8746.06 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 5/9 test case(s) from 9 check(s) (0 failure(s), 4 skipped, 0 aborted)
Details
✅ job output file slurm-529934.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@hvelab
Copy link
Contributor Author

hvelab commented Sep 3, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

@eessi-bot-deucalion
Copy link

eessi-bot-deucalion bot commented Sep 3, 2025

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.09/pr_1151/531092

date job status comment
Sep 03 12:40:07 UTC 2025 submitted job id 531092 awaits release by job manager
Sep 03 12:41:09 UTC 2025 released job awaits launch by Slurm scheduler
Sep 03 12:43:12 UTC 2025 running job 531092 is running
Sep 03 23:46:16 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-531092.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-17569426960.tar.gzsize: 289 MiB (304052606 bytes)
entries: 24669
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
ATK/2.38.0-GCCcore-13.2.0.lua
Brunsli/0.1-GCCcore-13.2.0.lua
Extrae/4.2.0-gompi-2023b.lua
FLAC/1.4.3-GCCcore-13.2.0.lua
FriBidi/1.0.13-GCCcore-13.2.0.lua
GEOS/3.12.1-GCC-13.2.0.lua
GLPK/5.0-GCCcore-13.2.0.lua
GTK3/3.24.39-GCCcore-13.2.0.lua
Ghostscript/10.02.1-GCCcore-13.2.0.lua
HDF/4.2.16-2-GCCcore-13.2.0.lua
HPL/2.3-foss-2023b.lua
HTSlib/1.19.1-GCC-13.2.0.lua
ImageMagick/7.1.1-34-GCCcore-13.2.0.lua
Imath/3.1.9-GCCcore-13.2.0.lua
LAME/3.100-GCCcore-13.2.0.lua
LERC/4.0.0-GCCcore-13.2.0.lua
MPC/1.3.1-GCCcore-13.2.0.lua
NLopt/2.7.1-GCCcore-13.2.0.lua
OpenEXR/3.2.0-GCCcore-13.2.0.lua
PAPI/7.1.0-GCCcore-13.2.0.lua
Pango/1.51.0-GCCcore-13.2.0.lua
PostgreSQL/16.1-GCCcore-13.2.0.lua
R/4.4.1-gfbf-2023b.lua
STAR/2.7.11b-GCC-13.2.0.lua
SWIG/4.1.1-GCCcore-13.2.0.lua
Xerces-C++/3.2.5-GCCcore-13.2.0.lua
Xvfb/21.1.9-GCCcore-13.2.0.lua
at-spi2-atk/2.38.0-GCCcore-13.2.0.lua
at-spi2-core/2.50.0-GCCcore-13.2.0.lua
dlb/3.4-gompi-2023b.lua
elfutils/0.190-GCCcore-13.2.0.lua
gmpy2/2.1.5-GCC-13.2.0.lua
json-c/0.17-GCCcore-13.2.0.lua
libdwarf/0.9.2-GCCcore-13.2.0.lua
libepoxy/1.5.10-GCCcore-13.2.0.lua
libgeotiff/1.7.3-GCCcore-13.2.0.lua
libgit2/1.7.2-GCCcore-13.2.0.lua
libogg/1.3.5-GCCcore-13.2.0.lua
libopus/1.5.2-GCCcore-13.2.0.lua
libsndfile/1.2.2-GCCcore-13.2.0.lua
libtirpc/1.3.4-GCCcore-13.2.0.lua
libvorbis/1.3.7-GCCcore-13.2.0.lua
nettle/3.9.1-GCCcore-13.2.0.lua
pystencils/1.3.4-gfbf-2023b.lua
sympy/1.12-gfbf-2023b.lua
xxd/9.1.0307-GCCcore-13.2.0.lua
software under 2023.06/software/linux/aarch64/a64fx/software
ATK/2.38.0-GCCcore-13.2.0
Brunsli/0.1-GCCcore-13.2.0
Extrae/4.2.0-gompi-2023b
FLAC/1.4.3-GCCcore-13.2.0
FriBidi/1.0.13-GCCcore-13.2.0
GEOS/3.12.1-GCC-13.2.0
GLPK/5.0-GCCcore-13.2.0
GTK3/3.24.39-GCCcore-13.2.0
Ghostscript/10.02.1-GCCcore-13.2.0
HDF/4.2.16-2-GCCcore-13.2.0
HPL/2.3-foss-2023b
HTSlib/1.19.1-GCC-13.2.0
ImageMagick/7.1.1-34-GCCcore-13.2.0
Imath/3.1.9-GCCcore-13.2.0
LAME/3.100-GCCcore-13.2.0
LERC/4.0.0-GCCcore-13.2.0
MPC/1.3.1-GCCcore-13.2.0
NLopt/2.7.1-GCCcore-13.2.0
OpenEXR/3.2.0-GCCcore-13.2.0
PAPI/7.1.0-GCCcore-13.2.0
Pango/1.51.0-GCCcore-13.2.0
PostgreSQL/16.1-GCCcore-13.2.0
R/4.4.1-gfbf-2023b
STAR/2.7.11b-GCC-13.2.0
SWIG/4.1.1-GCCcore-13.2.0
Xerces-C++/3.2.5-GCCcore-13.2.0
Xvfb/21.1.9-GCCcore-13.2.0
at-spi2-atk/2.38.0-GCCcore-13.2.0
at-spi2-core/2.50.0-GCCcore-13.2.0
dlb/3.4-gompi-2023b
elfutils/0.190-GCCcore-13.2.0
gmpy2/2.1.5-GCC-13.2.0
json-c/0.17-GCCcore-13.2.0
libdwarf/0.9.2-GCCcore-13.2.0
libepoxy/1.5.10-GCCcore-13.2.0
libgeotiff/1.7.3-GCCcore-13.2.0
libgit2/1.7.2-GCCcore-13.2.0
libogg/1.3.5-GCCcore-13.2.0
libopus/1.5.2-GCCcore-13.2.0
libsndfile/1.2.2-GCCcore-13.2.0
libtirpc/1.3.4-GCCcore-13.2.0
libvorbis/1.3.7-GCCcore-13.2.0
nettle/3.9.1-GCCcore-13.2.0
pystencils/1.3.4-gfbf-2023b
sympy/1.12-gfbf-2023b
xxd/9.1.0307-GCCcore-13.2.0
reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod
no reprod directories in tarball
other under 2023.06/software/linux/aarch64/a64fx
no other files in tarball
Sep 03 23:46:16 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ SKIP ] (1/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (2/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (3/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] (4/9) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ OK ] (5/9) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default
P: perf: 14.61 timesteps/s (r:0, l:None, u:None)
[ OK ] (6/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default
P: latency: 1.67 us (r:0, l:None, u:None)
[ OK ] (7/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default
P: latency: 1.72 us (r:0, l:None, u:None)
[ OK ] (8/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8706.98 MB/s (r:0, l:None, u:None)
[ OK ] (9/9) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8439.52 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 5/9 test case(s) from 9 check(s) (0 failure(s), 4 skipped, 0 aborted)
Details
✅ job output file slurm-531092.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

options:
# see https://github.com/easybuilders/easybuild-easyconfigs/pull/21366
# use the latest update of the bundle
from-commit: 743dcc4e3440f29200b90a3cd1aaee2580aaf19f
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this commit is too recent (from EB 5.x), and it will probably use easyconfigs for dependencies from this same commit, causing failures (in this particular case for GDAL, I guess because PYTHONPATH is not explicitly set anymore). Maybe it's better to stick to an older one, e.g. one that was used for grace or sapphirerapids.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The older commits "work" but checksums fail for some extensions, what's the correct way to proceed here? I pick the recipe for an older commit, fix the checksums and make a PR for EB with maybe a different name or some way to differentiate it?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, that's tricky indeed... Maybe you could still use the latest commit then, but in order to prevent build failures of the dependencies (e.g. GDAL), those would have to use an older commit (e.g. the one that we used for sapphirerapids: https://github.com/EESSI/software-layer/blob/main/easystacks/software.eessi.io/2023.06/sapphirerapids/eessi-2023.06-eb-4.9.2-2023b.yml#L27).

Alternatively, we could build the R bundle and its dependencies with a newer EB version. Then we won't build everything in the exact same way as for the other CPUs, but it's much easier to do it that way.

@hvelab
Copy link
Contributor Author

hvelab commented Sep 17, 2025

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

@eessi-bot-deucalion
Copy link

eessi-bot-deucalion bot commented Sep 17, 2025

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.09/pr_1151/548950

date job status comment
Sep 17 09:14:00 UTC 2025 submitted job id 548950 awaits release by job manager
Sep 17 09:14:24 UTC 2025 released job awaits launch by Slurm scheduler
Sep 17 09:15:27 UTC 2025 running job 548950 is running
Sep 17 19:28:00 UTC 2025 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-548950.out
✅ no message matching FATAL:
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-17581367940.tar.gzsize: 274 MiB (287332552 bytes)
entries: 19802
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
Brunsli/0.1-GCCcore-13.2.0.lua
Extrae/4.2.0-gompi-2023b.lua
FLAC/1.4.3-GCCcore-13.2.0.lua
GDAL/3.9.0-foss-2023b.lua
GEOS/3.12.1-GCC-13.2.0.lua
GLPK/5.0-GCCcore-13.2.0.lua
Ghostscript/10.02.1-GCCcore-13.2.0.lua
HDF/4.2.16-2-GCCcore-13.2.0.lua
HPL/2.3-foss-2023b.lua
HTSlib/1.19.1-GCC-13.2.0.lua
ImageMagick/7.1.1-34-GCCcore-13.2.0.lua
Imath/3.1.9-GCCcore-13.2.0.lua
LERC/4.0.0-GCCcore-13.2.0.lua
MPC/1.3.1-GCCcore-13.2.0.lua
NLopt/2.7.1-GCCcore-13.2.0.lua
OpenEXR/3.2.0-GCCcore-13.2.0.lua
R/4.4.1-gfbf-2023b.lua
STAR/2.7.11b-GCC-13.2.0.lua
SWIG/4.1.1-GCCcore-13.2.0.lua
Xerces-C++/3.2.5-GCCcore-13.2.0.lua
Xvfb/21.1.9-GCCcore-13.2.0.lua
dlb/3.4-gompi-2023b.lua
gmpy2/2.1.5-GCC-13.2.0.lua
json-c/0.17-GCCcore-13.2.0.lua
libdwarf/0.9.2-GCCcore-13.2.0.lua
libgeotiff/1.7.3-GCCcore-13.2.0.lua
libgit2/1.7.2-GCCcore-13.2.0.lua
libogg/1.3.5-GCCcore-13.2.0.lua
libopus/1.5.2-GCCcore-13.2.0.lua
libsndfile/1.2.2-GCCcore-13.2.0.lua
libtirpc/1.3.4-GCCcore-13.2.0.lua
libvorbis/1.3.7-GCCcore-13.2.0.lua
nettle/3.9.1-GCCcore-13.2.0.lua
pystencils/1.3.4-gfbf-2023b.lua
sympy/1.12-gfbf-2023b.lua
software under 2023.06/software/linux/aarch64/a64fx/software
Brunsli/0.1-GCCcore-13.2.0
Extrae/4.2.0-gompi-2023b
FLAC/1.4.3-GCCcore-13.2.0
GDAL/3.9.0-foss-2023b
GEOS/3.12.1-GCC-13.2.0
GLPK/5.0-GCCcore-13.2.0
Ghostscript/10.02.1-GCCcore-13.2.0
HDF/4.2.16-2-GCCcore-13.2.0
HPL/2.3-foss-2023b
HTSlib/1.19.1-GCC-13.2.0
ImageMagick/7.1.1-34-GCCcore-13.2.0
Imath/3.1.9-GCCcore-13.2.0
LERC/4.0.0-GCCcore-13.2.0
MPC/1.3.1-GCCcore-13.2.0
NLopt/2.7.1-GCCcore-13.2.0
OpenEXR/3.2.0-GCCcore-13.2.0
R/4.4.1-gfbf-2023b
STAR/2.7.11b-GCC-13.2.0
SWIG/4.1.1-GCCcore-13.2.0
Xerces-C++/3.2.5-GCCcore-13.2.0
Xvfb/21.1.9-GCCcore-13.2.0
dlb/3.4-gompi-2023b
gmpy2/2.1.5-GCC-13.2.0
json-c/0.17-GCCcore-13.2.0
libdwarf/0.9.2-GCCcore-13.2.0
libgeotiff/1.7.3-GCCcore-13.2.0
libgit2/1.7.2-GCCcore-13.2.0
libogg/1.3.5-GCCcore-13.2.0
libopus/1.5.2-GCCcore-13.2.0
libsndfile/1.2.2-GCCcore-13.2.0
libtirpc/1.3.4-GCCcore-13.2.0
libvorbis/1.3.7-GCCcore-13.2.0
nettle/3.9.1-GCCcore-13.2.0
pystencils/1.3.4-gfbf-2023b
sympy/1.12-gfbf-2023b
reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod
no reprod directories in tarball
other under 2023.06/software/linux/aarch64/a64fx
no other files in tarball
Sep 17 19:28:00 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ SKIP ] ( 1/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] ( 2/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] ( 3/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] ( 4/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ OK ] ( 5/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:aarch64_a64fx+default
P: perf: 497.517 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default
P: perf: 491.051 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default
P: latency: 1.71 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default
P: latency: 1.77 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8451.31 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8431.37 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 6/10 test case(s) from 10 check(s) (0 failure(s), 4 skipped, 0 aborted)
Details
✅ job output file slurm-548950.out
❌ found message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case

@bedroge
Copy link
Collaborator

bedroge commented Sep 18, 2025

It now failed because of a checksum error for the bold extension. I've copied the source file from the AWS bot account to the Deucalion bot account, and this one does have the checksum that matches with the entry from the used R-Bundle-CRAN. So let's try again.

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-deucalion for:arch=aarch64/a64fx

@eessi-bot-deucalion
Copy link

eessi-bot-deucalion bot commented Sep 18, 2025

New job on instance eessi-bot-deucalion for repository eessi.io-2023.06-software
Building on: a64fx
Building for: aarch64/a64fx
Job dir: /home/eessibot/new-bot/jobs/2025.09/pr_1151/550009

date job status comment
Sep 18 15:02:19 UTC 2025 submitted job id 550009 awaits release by job manager
Sep 18 15:02:43 UTC 2025 released job awaits launch by Slurm scheduler
Sep 18 15:03:46 UTC 2025 running job 550009 is running
Sep 20 12:21:54 UTC 2025 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-550009.out
✅ no message matching FATAL:
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-a64fx-17583700770.tar.gzsize: 1918 MiB (2011261011 bytes)
entries: 88117
modules under 2023.06/software/linux/aarch64/a64fx/modules/all
Brunsli/0.1-GCCcore-13.2.0.lua
Extrae/4.2.0-gompi-2023b.lua
FLAC/1.4.3-GCCcore-13.2.0.lua
GDAL/3.9.0-foss-2023b.lua
GEOS/3.12.1-GCC-13.2.0.lua
Ghostscript/10.02.1-GCCcore-13.2.0.lua
HDF/4.2.16-2-GCCcore-13.2.0.lua
HPL/2.3-foss-2023b.lua
HTSlib/1.19.1-GCC-13.2.0.lua
ImageMagick/7.1.1-34-GCCcore-13.2.0.lua
Imath/3.1.9-GCCcore-13.2.0.lua
LERC/4.0.0-GCCcore-13.2.0.lua
MPC/1.3.1-GCCcore-13.2.0.lua
NLopt/2.7.1-GCCcore-13.2.0.lua
OpenEXR/3.2.0-GCCcore-13.2.0.lua
R-bundle-CRAN/2024.06-foss-2023b.lua
R/4.4.1-gfbf-2023b.lua
STAR/2.7.11b-GCC-13.2.0.lua
SWIG/4.1.1-GCCcore-13.2.0.lua
Xerces-C++/3.2.5-GCCcore-13.2.0.lua
Xvfb/21.1.9-GCCcore-13.2.0.lua
dlb/3.4-gompi-2023b.lua
gmpy2/2.1.5-GCC-13.2.0.lua
json-c/0.17-GCCcore-13.2.0.lua
libdwarf/0.9.2-GCCcore-13.2.0.lua
libgeotiff/1.7.3-GCCcore-13.2.0.lua
libgit2/1.7.2-GCCcore-13.2.0.lua
libogg/1.3.5-GCCcore-13.2.0.lua
libopus/1.5.2-GCCcore-13.2.0.lua
libsndfile/1.2.2-GCCcore-13.2.0.lua
libtirpc/1.3.4-GCCcore-13.2.0.lua
libvorbis/1.3.7-GCCcore-13.2.0.lua
nettle/3.9.1-GCCcore-13.2.0.lua
pystencils/1.3.4-gfbf-2023b.lua
sympy/1.12-gfbf-2023b.lua
software under 2023.06/software/linux/aarch64/a64fx/software
Brunsli/0.1-GCCcore-13.2.0
Extrae/4.2.0-gompi-2023b
FLAC/1.4.3-GCCcore-13.2.0
GDAL/3.9.0-foss-2023b
GEOS/3.12.1-GCC-13.2.0
Ghostscript/10.02.1-GCCcore-13.2.0
HDF/4.2.16-2-GCCcore-13.2.0
HPL/2.3-foss-2023b
HTSlib/1.19.1-GCC-13.2.0
ImageMagick/7.1.1-34-GCCcore-13.2.0
Imath/3.1.9-GCCcore-13.2.0
LERC/4.0.0-GCCcore-13.2.0
MPC/1.3.1-GCCcore-13.2.0
NLopt/2.7.1-GCCcore-13.2.0
OpenEXR/3.2.0-GCCcore-13.2.0
R-bundle-CRAN/2024.06-foss-2023b
R/4.4.1-gfbf-2023b
STAR/2.7.11b-GCC-13.2.0
SWIG/4.1.1-GCCcore-13.2.0
Xerces-C++/3.2.5-GCCcore-13.2.0
Xvfb/21.1.9-GCCcore-13.2.0
dlb/3.4-gompi-2023b
gmpy2/2.1.5-GCC-13.2.0
json-c/0.17-GCCcore-13.2.0
libdwarf/0.9.2-GCCcore-13.2.0
libgeotiff/1.7.3-GCCcore-13.2.0
libgit2/1.7.2-GCCcore-13.2.0
libogg/1.3.5-GCCcore-13.2.0
libopus/1.5.2-GCCcore-13.2.0
libsndfile/1.2.2-GCCcore-13.2.0
libtirpc/1.3.4-GCCcore-13.2.0
libvorbis/1.3.7-GCCcore-13.2.0
nettle/3.9.1-GCCcore-13.2.0
pystencils/1.3.4-gfbf-2023b
sympy/1.12-gfbf-2023b
reprod directories under 2023.06/software/linux/aarch64/a64fx/reprod
no reprod directories in tarball
other under 2023.06/software/linux/aarch64/a64fx
no other files in tarball
Sep 20 12:21:54 UTC 2025 test result
😁 SUCCESS (click triangle for details)
ReFrame Summary
[ SKIP ] ( 1/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] ( 2/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] ( 3/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ SKIP ] ( 4/10) Skipping test: nodes in this partition only have 30720 MiB memory available (per node) accodring to the current ReFrame configuration, but 49152 MiB is needed
[ OK ] ( 5/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:aarch64_a64fx+default
P: perf: 13.87 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 6/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:aarch64_a64fx+default
P: perf: 50.441 timesteps/s (r:0, l:None, u:None)
[ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:aarch64_a64fx+default
P: latency: 1.65 us (r:0, l:None, u:None)
[ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:aarch64_a64fx+default
P: latency: 1.71 us (r:0, l:None, u:None)
[ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8820.08 MB/s (r:0, l:None, u:None)
[ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:aarch64_a64fx+default
P: bandwidth: 8746.77 MB/s (r:0, l:None, u:None)
[ PASSED ] Ran 6/10 test case(s) from 10 check(s) (0 failure(s), 4 skipped, 0 aborted)
Details
✅ job output file slurm-550009.out
✅ no message matching ERROR:
✅ no message matching [\s*FAILED\s*].*Ran .* test case
Sep 22 08:24:08 UTC 2025 uploaded transfer of eessi-2023.06-software-linux-aarch64-a64fx-17583700770.tar.gz to S3 bucket succeeded

@hvelab
Copy link
Contributor Author

hvelab commented Sep 22, 2025

Looks like it worked!! I cannot edit the labels to put the deploy one

@ocaisa ocaisa added the bot:deploy Ask bot to deploy missing software installations to EESSI label Sep 22, 2025
@ocaisa
Copy link
Member

ocaisa commented Sep 22, 2025

@hvelab I added it (you wouldn't deploy your own PRs anyway, better to leave that to another pair of eyes)

@ocaisa
Copy link
Member

ocaisa commented Sep 22, 2025

Ingested

@ocaisa ocaisa merged commit f334f91 into EESSI:main Sep 22, 2025
50 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

2023.06-software.eessi.io 2023.06 version of software.eessi.io a64fx bot:deploy Ask bot to deploy missing software installations to EESSI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants