Skip to content

Conversation

@trz42
Copy link
Owner

@trz42 trz42 commented Feb 21, 2024

PR to test deploying to different buckets + directories implemented by EESSI/eessi-bot-software-layer#254

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build:

  • arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2022.11-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11
  • arch aarch64/thunderx2 for repo nessi-2022.11-swl-deb10
  • arch aarch64/thunderx2 for repo nessi-2023.06-cl
  • arch aarch64/thunderx2 for repo nessi-2023.06-swl-deb10
  • arch aarch64/thunderx2 for repo nessi-2023.06-swl-deb11

@trz42
Copy link
Owner Author

trz42 commented Feb 21, 2024

Try to build for different repo ids for which different buckets and upload directories are configured.

bucket_name = {
    "nessi-2022.11-swl-deb10": "dev-pr254-3",
    "nessi-2023.06-swl-deb10": "dev-pr254-2",
    "nessi-2023.06-swl-deb11": "dev-pr254"}
metadata_prefix = {
    "nessi-2022.11-swl-deb10": "new11-10/'${github_repository}'/'${pull_request_number}'",
    "nessi-2023.06-swl-deb10": "new06-10/'${github_repository}'/'${pull_request_number}'",
    "nessi-2023.06-swl-deb11": "new06-11/'${github_repository}'/'${pull_request_number}'"}
tarball_prefix = {
    "nessi-2022.11-swl-deb10": "tb22.11/'${github_repository}'/'${pull_request_number}'",
    "nessi-2023.06-swl-deb10": "tb23.06-deb10/'${github_repository}'/'${pull_request_number}'",
    "nessi-2023.06-swl-deb11": "tb23.06-deb11/'${github_repository}'/'${pull_request_number}'"}

bot: build repo:swl arch:zen2
bot: build repo:swl arch:generic

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 21, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 21, 2024

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2022.11-swl-deb10 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134732

date job status comment
Feb 21 12:36:28 PM UTC 2024 submitted job id 134732 awaits release by job manager
Feb 21 12:43:34 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 21 12:56:15 PM UTC 2024 running job 134732 is running
Feb 21 01:05:32 PM UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-134732.out
❌ found message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2022.11-software-linux-x86_64-amd-zen2-1708520675.tar.gzsize: 34 MiB (35951456 bytes)
entries: 61050
modules under 2022.11/software/linux/x86_64/amd/zen2/modules/all
EasyBuild/4.7.2.lua
EasyBuild/4.9.0.lua
software under 2022.11/software/linux/x86_64/amd/zen2/software
EasyBuild/4.7.2
EasyBuild/4.9.0
other under 2022.11/software/linux/x86_64/amd/zen2
2022.11/scripts/gpu_support/nvidia/install_cuda_host_injections.sh
2022.11/scripts/gpu_support/nvidia/link_nvidia_host_libraries.sh
2022.11/scripts/utils.sh
Feb 21 01:05:32 PM UTC 2024 test result (no tests yet)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 21, 2024

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb10 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134733

  • from log
'Upload tarball to S3 bucket' by running '/home/thomarob/bot-devel/test_sync_feb24/eessi-bot-software-layer/scripts/eessi-upload-to-staging --bucket-name dev-pr254-2 --endpoint-url https://minio.nessi.no:60900 --metadata-prefix new06-10/'${github_repository}'/'${pull_request_number}' --repository trz42/software-layer --pull-request-number 72 --pr-comment-id 1956558269 --tarball-prefix tb23.06-deb10/'${github_repository}'/'${pull_request_number}' /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134733/eessi-2023.06-software-linux-x86_64-amd-zen2-1708520094.tar.gz' in directory '/home/thomarob/bot-devel/test_sync_feb24/eessi-bot-software-layer'
date job status comment
Feb 21 12:36:30 PM UTC 2024 submitted job id 134733 awaits release by job manager
Feb 21 12:43:31 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 21 12:49:52 PM UTC 2024 running job 134733 is running
Feb 21 12:55:11 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-134733.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1708520094.tar.gzsize: 1 MiB (1339261 bytes)
entries: 25
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
CaDiCaL/1.3.0-GCC-10.3.0.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
CaDiCaL/1.3.0-GCC-10.3.0
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Feb 21 12:55:11 PM UTC 2024 test result (no tests yet)
Feb 21 01:20:00 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1708520094.tar.gz to S3 bucket succeeded

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 21, 2024

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134734

date job status comment
Feb 21 12:36:32 PM UTC 2024 submitted job id 134734 awaits release by job manager
Feb 21 12:43:28 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 21 12:44:22 PM UTC 2024 running job 134734 is running
Feb 21 12:48:45 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-134734.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1708519699.tar.gzsize: 1 MiB (1341748 bytes)
entries: 25
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
CaDiCaL/1.3.0-GCC-10.3.0.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
CaDiCaL/1.3.0-GCC-10.3.0
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Feb 21 12:48:45 PM UTC 2024 test result (no tests yet)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 21, 2024

New job on instance dev-PR254 for architecture aarch64-generic for repository nessi-2022.11-swl-deb10 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134735

date job status comment
Feb 21 12:36:40 PM UTC 2024 submitted job id 134735 awaits release by job manager
Feb 21 12:43:25 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 21 12:44:19 PM UTC 2024 running job 134735 is running
Feb 21 12:56:17 PM UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-134735.out
❌ found message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2022.11-software-linux-aarch64-generic-1708520100.tar.gzsize: 34 MiB (36021639 bytes)
entries: 61050
modules under 2022.11/software/linux/aarch64/generic/modules/all
EasyBuild/4.7.2.lua
EasyBuild/4.9.0.lua
software under 2022.11/software/linux/aarch64/generic/software
EasyBuild/4.7.2
EasyBuild/4.9.0
other under 2022.11/software/linux/aarch64/generic
2022.11/scripts/gpu_support/nvidia/install_cuda_host_injections.sh
2022.11/scripts/gpu_support/nvidia/link_nvidia_host_libraries.sh
2022.11/scripts/utils.sh
Feb 21 12:56:17 PM UTC 2024 test result (no tests yet)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 21, 2024

New job on instance dev-PR254 for architecture aarch64-generic for repository nessi-2023.06-swl-deb10 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134736

date job status comment
Feb 21 12:36:41 PM UTC 2024 submitted job id 134736 awaits release by job manager
Feb 21 12:43:22 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 21 12:44:16 PM UTC 2024 running job 134736 is running
Feb 21 12:46:34 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-134736.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1708519563.tar.gzsize: 1 MiB (1251449 bytes)
entries: 25
modules under 2023.06/software/linux/aarch64/generic/modules/all
CaDiCaL/1.3.0-GCC-10.3.0.lua
software under 2023.06/software/linux/aarch64/generic/software
CaDiCaL/1.3.0-GCC-10.3.0
other under 2023.06/software/linux/aarch64/generic
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Feb 21 12:46:34 PM UTC 2024 test result (no tests yet)

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 21, 2024

New job on instance dev-PR254 for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134737

  • Upload of tarball actually failed
  • From log (when upload was init)
'Upload tarball to S3 bucket' by running '/home/thomarob/bot-devel/test_sync_feb24/eessi-bot-software-layer/scripts/eessi-upload-to-staging --bucket-name dev-pr254 --endpoint-url https://minio.nessi.no:60900 --metadata-prefix new06-11/'${github_repository}'/'${pull_request_number}' --repository trz42/software-layer --pull-request-number 72 --pr-comment-id 1956558618 --tarball-prefix tb23.06-deb11/'${github_repository}'/'${pull_request_number}' /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_72/134737/eessi-2023.06-software-linux-aarch64-generic-1708519794.tar.gz'
date job status comment
Feb 21 12:36:43 PM UTC 2024 submitted job id 134737 awaits release by job manager
Feb 21 12:43:19 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 21 12:44:13 PM UTC 2024 running job 134737 is running
Feb 21 12:50:57 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-134737.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1708519794.tar.gzsize: 1 MiB (1253906 bytes)
entries: 25
modules under 2023.06/software/linux/aarch64/generic/modules/all
CaDiCaL/1.3.0-GCC-10.3.0.lua
software under 2023.06/software/linux/aarch64/generic/software
CaDiCaL/1.3.0-GCC-10.3.0
other under 2023.06/software/linux/aarch64/generic
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Feb 21 12:50:57 PM UTC 2024 test result (no tests yet)
Feb 21 01:23:19 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1708519794.tar.gz to S3 bucket succeeded

@trz42 trz42 added the bot:deploy Instruct bot to deploy built artefacts to Stratum 0 label Feb 21, 2024
@poksumdo
Copy link
Collaborator

Try if sending a comment by a non-authorised account let the bot respond.

@trz42
Copy link
Owner Author

trz42 commented Feb 26, 2024

Try if sending a comment by an authorised account let the bot respond.

@trz42
Copy link
Owner Author

trz42 commented Feb 26, 2024

Try again with a command from an authorised account:

bot: status

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 26, 2024

Updates by the bot instance dev-PR254 (click for details)
  • received bot command status from trz42

    • expanded format: status
  • handling command status resulted in:

@eessi-bot-devel-trz42
Copy link

This is the status of all the bot: build commands:

arch result date status url
x86_64-amd-zen2 😢 FAILURE Feb 21 01:05:32 PM UTC 2024 finished #72 (comment)
x86_64-amd-zen2 😁 SUCCESS Feb 21 12:55:11 PM UTC 2024 finished #72 (comment)
x86_64-amd-zen2 😁 SUCCESS Feb 21 12:48:45 PM UTC 2024 finished #72 (comment)
aarch64-generic 😢 FAILURE Feb 21 12:56:17 PM UTC 2024 finished #72 (comment)
aarch64-generic 😁 SUCCESS Feb 21 12:46:34 PM UTC 2024 finished #72 (comment)
aarch64-generic 😁 SUCCESS Feb 21 12:50:57 PM UTC 2024 finished #72 (comment)

@poksumdo
Copy link
Collaborator

Try again with a command from a non-authorised account:

bot: status

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance dev-PR254 (click for details)
  • account poksumdo has NO permission to send commands to the bot

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

2 similar comments
@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Mar 13, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build for:- architectures: x86_64/amd/zen2, aarch64/generic, aarch64/thunderx2- repositories: linux/x86_64/amd/zen2, linux/aarch64/generic, linux/aarch64/thunderx2

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Mar 13, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build for:- architectures: x86_64/amd/zen2, aarch64/generic, aarch64/thunderx2- repositories: linux/x86_64/amd/zen2, linux/aarch64/generic, linux/aarch64/thunderx2

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Mar 13, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build for:

  • architectures: x86_64/amd/zen2, aarch64/generic, aarch64/thunderx2
  • repositories: linux/x86_64/amd/zen2, linux/aarch64/generic, linux/aarch64/thunderx2

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Mar 13, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build for:

  • architectures: x86_64/amd/zen2, aarch64/generic, aarch64/thunderx2
  • repositories: ['nessi-2022.11-swl-deb10', 'nessi-2023.06-cl', 'nessi-2023.06-swl-deb10', 'nessi-2023.06-swl-deb11'], ['nessi-2022.11-swl-deb10', 'nessi-2023.06-cl', 'nessi-2023.06-swl-deb10', 'nessi-2023.06-swl-deb11'], ['nessi-2022.11-swl-deb10', 'nessi-2023.06-cl', 'nessi-2023.06-swl-deb10', 'nessi-2023.06-swl-deb11']

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

Updates by the bot instance dev-PR254 (click for details)
  • received bot command show_config from trz42
    • expanded format: show_config

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Mar 13, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build for:

  • architectures: x86_64/amd/zen2, aarch64/generic, aarch64/thunderx2
  • repositories: nessi-2022.11-swl-deb10, nessi-2023.06-cl, nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11, nessi-2022.11-swl-deb10, nessi-2023.06-cl, nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11, nessi-2022.11-swl-deb10, nessi-2023.06-cl, nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11

@trz42
Copy link
Owner Author

trz42 commented Mar 13, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Mar 13, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build for:

  • architectures: x86_64/amd/zen2, aarch64/generic, aarch64/thunderx2
  • repositories: nessi-2023.06-cl, nessi-2023.06-swl-deb11, nessi-2023.06-swl-deb10, nessi-2022.11-swl-deb10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bot:deploy Instruct bot to deploy built artefacts to Stratum 0 development

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants