Update KCIDB tests grouping

[JenySadadia]

• Update kcidb_test_results to fetch architecture and compiler information for tests
• Take architecture and compiler into account while grouping tests in evaluate_test_results

[MarceloRobert]

You need to change the jinja template as well. The new/fixed/unstable issues are destructured there and so you'll need to add another for layer in order for the status to be properly shown.

[MarceloRobert]

Also please rebase, we have fixed the integration test that was causing an error and we also had some changes in the checkout summary that could conflict with yours

[MarceloRobert]

It is working, but I think that the final result is not the best looking. It shows the config for every test, and seems to group tests by architecture even though the first parameter is the config.

IMO we could place the config_name above arch/compiler and add more spaces to group arch/compiler under configs, and then tests under arch/compiler

Current structure:

[MarceloRobert]

In the example above, it would mean:

Hardware: mt8395-genio-1200-evk
Config: defconfig+lab-setup+kselftest
- Architecture/compiler: arm64/gcc-12
  - boot
    last run: https://d.kernelci.org/test/maestro:68b7e1f7b9811ea53d01b575
    history:  > ✅  > ✅  > ❌  > ✅  >

Config: defconfig+preempt_rt
- Architecture/compiler: arm64/gcc-12
  - rt-tests.cyclicdeadline
    last run: https://d.kernelci.org/test/maestro:68b79c4eb9811ea53d016421
    history:  > ✅  > ⚠️  
            
  - rt-tests.cyclictest
    last run: https://d.kernelci.org/test/maestro:68b79c53b9811ea53d016440
    history:  > ✅  > ⚠️ 

[JenySadadia]

Hi, thanks for the testing. I fixed the summary template.
Tested OK locally. Thanks for helping me with the local setup @MarceloRobert :)

[JenySadadia]

Hello @padovan
Does this structure look OK or do you need any changes? #1453 (comment)

[padovan]

How about add one more level of indent

Hardware:
  > Config:
      -  Arch/compiler:

So it reads better.

[padovan]

How about add one more level of indent

Hardware:
  > Config:
      -  Arch/compiler:

So it reads better.

[JenySadadia]

Okay. Updated it.

Hardware: sun50i-h5-libretech-all-h3-cc
  > Config: defconfig+arm64-chromebook+kselftest
    - Architecture/compiler: arm64/gcc-12
      - kselftest.uevent
      last run: https://d.kernelci.org/test/maestro:68be1e3f3273d911562c70a2
      history:  > ✅  > ❌  > ✅  > ✅  > ✅  
            
      - kselftest.uevent.uevent_uevent_filtering
      last run: https://d.kernelci.org/test/maestro:68be330a3273d911562cd016
      history:  > ✅  > ❌  > ✅  > ✅  > ✅  
            
      - kselftest.uevent.uevent_uevent_filtering_global_uevent_filtering
      last run: https://d.kernelci.org/test/maestro:68be330a3273d911562cd017
      history:  > ✅  > ❌  > ✅  > ✅  > ✅  

[MarceloRobert]

Seems to be working and looking good! I won't merge it, you can wait for Padovan's check and merge it later or you can do so now, you have the permission

[JenySadadia]

Merging this one as all the comments have been addressed.