It appears to be possible to cancel the existing running/queued actions upon pushing a new commit. Is there a reason why we don't want to do that?
The main reason for doing that would be to reduce the number of jobs running concurrently, and consequently the probability of queueing (there are limits on how many jobs can run concurrently for CI)