Automated benchmarks
Use PkgBenchmark.jl to setup automated benchmarks to detect performance regressions (e.g for PRs). With our own CI, we can ensure to always run these benchmarks on the same compute node.
Manual triggering of the benchmarks is probably good enough. (Alternatively, we could trigger the pipline on a per PR basis, i.e. excluding individual commits.)