Maat gives untrustworthy measurements for timings

[Arcticae]

Problem

Depending on the machines that we're given, and load on the machines VMs we can have results that vary. We need to somehow mitigate by either:

• Running actions couple of times (costly)
• Providing reproducible results by running the jobs on the same machine always (need to be discussed with devops team)

The problem is also that we want to compare different results ran on many different machines which is not ideal.

Steps

No response

Possible Solution(s)

No response

Notes

No response