...
Step | NRAO (steps-all-parallel9) | NRAO/CHTC (steps-all-parallel17) | NRAO/AWS (steps-all-parallel16) |
---|---|---|---|
01 | 9.4 | 27.7 (ran at CHTC) (wrong cfcache) | 12.3 |
05 | 60.2 | 125.1 | 65.9 |
06 | 24 | 24.4 | |
07 | 11.8 | 21.4 | |
15 | 55.2 | 58.9 | |
16 | 6.1 | 7.6 | |
23 | 230.8 | ||
24 | 46 | ||
Total | 443.5 |
Small data set test.ms with full parameters and not copying cfcache to local disk at CHTC using the 16k (wrong) cfcache
...
CPUs at CHTC are noticibly slower than CPUs at NRAO. For example, their set of c20xx machines (e20{03..18}) each have two Intel Xeon Silver 4114 2.20GHz processors and 0.5TB to 1TB of memory, while their large memory machines (mem3, mem2001, mem2002) each have four Intel Xeon E7-4820 v4 2.00GHz processors and 2TB to 4TB of memory. While this can cause jobs to run slower, the biggest factor was probably using cfcache on their shared filesystem.
...