You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 17 Next »

Currently, the nmpost cluster is a mix of Torque/Moab nmpost{001..090} and HTCondor nmpost{091..120} devhost{001..002}.  Eventually we would like to replace Torque/Moab with Slurm as we think it can do most of what Torque/Moab does but is free and has regular versions released.  Torque/Moab seem to have stalled.

We upgraded to Torque-6/Moab-9 and thus started having to pay for Torque/Moab in 2018.  This was done because Torque-6 understood cgroups and NUMA nodes (although it doesn't handle NUMA nodes the way I would like it to) and Torque-6 was no longer compatible with the free scheduler Maui forcing us to purchase the Moab scheduler.  Since then we have leveraged a couple of things Moab can do that Maui never could like increasing the number of jobs the scheduler looks ahead to schedule.  This allows Moab to start reserving space for pending vlass jobs on vlasstest nodes but is not a critical requirement.  Largely, the win was with cgroups for resource separation and NUMA nodes to double the number of interactive nodes.  Both of which only required the new version of Torque which in turn required Moab which in turn we had to pay for.  See what they did there?  You can read more about it at https://staff.nrao.edu/wiki/bin/view/DMS/SCGTorque6Moab9Presentation

An option to replace Torque/Moab, instead of Slurm, is openpbs which seems to be the free version of PBS Pro maintained by Altair Engineering.  I haven't used openpbs yet but it may be a simpler transition than Slurm.



  • No labels