Please track notes from HTCondor week here, particularly new features we may want to investigate. It could be some time before we can look at them and I don't want to forget. If possible include:
The primary function of this is as a note to future versions of us so no need to go into great detail, just want to avoid head scratching questions about 'what was that thing, that was going to help with that other thing'.
Try to create and follow some form of structure using headers and bullets.
Do we want to attend the OSG School? https://opensciencegrid.org/virtual-school-2021/
ANSWER: K. Scott doesn't think it is very useful. Unless we plan on using OSG significanly, I suggest we skip it.
They plan to make just a "condor" command that works like git or aws. That sounds great.
Coming soon will be able to have just one file (DAG) that also does the submit.
May be useful for users if we switch to HTCondor more broadly. CHTC Youtube Channel: https://www.youtube.com/channel/UCd1UBXmZIgB4p85t2tu-gLw
The LIGO talk on their dashboard is akin to something I'd like to see us try at some point.
This is a script you download from https://get.htcondor.com/ as get_htcondor and then you can run that to install HTCondor.
The HTCondor.dag API looks like it might be interesting for setting up iterating over a large number of data sets where there are complex dags which differ by only a small amount.
Is CVMFS helpful to us at all? Maybe. If CASA was more modular and didn't try to load every python file on startup and we were doing lots of small, remote jobs.