...
If I create a file like 'outputfile' instead of 'newdir' and transfer that, everything works fine.
Chirp in upload_file
While I seem to be able to use chirp in the download_file() function of a plugin, I cannot seem to use it in the upload_file() porttion. Something like the following will produce a line in the condor log file but not when executed from the upload_file() function.
message = 'in upload_file()'
subprocess.call(['/usr/libexec/condor/condor_chirp', 'ulog', message])
Shadow jobs and Lustre
We had some jobs get restarted because they lost contact with their shadow jobs. I assume this is because the shadow jobs keep the condor.log file open and if that file is on Lustre and Lustre goes down then the shadow job fails to communicate with the job and the job gets killed. Does that seem accurate to you?
...