Transfer Plugin Upload
I am working on a transfer plugin that uses rsync and I ran into a situation that confounds me. I have a job that creates a directory newdir and a file newdir/date. If I set transfer_output_files = newdir and output_destination = nraorsync://$ENV(PWD) in the submit file, the resulting input file that is fed to my plugin looks like this
[ LocalFileName = "/lustre/aoc/admin/tmp/condor/testpost003/execute/dir_29453/_condor_stderr"; Url = "nraorsync:///lustre/aoc/sciops/krowe/plugin/_condor_stderr" ][ LocalFileName = "/lustre/aoc/admin/tmp/condor/testpost003/execute/dir_29453/_condor_stdout"; Url = "nraorsync:///lustre/aoc/sciops/krowe/plugin/_condor_stdout" ][ LocalFileName = "/lustre/aoc/admin/tmp/condor/testpost003/execute/dir_29453/newdir/date"; Url = "nraorsync:///lustre/aoc/sciops/krowe/plugin/newdir/date" ]
I am surprised to see that it sets LocalFileName and Url to the file inside newdir instead of newdir itself. Needless to say, this makes rsync unhappy as newdir doesn't exist on the destination yet. Is it possible that setting preserve_relative_paths = true will affect this?
Shadow jobs and Lustre
We had some jobs get restarted because they lost contact with their shadow jobs. I assume this is because the shadow jobs keep the condor.log file open and if that file is on Lustre and Lustre goes down then the shadow job fails to communicate with the job and the job gets killed. Does that seem accurate to you?
...