...
- explicity list every file/directory in transfer_input_files (it doens't grok regexps). This would be a large list . E.g.
- transfer_input_files = "working/VIP_iter0.gridwt, working/VIP_iter0.pb.tt0, working/VIP_iter0.psf.tt0, working/VIP_iter0.psf.tt1, working/VIP_iter0.psf.tt2, working/VIP_iter0.sumwt.tt0, working/VIP_iter0.sumwt.tt1, working/VIP_iter0.sumwt.tt2, working/VIP_iter0.weight.tt0, working/VIP_iter0.weight.tt1, working/VIP_iter0.weight.tt2"
- Can transfer_input_fies take a manifest? E.g a file containing the list of files to transfer
- Make a temporary director on the submit host, and transfer that (possibly tarring it up)
- Set the inputs as a variable in the DAG file for each DAG step. The task.sh script deletes and then makes working-<dagstep>, copies the inputs into this directory, transfers it to the scratch area via transfer_input_files=working-<dagstep> then when finished transfers explicitly things out of working-<dagstep> we know changed by an outputs variable defined in the DAG file.
Task01
Doesn't alter the MS
...