...
HTCondor area: High Throughput Computing with HTCondor
Attendees: James,
Agenda (Primarily a getting organized meeting)
- Purpose of group meeting
- Coordinate all DMS effort to support VLASS SE imaging internally and externally
- Coordination/Logistics
- Track everything here or just major targets and let groups track their own deliverables and JIRA tickets (I'd prefer the latter)
- Use of tags to make clearing house pages easy (ie select for all tickets in SSA/SCG/CASA/CASA-pipeline/ARDG with tag 'XXXX'
- Schedule (broad strokes, need to flesh out details)
- Demonstrate 100 sq degrees via HTCondor external to pipeline by October 1st.
- VIP script implemented as pipeline by ? (would like October)
- SSA natively uses HTCondor for SE job submissions by ? (would like September or October)
- Pipeline
- Is the plan to make a separate task or leverage existing task
- how to manage pybdsf and other external python apps
- SSA
- Split pipeline between data selection and mstransform and imaging (should this be done in the pipeline recipe, ie hifv_splitms() or some such)
- HTCondor effort, when to start, how to coordinate, how to set up test environment
- How to incorporate into workflow manager
- SCG
- Return to effort to create an external imaging approach with decomposition along the major/minor cycle and SPWs. Imaging with HTCondor
- Assist other groups, set up test environments
- Coordinate with CHTC NRAO-CHTC HTCondor collaboration
...