Date and Time
16:00 EDT / 14:00 MDT
Video: https://zoom.us/j/5646363780?pwd=VGxrUGFrTTUrUmZHRGQ1L3poMTN6dz09
...
External processing page: VLASS SE External Processing
Pipeline version of PI script: https://gitlab.nrao.edu/nrao-pl-devs/vlass-imaging-project
HTCondor area: High Throughput Computing with HTCondor
Image Comparison Tool: Image Comparison
VIP Script timing info: https://docs.google.com/spreadsheets/d/1yGpNNexL9YdEST3-_zyqtNqK2UxSNvmzKFOeRyanOHQ/edit#gid=0
All tickets pertaining to VLASS SE operations should have the VLASS-SE-OPS label. Add VLASS-SE-DISCUSS label if it should be brought up in this meeting
News
Open Issues
- Need to discuss loop control for splitting MSes into relevant sq dg. E.g. a single cluster job that walks through the N phase centers or N jobs submitted per phase center.
- Note the pipeline currently works on single sq dg.
- There is a need to split out per sq dg or all sq dg, is it necessary to support splitting by tile. Is a 'tile' an sufficient object within the VLASS manager that can be used to define that split ?
- How to handle Continuum products that may be of use for Cube imaging
Decisions
- Plan is to manage loop control as N unique jobs, one per phase center
- For now SSA plans to support single or multiple phase centers, per tile and per MS splits. Implementation may initially only support single phase center and entire MS but ultimately all 4 will be supported
- No conclusion on products, ultimately they will probably be ingested as regular products but Jeff wants to investigate more before making a decision.
- No meeting next week, next meeting is August 4th in the lead up to the SSA planning meeting.
Agenda (Primarily focused on roadmap)
- Coordination/Logistics
- <nothing>
- Schedule (broad strokes, need to flesh out details)
- <nothing>
- SSA
- Discuss requirements capture and workflow
- Need list of existing tickets tied to SE imaging (I can go in and add labels)
- HTCondor effort, when to start, how to coordinate, how to set up test environment (want to start in June, need to discuss what it should look like)
- How to track SE-continuum products and their possible inclusion in SE-cube imaging (relevant in the short term, inputs to Cube need to be known so they can drive continuum products (IDs, name formats etc)
- SCG
- Working on drawing, settle on Google Draw, simplest.
- Pipeline
- <nothing>
Action items
- James to restructure page and add a Open Issues section. Loop control for spliting MSes first on list
- SE Imaging Workflow: Is the component list generation step in the workflow or does it only run the pipeline
- How are SE calibration products handled in the VLASS Manager (I'll explain)
Decision on whether to produce a Mosaic implementation (we will produce one)Pipeline available for testing (available for AWP implementation, Mosaic in progress)- SSA PIMS workflow validated (validated)
- SSA SE Imaging workflow ready for testing (In progress ?)
Pipeline validated (6/10)Pipeline released (6/10)- SSA SE Imaging workflow validated
- Begin operations (shooting for June
1st25th) - Migrate above to htcondor (Mid/late August)
- Accept and archive implemented
Decisions
Agenda
- Pipeline
- SSA
- PIMS testing in progress
- SE Imaging workflow testing state
- HTCondor design
- SCG
- Verification of pipeline vs VIP script in mosaic and AWP (AWP is consistent). Stalled for now
- Investigation of GPU gridder vs CASA underway
Action items
Ticket Discussions
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|