Page History

Date and Time

11 Aug 202022 Jun 202116:00 EDT / 14:00 MDT

Video: https://zoom.us/j/5646363780?pwd=VGxrUGFrTTUrUmZHRGQ1L3poMTN6dz09 

...

External processing page: VLASS SE External Processing

Pipeline version of PI script: https://gitlab.nrao.edu/nrao-pl-devs/vlass-imaging-project

HTCondor area: High Throughput Computing with HTCondor

Image Comparison Tool: Image Comparison

VIP Script timing info: https://docs.google.com/spreadsheets/d/1yGpNNexL9YdEST3-_zyqtNqK2UxSNvmzKFOeRyanOHQ/edit#gid=0

All tickets pertaining to VLASS SE operations should have the VLASS-SE-OPS label.  Add VLASS-SE-DISCUSS label if it should be brought up in this meeting

News

Open Issues

• Data staging for SE imaging may not be as simple as a 'restore from acrhive' step.  VLASS team has investigated and defined the process.  Tracked as SCG-107 below

Decisions

• Continuum products needed for Cube imaging will be stored in archive as ancillary products
• No meeting on 8/18, next meeting on 8/25

Agenda

• Pipeline
  • <nothing>
• SSA
  

  • Is the proposed directory structure (/lustre/aoc/cluster/pipeline/vlass_auto/cache/pims/EB/CAL/DEC/RA) acceptable to everyone

  • What people want to see as directory components for EBs, calibrations, RA and dec for the phase center. Less essential since it will be mostly managed by the tool

  • what syntax do people want to use on the CLI to input this information. 

• SCG
  • Have initial list of 7 data sets 

Action items

• SE Imaging Workflow: Is the component list generation step in the workflow or does it only run the pipeline
• How are SE calibration products handled in the VLASS Manager (I'll explain) 
  
  • Decision on whether to produce a Mosaic implementation (we will produce one)
  • Pipeline available for testing (available for AWP implementation, Mosaic in progress)
  • SSA PIMS workflow validated (validated)
  • SSA SE Imaging workflow ready for testing   (In progress ?)
  • Pipeline validated  (6/10)
  • Pipeline released   (6/10)
  • SSA SE Imaging workflow validated
  • Begin operations (shooting for June 1st 25th)
  • Migrate above to htcondor (Mid/late August)
  • Accept and archive implemented

Decisions

Agenda

• Pipeline
• SSA 
  • PIMS testing in progress
  • SE Imaging workflow testing state 
  • HTCondor design
• SCG
  
  • Verification of pipeline vs VIP script in mosaic and AWP (AWP is consistent).  Stalled for now
  • Investigation of  GPU gridder vs CASA underway

Action items

Ticket Discussions