Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date and Time

16:00 EDT / 14:00 MDT

Video: https://zoom.us/j/5646363780?pwd=VGxrUGFrTTUrUmZHRGQ1L3poMTN6dz09 

...

External processing page: VLASS SE External Processing

Pipeline version of PI script: https://gitlab.nrao.edu/nrao-pl-devs/vlass-imaging-project

HTCondor area: High Throughput Computing with HTCondor

Image Comparison Tool: Image Comparison

VIP Script timing info: https://docs.google.com/spreadsheets/d/1yGpNNexL9YdEST3-_zyqtNqK2UxSNvmzKFOeRyanOHQ/edit#gid=0

All tickets pertaining to VLASS SE operations should have the VLASS-SE-OPS label.  Add VLASS-SE-DISCUSS label if it should be brought up in this meeting


News

Open Issues

  • Need to discuss loop control for splitting MSes into relevant sq dg.  E.g. a single cluster job that walks through the N phase centers or N jobs submitted per phase center.
  • There is a need to split out per sq dg or all sq dg,  is it necessary to support splitting by tile.  Is a 'tile' an sufficient object within the VLASS manager that can be used to define that split ?

Agenda (Primarily focused on roadmap)

  • Coordination/Logistics
    • <nothing>
  • Schedule (broad strokes, need to flesh out details)
    • <nothing>
  • SSA
    • Discuss requirements capture and workflow
    • Need list of existing tickets tied to SE imaging (I can go in and add labels)
    • HTCondor effort, when to start, how to coordinate, how to set up test environment (want to start in June, need to discuss what it should look like)
    • How to track SE-continuum products and their possible inclusion in SE-cube imaging (relevant in the short term,  inputs to Cube need to be known so they can drive continuum products  (IDs, name formats etc)
  • SCG
  • Pipeline
    • <nothing>

Action items

  •   James to restructure page and add a Open Issues section.  Loop control for spliting MSes first on list
  • SE Imaging Workflow: Is the component list generation step in the workflow or does it only run the pipeline
  • How are SE calibration products handled in the VLASS Manager (I'll explain) 
    • Decision on whether to produce a Mosaic implementation (we will produce one)
    • Pipeline available for testing (available for AWP implementation, Mosaic in progress)
    • SSA PIMS workflow validated (validated)
    • SSA SE Imaging workflow ready for testing   (In progress ?)
    • Pipeline validated  (6/10)
    • Pipeline released   (6/10)
    • SSA SE Imaging workflow validated
    • Begin operations (shooting for June 1st 25th)
    • Migrate above to htcondor (Mid/late August)
    • Accept and archive implemented

Decisions

Agenda

  • Pipeline
  • SSA 
    • PIMS testing in progress
    • SE Imaging workflow testing state 
    • HTCondor design
  • SCG
    • Verification of pipeline vs VIP script in mosaic and AWP (AWP is consistent).  Stalled for now
    • Investigation of  GPU gridder vs CASA underway

Action items

Ticket Discussions

Jira
serverDMS JIRA
columnskey,summary,type,created,assignee,status
maximumIssues20
jqlQueryfilter=12546
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01