Checklist for SRDP calibrations of VLA data, based heavily on the VLASS one.
Also relevant: requirements for the AQUAReport SRDP-194 - Getting issue details... STATUS
Checklist (in order of pipeline stage), to be done after the initial pipeline run that is performed for all EBs:
- Overview of MS: check calibration of EB as executed is SRDP compliant (many of these problems may have been caught at the SB submission stage, but some observers may choose to ignore recommendations anyway). If any of the conditions below are violated the pipeline should be run only once and no SRDP QA should be set (jump to step 15):
- The EB uses only Ku-band or above for science.
- The project is A or B-ranked (check against list with link on this page - or just do all??)
- intents for bandpass, amplitude and gain calibration all present.
- the amplitude (flux) calibrator is appropriate for the frequency and configuration (i.e. a good model exists). See https://science.nrao.edu/facilities/vla/docs/manuals/oss/performance/fdscale
- all science spw are calibrated
- all science spw are in the frequency range deemed in scope for SRDP (>12GHz for the pilot).
- gain calibrations are at appropriate intervals for the frequency being observed i.e. <10-60min <12GHz, <2-20min >12GHz, depending on configuration (see https://science.nrao.edu/facilities/vla/docs/manuals/obsguide/calibration#CalibrationCycle for details), and bracket the science observations.
- appropriate setup scans were performed: see https://science.nrao.edu/facilities/vla/docs/manuals/obsguide/set-up
- antenna reference pointing calibrations were performed for high frequency (>15GHz) observations.
- hifv_flagdata - online flags. Notify scientist if >20% flagged - maybe should be 35%?
- hifv_priorcals - check for gain compression due to severe RFI - is hifv_syspower part of the regular pipeline yet? If not, probably need to flag.
- hifv_testBDdcals - check for Data Transmission System (DTS) problems.
- hifv_flagbaddef - check that any DTS issues have been flagged.
- hifv_semiFinalBPdcals - check for any remaining DTS issues.
- hifv_solint - check solints for calibrators are reasonable (< a few mins for the long interval, > 0.05s for the short interval) - if in doubt check with a scientist.
- hifv_fluxboot2:
- check the input tables look clean
- check that the model is reasonable and covers all spw.
- make a note of the phase calibrator flux densities.
- hifv_finalcals:
- check for delay outliers
- check for unusual bandpass shapes
- check for outlying bandpass phases
- phase (short) gain solution: check for large phase scatter
- final amp/time: check for outliers
- final amp/freq: check that outliers fall into known bad spw
- Final phase - check there are no phase jumps > 90deg
- hifv_applycals: check end of CASA log and note final % flagged. If over 50%? check with a scientist
- hifv_plotsummary:
- phase vs time plots: check all are centered on zero
- amp vs uvwave:
- check calibrators are point-like (constant flux)
- check there is no evidence of decorrelation (strong "waterfall")
- check RFI is fully flagged
- amp vs frequency:
- check for residual RFI on calibrators
- check for residual RFI on targets
- Update google spreadsheet with run details
- Rerun with additional flagging if needed.
- Once satisfied, write a short overall evaluation suitable for archiving and transmission to the PI (no cuss words!)
- need a template for this
- Trigger archive ingest with appropriate SRDP QA level set (Pass/Fail/Null not SRDP compliant])
- Send user an email via the helpdesk? with the summary from step (14) and instructions on how to obtain their calibrated data.