VLASS 2023 Priorities
VLA 2023 Priorities
Blocker:
Per-band manipulation of apply, antexclude, and usemedian for hifv_syspower ( PIPE-1487 - Getting issue details... STATUS )
- Detect mosaicked fields and perform joint deconvolution with mosaic gridder (PIPE-684)
Critical:
Different bandpass calibrators in different bands - ( PIPE-669 - Getting issue details... STATUS )
- flux calibrator RFI flagging should use residuals - ( PIPE-1274 - Getting issue details... STATUS )
- Only flag offending polarization for DTS issues PIPE-1467 - Getting issue details... STATUS
include additional flag versions in exported *.ms.flagversions.tgz ( PIPE-1553 - Getting issue details... STATUS )
hifv_restoredata should use flagversion backed up before statwt ( PIPE-1555 - Getting issue details... STATUS )
Checkflag should properly execute when sources have mixed intents PIPE-1335 - Getting issue details... STATUS
Minor:
- plot labels in semifinalbpdcals (PIPE-984)
- parallactic angle vs time plot (PIPE-836)
- Add API plot to VLA pipeline runs (PIPE-580)
VLASS 2022 Priorities
- Cube Imaging pipeline PIPEREQ-142
Resolved calibrator handling PIPEREQ-132Deferred- Imaging fails in some cases in 2021.2 ( PIPE-1173 - Getting issue details... STATUS )
Change VLASS parameter compressionusemedian default from False to True ( PIPE-1338 - Getting issue details... STATUS )
- Change hifv_targetflag to flag target data using a .flagtargetstemplate.txt - (
PIPE-37, PIPE-1355 - Getting issue details... STATUS ) - Add reimaging_resources.tgz to manifest.xml ( PIPE-1407 - Getting issue details... STATUS )
VLA 2022 Priorities
Prioritized list:
Blocker:
- Add plots to statwt weblog in PI pipeline( PIPE-1341 - Getting issue details... STATUS )
- Flagging Heuristics on outlier weights (ticket to be created)
- Generalized Compression correction for S-band and L-band ( PIPE-1155 - Getting issue details... STATUS / PIPEREQ-61 - Getting issue details... STATUS )
- TEC maps fixes and behavior changes ( PIPE-1136 - Getting issue details... STATUS , PIPE-1365 - Getting issue details... STATUS )
Critical:
- Backup flags in hifv_applycal prior to calibration ( PIPE-854 - Getting issue details... STATUS )
- Enable self-calibration heuristics for continuum data only in new task (hif_selfcal) and operate on only the _cont.ms ( PIPE-1445 - Getting issue details... STATUS )
- Spectral line stuff:
- Task to create VLA _line.ms ( PIPE-1414 - Getting issue details... STATUS )
Ability to use _line.ms and cont.ms in different pipeline tasks. ( PIPE-1411 - Getting issue details... STATUS )
- Detection Spectral windows for spectral line processing ( PIPE-1412 - Getting issue details... STATUS )
Spectral line calibration recipe definition ( PIPE-1344 - Getting issue details... STATUS )
- Zoom-in plots on non-128 MHz windows for inspection of bandpass in finalcals, semifinalBPdcals,testBPdcals, plotsummary for targets and cals ( PIPE-1413 - Getting issue details... STATUS ) Less critical than other items, but still desired.
- Enable basic cube imaging ( PIPE-1346 - Getting issue details... STATUS )
- combine targetflag heuristics into checkflag - ( PIPE-1342 - Getting issue details... STATUS )
- Change hifv_targetflag to flag target data using a .flagtargetstemplate.txt - (
PIPE-37, PIPE-1355 - Getting issue details... STATUS ) - flux calibrator RFI flagging should use residuals - ( PIPE-1274 - Getting issue details... STATUS )
- Different bandpass calibrators in different bands - ( PIPE-669 - Getting issue details... STATUS )
Major:
- Spectral Line syspower ( PIPE-1496 - Getting issue details... STATUS )
- Detect mosaicked fields and perform joint deconvolution with mosaic gridder (PIPE-684)
- wproject and n- w-planes heuristics for VLA imaging pipeline (J. Marvil input)
- PIPE-1287 - fluxboot failing with target intent using pointing and a CG intent with the pointing setup ( PIPE-1287 - Getting issue details... STATUS )
- PIPE-1350 - fluxboot shared intents ( PIPE-1350 - Getting issue details... STATUS )
- PIPE-1335 - selection heuristics when delay calibrator mixed with CG intent
- Long solution interval calculation improvement (PIPE-1002/PIPEREQ-64)
- Short Solution interval calculation improvments (PIPE-1340)
- Spws not specified in cont.dat should be handled as standard continuum (PIPE-1043)
- Use MS tool hanning smoothing to enable per spw hanning smoothing (CASR-523; PIPE-672)
- per-baseline RFI flagging - (PIPE-1286)
- Fluxboot QA metric adjustments (PIPEREQ-8/PIPE-989)
Minor:
- long solints: ( PIPE-1473 - Getting issue details... STATUS )
- solint calc: ( PIPE-1002 - Getting issue details... STATUS )
- Zoom feature for all hif_makeimages plots (PIPE-1083)
- plot labels in semifinalbpdcals (PIPE-984)
- parallactic angle vs time plot (PIPE-836)
- Add API plot to VLA pipeline runs (PIPE-580)
- Report total MS sizes at end of calibration on main weblog page (PIPE-1166)
- multi-band weblog plots should not use shared time axis for plots (PIPE-1044)
- Zeros flagged not reported properly (PIPE-1033)
- Make an untarred MS when making a basic MS PIPE-749
- PIPE-1098 - cont.dat failures for targets with some characters
Backburner:
Per-baseband delay solutions (PIPE-670)
Spectral window mapping for gain calibration (PIPE-671)
Antenna position corrections in a post-observation time window (CASR-556)
Gain table flagging extensions
Ripple detection (bad switch problem) (PIPEREQ-11)
Gain outlier detection (PIPEREQ-10)
Enhanced DTS issue identification and flagging (CASR-563/PIPE-986)
- Option to disable bad deformatter flagging completely or partially, (PIPE-1183)
- Generalize hifv_circfeedpolcal for all bands
Enable experimental P-band calibration
- Define requirements for the continuum imaging pipeline to use outlier fields to remove effects of bright sources rather than using large images
- RFI flagging on uv-grid (CASR-496)
- avoids flagging of bright spectral lines
- Enable data weights to be determined from switched power (CASR-476)
- Seasonal model selection to override weather station in priorcals to compensate for bad weather station data (PIPE-1367)
- Add Operator log to weblog (PIPE-1365)
VLA 2022 Categorized:
Bugs
- PIPE-1287 - fluxboot failing with target intent using pointing and a CG intent with the pointing setup ( PIPE-1287 - Getting issue details... STATUS )
- PIPE-1335 - selection heuristics when delay calibrator mixed with CG intent
- PIPE-1098 - cont.dat failures for targets with some characters
Calibration and Flagging
Enhanced DTS issue identification and flagging (CASR-563/PIPE-986)
- Option to disable bad deformatter flagging completely or partially, (PIPE-1183)
Possible RFI flagging refinements
- per baseline flagging - (PIPE-1286)
- combine targetflag heuristics into checkflag - (PIPE-1342)
- flux calibrator RFI flagging should use residuals - (PIPE-1274)
- Backup flags in hifv_applycal prior to calibration (PIPE-854)
- Change hifv_targetflag to flag target data using a .flagtargetstemplate.txt - (
PIPE-37, PIPE-1355 - Getting issue details... STATUS ) - Add plots to statwt weblog in PI pipeline (PIPE-1341)
- Long solution interval calculation improvement ( PIPE-1002 - Getting issue details... STATUS / PIPEREQ-64 - Getting issue details... STATUS )
- Short Solution interval calculation improvments (PIPE-1340)
Per-baseband delay solutions (PIPE-670)
Spectral window mapping for gain calibration (PIPE-671)
enables phase calibration if not enough S/N due to faint calibrator
Antenna position corrections in a post-observation time window (CASR-556)
Gain table flagging extensions
Ripple detection (bad switch problem) (PIPEREQ-11)
Gain outlier detection (PIPEREQ-10)
Fluxboot gain solution flagging (PIPEREQ-9)
Fluxboot QA metric adjustments (PIPEREQ-8)
Self-calibration
- Enable self-calibration heuristics for continuum data only in new task (hif_selfcal) and operate on only the _cont.ms (PIPE-)
- Joint ALMA and VLA development and should work on both types of data
- SRDP heuristics team input
Spectral lines
Ability to use _line and cont.ms in different pipeline tasks.
Spectral line calibration recipe definition (PIPE-1344)
- Save pre-target RFI flagging and split non-RFI flagged data after hifv_statwt using a new task (PIPE-1343)
- For VLA data, enable steps to run findcont to only run on line spws
- hif_makeimlist(specmode='mfs')
- hif_findcont()
- hif_uvcontfit()
- hif_uvcontsub()
Spectral window mapping for gain calibration (PIPE-671)
enables phase calibration if not enough S/N on narrow spws
- Use MS tool hanning smoothing to enable per spw hanning smoothing (CASR-523; PIPE-672)
- Zoom-in plots on non-128 MHz windows for inspection of bandpass in finalcals, semifinalBPdcals,testBPdcals
- Cont.dat interpretation to treat non-specified spws as continuum-only (PIPE-1043)
Weblog
- Zoom feature for all hif_makeimages plots (PIPE-1083)
- plot labels in semifinalbpdcals (PIPE-984)
- parallactic angle vs time plot (PIPE-836)
- Add API plot to VLA pipeline runs (PIPE-580)
Minor things
- Report total MS sizes at end of calibration on main weblog page (PIPE-1166)
- multi-band weblog plots should not use shared time axis for plots (PIPE-1044)
- Zeros flagged not reported properly (PIPE-1033)
- Make an untarred MS when making a basic MS PIPE-749
Imaging
Detect mosaicked fields and perform joint deconvolution with mosaic gridder (PIPE-684)
Enable basic cube imaging (PIPE-1346)
- wproject and n- w-planes heuristics for VLA imaging pipeline (J. Marvil input)
Backburner (CASA development or low priority):
- Generalize hifv_circfeedpolcal for all bands
Enable experimental P-band calibration
- Define requirements for the continuum imaging pipeline to use outlier fields to remove effects of bright sources rather than using large images
- RFI flagging on uv-grid (CASR-496)
- avoids flagging of bright spectral lines
- Enable data weights to be determined from switched power (CASR-476)
2021 Priorities
Primary Development Priorities
Calibration and Flagging
Enhanced DTS issue identification and flagging (CASR-563)
Improved calibrator RFI flagging heuristics (PIPEREQ-12; PIPE-939)
Gaintable flagging heuristics to ID bad data
Per-baseband delay solutions (PIPE-670)
Spectral window mapping for gain calibration (PIPE-671)
enables phase calibration if not enough S/N due to faint calibrator
Antenna position corrections in a post-observation time window (CASR-556)
Gain table flagging extensions
Ripple detection (bad switch problem) (PIPEREQ-11)
Gain outlier detection (PIPEREQ-10)
Fluxboot gain solution flagging (PIPEREQ-9)
Fluxboot QA metric adjustments (PIPEREQ-8)
Target RFI Flagging (CASR-540)
Enable data weights to be determined from switched power (CASR-476)
Use MS tool hanning smoothing to enable per spw hanning smoothing (CASR-523; PIPE-672)
Spectral window mapping for gain calibration (PIPE-671)
enables phase calibration if not enough S/N on narrow spws
RFI flagging on uv-grid (CASR-496)
avoids flagging of bright spectral lines
Cont.dat interpretation to treat non-specified spws as continuum-only
Design and set up independent spectral line calibration recipe that could be used by end users or triggered using recalibration workflow
Imaging
Detect mosaicked fields and perform joint deconvolution with mosaic gridder
Enable basic cube imaging
- Enable automasking for VLA continuum imaging pipeline
Stretch Priorities
- Generalize hifv_circfeedpolcal for all bands
Enable experimental P-band calibration
Enable pipeline to use two MS files to perform continuum on one and spectral line optimized calibration on the other when spectral lines are a science goal set in PST
Define requirements for the continuum imaging pipeline to use outlier fields to remove effects of bright sources rather than using large images