Status
Stakeholders

Emmanuel Momjian Brian Kent Drew Medlin 

Outcome
  • MCAF
    Rich M was informed of the MCAF bug and it has been fixed the week of 2022-10-03.

    CASA
    Steve and George M discussed and would like to change the way gencal caltype='rq' behaves. CASA ticket has been created:
    https://open-jira.nrao.edu/browse/CAS-13941

    22A-126
    We decided to qaFail all EBs. The PI has been informed of the issue through a helpdesk ticket:
    https://help.nrao.edu/agent/go/ticket/35000

    We would like to note the issue in the archive for future users. Comment added here:
    https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

    Emmanuel provided the scripted pipeline hack and Brian K provided the integrated hack. We gave the scripted hack but not the integrated hack to the 22A-126 PI, because they are mostly using it to compliment manual data reduction and did not press the issue. Official policy may need more discussion. (Personal note from Edward: if I have an easy solution and it could help a user, it feels weird to sit on the info and not share it with them.)

    20A-160
    This project has at least one EB with a completely empty SysPower.bin. We gave the integrated hack to Michael Rugel since he is a Jansky Fellow, and had already processed MANY large data sets with the integrated pipeline.

    Scripted Pipeline Hack

    In EVLA_pipe_priorcals.py:

    if startdate >= 55616.6:
    default(gencal)
    vis=ms_active
    caltable='requantizergains.g'
    caltype='rq'
    spw=''
    antenna=''
    pol=''
    parameter=[]
    # gencal()

    if os.path.exists('requantizergains.g'):
    priorcals=['gain_curves.g','opacities.g','requantizergains.g']
    else:
    priorcals=['gain_curves.g','opacities.g']

    Integrated Pipeline Hack

    In the file:
    ./pipeline/pipeline/hifv/tasks/priorcals/priorcals.py

    Change the line:

    rq_result = self._do_rqcal()
    to
    rq_result = None

    In the file:
    ./pipeline/pipeline/hifv/templates/priorcals.mako

    Add a conditional "if" statement around the rq table loop:

    %if single_result.rq_result:

        %for single_result in result:
         <p><b>${os.path.basename(single_result.rq_result.inputs['caltable'])}
         </b></p>
        %endfor

    %endif

    [WARNING - indentation matters and may not be correct in this format]
Due dateWhen does this decision need to be made by?
Owner
Edward Starr 

Background

For Project 22A-126, all 35 EBs had a resource setup that triggered a bug in MCAF software, causing an incomplete SysPower.bin. This caused a highly flagged requantizer gain table, which the pipeline applies by default, resulting in very high total flagging by the end of calibration, often up to 97%. The data is 8-bit and does not require the rq table, so manual calibration is possible (or a modified pipeline).

Action items