Quarterly Status Summaries

March 4, 2019

Project

• Scope for Wave 1 was realigned to accommodate RealFast [VLA commensal transient project], which displaced some previously scheduled work within DMS.  The scope change for RealFast, along with other schedule delays have restructured the SRDP Pilot a bit, with a potential delayed rollout of the workspace infrastructure to the Wave 1 release.
• The first of the Wave 1 capabilities is nearing completion. The NRAO Archive will soon allow authorized users to download calibrated Measurement Sets for ALMA Cycle 5 and Cycle 6 data (this capability already exists for VLA).  The calibrated MSs are automatically restored from the ALMA pipeline generated calibrations upon demand.  Scientific validation is proceeding with detailed comparison of restored products to what is provided by NAASC via LAVA process.
• The delivery of a next generation Proposal Submission Tool (ngPST) is a key enabler of true SRDP operations.  The SRDP project has agreed to include the creation of this tool as part of the SRDP project deliverables.  Project management plan is under development, a change request (to the SRDP scope) will be submitted once scope of ngPST work has been understood.

Heuristics

• VLASS RFI flagging heuristics are being evaluated for inclusion in the PI pipeline along with other VLASS functionality.
• The pipeline tasks necessary to conduct ALMA imaging based on PI-specified parameters request through the NRAO Archive are undergoing final testing for validation.

Operations

• A draft SRDP operations plan was distributed to the SRDP management team at the end of December, the document is in stages of final draft.
• Three applicants for the Socorro Scientific Data Analyst position were shortlisted and interviewed by phone. Two have been invited for in-person visits the first week of March. (One has since withdrawn.)
• An NRAO-internal review (internal to the Observatory, not the project) of the SRDP Operations Plan is being organized for late in the month of March; a charge has been set, a review plan is in draft, selection of a chair and committee is in progress

Implementation

• Improved VLA flux calibration will be brought into the Standard PI Pipeline for CASA 5.6.
• Pipeline work to support PI directed ALMA cube imaging is ongoing, Support for PI directed ALMA cube imaging in the AAT and integration with the pipeline work is moving into the work queue
• A testing environment setup is in progress, and a detailed test plan has been developed, first set of test procedures are under development for OUS restores

June 4, 2019

Project

The SRDP project is approaching Pilot Operations (June 18)

• Download of calibrated data from the Archive (ALMA, VLA)
• Improved quality assurance of VLA pipeline results, including correction and re-execution of the pipeline.
• Mid-Pilot release (mid-July) brings PI driven ALMA cube generation.

User facing capabilities for Wave 1 (Dec 2019) are the same as Pilot, starting to look at Wave 2 (Dec 2020) targets. 

Telescope Time Allocation Tools now an initiative within the SRDP project (see below)

Heuristics

• Completed validation testing of pipeline and new archive for SRDP pilot. Validation testing now proceeding on CASA 5.6 for ALMA Cube Imaging and VLA pipeline with improved flux calibration.
• Planning for Wave 2 capabilities proceeding, aiming to improve VLA pipeline spectral line handling and extend capabilities of ALMA cube imaging (e.g., resolution vs. surface brightness sensitivity tradeoffs) to enable users to further 'optimize' their images.
• Studying common calibration issues with VLA data and those revealed in pilot to improve quality of pipeline calibration
• Mark Whitehead has replaced Rafael Hiriart on the stakeholder requirements committee.  We thank Rafael for his contributions and welcome Mark to the committee.

Operations

• A new data analyst (Aaron Lawson) has recently started in Socorro. A second offer has been made (to replace Alex Sobotka, who is leaving in the summer).
• The SRDP Operations review was held on 28th March. 51 RIDs were filed by the review panel and addressed by the Operations Team. The result was a partial pass, the reviewers requested a second review of the operations plan after the pilot was complete, but agreed that the planning was sufficient to proceed with the pilot.

• Operations testing began following a TRR on 3rd May.

Telescope Time Allocation Tools

• Change Request and Charter approved by key stakeholders
• TTA Tools Concept and Software Requirements Document through internal review
• Level 1 requirements capture and conceptual architecture design now underway.
• Next milestone: Conceptual Design Review (Q1 FY20)

Implementation

• Archive 3.6.0/3.6.1 was delivered to support OUS restores
• Most of the pipeline work to support optimized imaging was completed, as was the CLI to support testing
• Scripts were built to support pilot testing and early operations as a workaround to workflow implementation (scheduled later)
• As this was the first integration period, interoperability issues were discovered and resolved

• L1 test procedures were developed and are currently being executed in preparation for pilot operations

Information Services

• CIS has provisioned two NGAS servers for use as a primary NRAO archive store in Charlottesville (primary and backup).  This store will be used as the backing store for ALMA products produced as part by the SRDP project.
• RFQ in process for replacing the CV-Lustre solution with increased capacity and expanding the NAASC-Lustre system to meet the working storage needs for SRDP and other projects. Purchase Requisitions have been issued in NM for similar expansions needed by SRDP.
• In addition, CIS participated in efforts to provide an architectural diagram for current NAASC IT operations, one that includes the new SRDP dedicated hardware (see issue SRDP-192 in open-jira).

Sep 4, 2019

Project

As announced at the Coord Meeting SRDP is now a program (there are multiple projects that are under the SRDP umbrella).  For clarity we are going to change the name of the original SRDP Project to Science Ready Archive and Operations (SRAO), this is just a name change there is no change to the original scope of the project.

Science Ready Archive and Operation

• SDRP Operations started in mid-June. The delivery of the first calibrated VLA dataset meeting science ready standards was on June 24th.

• Since June 24th, 35 SRAO-calibrated datasets have been delivered (in Ku-band and higher).

• Calibration restoration workflows for users of both ALMA and the VLA have also been enabled in the AAT since mid-June.
• Archive 3.7.0 supporting the Mid-Pilot release is currently in validation.
• Delayed several weeks due to an underestimate of the effort needed to deliver the software.
• The ALMA PI Driven Imaging Graphical User Interface is operational and is being validated.
• The VLA PI pipeline is in final validation and on track to be released jointly with the ALMA Cycle 7 pipeline.
• The “Product System” within the archive, although invisible to the users, addresses significant technical debt and will facilitate delivering different products more quickly in the future.
• Future Development
• The Workspace Infrastructure is the current planning focus, with a target for delivery to the Wave 1 deployment (Nov. 2019).  This will retire scripted workflows, which were implemented within the archive as a temporary solution.
• A conceptual description of Wave 2 developments is in final review, this begins the second wave of development leading to a November 2020 deployment.

VLA Sky Survey

• VLASS Epoch 1 Observing and Quick Look imaging completed
• Validation of CASA 5.6 based Calibration and Single Epoch Imaging underway.
• Meeting with Center for High Throughput Computing (CHTC) organized by DMS to begin addressing the gap in computing resources for SE imaging.
• A new Data Analysist (Trent Seelig) has recently started in Socorro (backfill for Alex Sobotka departure).

Next generation Telescope Time Allocation Tools

• Effort is currently focusing on the requirements and beginning to develop the conceptual architecture.
• Oct. target for Conceptual Design Review is no longer valid, will re-plan once project velocity better established.

Dec 20, 2019

Science Ready Archive and Operation

• Quality assured SRAO VLA calibrations extended to include X-band
• 95 SRAO VLA calibrations delivered between Sept 1 and Nov 30th.
• Version 3.7 of the NRAO Archive has been released, importantly this provides the support for User Driven Imaging of ALMA data to the Archive.
• Planning and development for the next wave of functionality (Wave 2) is underway.  Headline capabilities are:
• Integration of the CARTA viewer with the NRAO Archive
• Workspace infrastructure in the archive to better manage capabilities and product creation.
• Support for catalogs of science sources support in the archive
• • Extension of current VLA calibration and ALMA imaging capabilities.

VLA Sky Survey

• Job ad has been posted for Data Analyst position (backfill for Angie Vargas January departure. Thanks Angie!)
• Publication describing the survey has been accepted by PASP.
• Reprocessing is underway for VLASS1.2 images that were affected by the correlator backend errors during observing
• SIS addition of “persistent” storage to relive pressure on lustre allowing increased processing.

Next generation Telescope Time Allocation Tools

• TTA Tools Concept is iterating between Project Scientist and System Architect, following architect’s review

March 23, 2020

Science Ready Archive and Operation

• 178 SRDP VLA calibrations delivered between Nov 30th and Feb 28^th
• ALMA User-driven imaging (AUDI) started in mid-December, 10 jobs completed successfully as part of our "soft" rollout.
• Updated Archive 3.7 with bug fixes (now on 3.7.4)
• Workspace CDR complete within DMS, now under implementation
• New heuristics for wave 2 are likely to be delayed, effort focused on VLASS Imaging Project.

VLA Sky Survey

• Open Data Analyst positions (2) currently in phone interviews:
• VLASS (backfill for Angie Vargas who left in January)
• SRDP / general DA position (replacement for Nick Ferraro, who will leave in July).
• Initiated VLASS Imaging Project to address VLASS SE continuum imaging issues.
• Preparing for initial data release:
• Reprocessing of VLASS 1.2 images for correlator back-end errors is complete, now reprocessing VLASS 1.1 images
• Reprocessing to correct for input parameter bug ongoing.
• Preparing for VLASS Observing 2.1 (May)
• Validation plan for VLASS 2.1 complete
• Validated VLASS with realfast setup does not drop BDFs.  No correlator errors found in the data.
• Draft of the QuickLook Quality Assurance memo currently in review by the VLASS team.
• Grant for RADIAL project support was submitted

Telescope Time Allocation Tools

• SRAO project planning and DMS documents in final draft for CoDR, April 15-16