Page History

Quarterly summaries of the progress and status of the SRDP Project. Intended for internal consumption and distributed to the NRAO coord list.

Table of Contents

maxLevel	2

Expand

title	March 4, 2019

March 4, 2019

Scope for Wave 1 was realigned to accommodate RealFast [VLA commensal transient project], which displaced some previously scheduled work within DMS. The scope change for RealFast, along with other schedule delays have restructured the SRDP Pilot a bit, with a potential delayed rollout of the workspace infrastructure to the Wave 1 release.
The first of the Wave 1 capabilities is nearing completion. The NRAO Archive will soon allow authorized users to download calibrated Measurement Sets for ALMA Cycle 5 and Cycle 6 data (this capability already exists for VLA). The calibrated MSs are automatically restored from the ALMA pipeline generated calibrations upon demand. Scientific validation is proceeding with detailed comparison of restored products to what is provided by NAASC via LAVA process.
The delivery of a next generation Proposal Submission Tool (ngPST) is a key enabler of true SRDP operations. The SRDP project has agreed to include the creation of this tool as part of the SRDP project deliverables. Project management plan is under development, a change request (to the SRDP scope) will be submitted once scope of ngPST work has been understood.

Heuristics

VLASS RFI flagging heuristics are being evaluated for inclusion in the PI pipeline along with other VLASS functionality.
The pipeline tasks necessary to conduct ALMA imaging based on PI-specified parameters request through the NRAO Archive are undergoing final testing for validation.

Operations

A draft SRDP operations plan was distributed to the SRDP management team at the end of December, the document is in stages of final draft.
Three applicants for the Socorro Scientific Data Analyst position were shortlisted and interviewed by phone. Two have been invited for in-person visits the first week of March. (One has since withdrawn.)
An NRAO-internal review (internal to the Observatory, not the project) of the SRDP Operations Plan is being organized for late in the month of March; a charge has been set, a review plan is in draft, selection of a chair and committee is in progress

Implementation

Improved VLA flux calibration will be brought into the Standard PI Pipeline for CASA 5.6.
Pipeline work to support PI directed ALMA cube imaging is ongoing, Support for PI directed ALMA cube imaging in the AAT and integration with the pipeline work is moving into the work queue
A testing environment setup is in progress, and a detailed test plan has been developed, first set of test procedures are under development for OUS restores

Expand

title	June 4, 2019

The SRDP project is approaching Pilot Operations (June 18)

Download of calibrated data from the Archive (ALMA, VLA)
Improved quality assurance of VLA pipeline results, including correction and re-execution of the pipeline.
Mid-Pilot release (mid-July) brings PI driven ALMA cube generation.

User facing capabilities for Wave 1 (Dec 2019) are the same as Pilot, starting to look at Wave 2 (Dec 2020) targets.

Telescope Time Allocation Tools now an initiative within the SRDP project (see below)

Completed validation testing of pipeline and new archive for SRDP pilot. Validation testing now proceeding on CASA 5.6 for ALMA Cube Imaging and VLA pipeline with improved flux calibration.
Planning for Wave 2 capabilities proceeding, aiming to improve VLA pipeline spectral line handling and extend capabilities of ALMA cube imaging (e.g., resolution vs. surface brightness sensitivity tradeoffs) to enable users to further 'optimize' their images.
Studying common calibration issues with VLA data and those revealed in pilot to improve quality of pipeline calibration
Mark Whitehead has replaced Rafael Hiriart on the stakeholder requirements committee. We thank Rafael for his contributions and welcome Mark to the committee.

A new data analyst (Aaron RobothamLawson) has recently started in Socorro. A second offer has been made (to replace Alex Sobotka, who is leaving in the summer).
The SRDP Operations review was held on 28th March. 51 RIDs were filed by the review panel and addressed by the Operations Team. The result was a partial pass, the reviewers requested a second review of the operations plan after the pilot was complete, but agreed that the planning was sufficient to proceed with the pilot.
Operations testing began following a TRR on 3rd May.

Archive 3.6.0/3.6.1 was delivered to support OUS restores
Most of the pipeline work to support optimized imaging was completed, as was the CLI to support testing
Scripts were built to support pilot testing and early operations as a workaround to workflow implementation (scheduled later)
As this was the first integration period, interoperability issues were discovered and resolved
L1 test procedures were developed and are currently being executed in preparation for pilot operations

CIS has provisioned two NGAS servers for use as a primary NRAO archive store in Charlottesville (primary and backup). This store will be used as the backing store for ALMA products produced as part by the SRDP project.
RFQ in process for replacing the CV-Lustre solution with increased capacity and expanding the NAASC-Lustre system to meet the working storage needs for SRDP and other projects. Purchase Requisitions have been issued in NM for similar expansions needed by SRDP.
In addition, CIS participated in efforts to provide an architectural diagram for current NAASC IT operations, one that includes the new SRDP dedicated hardware (see issue SRDP-192 in open-jira).