The objectives of this review are to ensure that:
- The L1 capabilities projected for delivery to Pilot Operations are ready for verification and validation.
- That the software system to be tested is under configuration control and is available in the software test environment.
- That any items not yet ready for test are identified with a plan to advance them to a state of completion and test prior to delivery to Pilot Operations.
- That a suite of tests sufficient for verification and validation have been defined.
Review Plan
- This is an internal SRDP Project Office review, the Review Plan is completely described within this Confluence page
- The Review is scheduled for May 3, 2019
Participants
- Project Office: Jeff, John, Mark, Bob
- DMS: Mark Whitehead, Stephan, Kana, Morgan, Andy, David, James
Artifacts Under Review
Date | Item or Event and Deadline for Availability | Responsible |
---|---|---|
5/3/2019 | RVTM (Requirements Verification Traceability Matrix) | SRDP PM |
Test Environment Ready (including configuration list) to support the L1 Verification and Validation | DMS | |
L2 Verification/Validation Complete | DMS/SRDP Heur. | |
L1 Verification Plan and Test Procedures Complete for the following:
| DMS | |
L1 Validation Plan for Heuristics and Operations Test procedures in Jira | SRDP Heur. / SRDP Ops. | |
5/8/2019 | Outstanding Issues and incurred Risk Defined | SRDP PM |
Report on Outcome of Review - Delta TRR scheduled for May 17, 2019 | SRDP PD |
Pilot TRR Agenda
- SRDP Project Director: Opening Remarks
DMS: Test Environment Ready (including configuration list)
- SRDP PM: Present Verification and Validation RVTMs; review process to track V&V against the requirements
- DMS: Present L2 verification and validation completion report, based on Jira ticket status
- DMS: Present L1 Verification Plan and Test Procedures, defined within the set of Jira Test Tickets
- SRDP Project Scientist: Present L1 Validation Plan and Test procedures defined within the set of Jira Test Tickets
- SRDP Operations Mgr.: Present Operations Process Test Plan defined within the set of Jira Test Tickets: SRDP-336; SRDP-337; SRDP-338, SRDP-340
- SRDP Project Director: Preliminary assessment of Test Readiness, itemize any key blockers or major risk to resolve before proceeding
Outcome of Pilot Ops TRR
Report prepared by SRDP Project Director to include:
Outcome of review to be one of the following:
Initial outcome May 3, was a Fail. Significant issues were identified in both the test configuration control, and feature completion. Delta TRR scheduled for May 17 to review progress and assess.
Pilot (Delta) TRR Agenda - May 17, 2019
- SRDP Project Director: Opening Remarks
- SRDP PM: Review Open Actions from TRR
- SRDP-364 - Configuration profiles for Test and Production environments
- SRDP-363 - Scripts for workspace manager (see
SSA-5599
-
Getting issue details...
STATUS
& discussion on Requirements for SSA work-around scripts for pilot)
SRDP PM: Review issues since TRR:
Issue Number Description References Impact Reported by Date Owner/Assigned in Jira 1 Outstanding requirement to allow selection of pre-release CASA versions within the Archive menu pull down described in SSA-5592 is not in the L1 Doc or model, should this be aded? SSA-5592 Revision to Requirements and all downstream artifacts (model, V&V Test, etc), added work to DMS Jeff Kern 5/13/2019 Richard Falardeau 2 Spectral cutouts within a spectral window (ALMA Cube Imaging) can only be exported to a single file, unsure if additional exports are overwriting a previously generated file. ALMA exports a single file since cutouts are not supported. PIPE-345 Significant inconvenience, workarounds are in discussion Joe Masters / John Tobin 5/13/2019 Kana 3 The export of calibration products from the VLA pipeline run is addressed in PIPE-47 is not working as expected Potential blocker to Pilot Ops John Tobin 5/13/2019 Kana 4 SRDP-251 (ALMA Metadata) missing EBs although the DB was reported as copied from production SRDP-251 (ALMA), SRDP-253 (VLA) & SSA-5583 Blocker to Pilot Ops due to partial validation John Tobin 5/13/2019 John Tobin 5 Permissions within archive to download to local directories SRDP-209, SRDP-218, SSA-5268 Significant inconvenience, no progress since Dec 2018 John Tobin 5/13/2019 John Tobin - Any Other issues?
- Pass: All inputs are satisfactory, no additional risks found, proceed as scheduled.
- Risk Identified: One or more risks were identified requiring additional attention. Risk is not deemed sufficient to affect the schedule. Risk management plan shall be updated.
- Partial Pass: One or more risks are likely to impact schedule of the release. Re-planning to address risk required.
- Fail: Sufficient risk identified to halt the release. Re-planning or rescoping required.
- Outcome less than an unconditional "Pass" shall include recommended steps and dates to rectify all discrepancies
SRDP Project Director: Closing Statement / next steps
Mid-Pilot TRR Agenda - July 9, 2019
Participants
SRDP Project Office: John Tobin, Mark lacy, Bob Treacy
DMS: Morgan Griffith, Mark Whitehead, Stephan Witz, Kana Sugimoto, Joe Masters
- SRDP PM: Review Open Actions required to deliver Pilot Operations Capability to Validation
- PIPE-389 - Template recipe: creation of 'mfs' and 'cont' images
- Ready to validate
- Ready to validate
- SSA-5113 - Epic ticket: Implement ALMA optimized imaging cube capability
- Review Issues under Epic for Blockers and completion target dates
- Review Issues under Epic for Blockers and completion target dates
- SSA-5330 Epic Ticket: Science Products, Ancillary Products and Associations
- Review Issues under Epic for completion target dates
- Still tagged for SRDP Pilot, No known blockers for Optimized Imaging
- (ML) Status of SSA-5599 Epic ticket - workaround scripts for Optimized Imaging workflow corresponding to requirements on Requirements for SSA work-around scripts for pilot, including SSA-5604, SSA-5632, SSA-5605.
- Identify Configuration changes (i.e. versions reflecting changes from these tickets) CASA 5.4.2-7; Archive TBD
- Any Other issues?
- Account permissions etc for DAs and AoD (ML) to run jobs as almapipe.
- Review and Assign Action Items
- PIPE-389 - Template recipe: creation of 'mfs' and 'cont' images
Issue Number | Description | References | Impact | Reported by | Date | Owner/Assigned in Jira |
---|---|---|---|---|---|---|
M1 | Apply PL changes to template | PIPE-389 | No CLI E2E testing until we do this, works with bespoke PPRs | John Tobin | 7/9 | SW/Jim Sheckard |
M2 | SSA-5175 - CLI | SSA-5175 PIPE-89 SSA-5645 | CLI functional, but changes needed to make it useful for user; need about half a day to do, once product system working | John Tobin | 7/9 | Stephan Witz |
M3 | Adding continuum image (switch) | SSA-5532 | Generating continuum by default, on/off switch not a blocker | John | 7/9 | Stephan Witz |
GUI Interface for Archive | Stephan will provide ticket number SSA-5392 SSA-5173 | Not implemented on test | John | 7/9 | SW/Givens | |
Need time (day or two) to integrate, then will have status | SSA-5330 | Stephan | Stephan Witz | |||
SSA-5599, VLA implemented, ALMA in progress, | SSA-5330 dependence Mark will provide info | Mark L. | Stephan Witz | |||
Run jobs as almapipe in CV, as they run as vlapipe in | SW will create a ticket | Mark L. | Stephan Witz |