The objectives of this review are to ensure that:
- The L1 capabilities projected for delivery to Pilot Operations are ready for verification and validation.
- That the software system to be tested is under configuration control and is available in the software test environment.
- That any items not yet ready for test are identified with a plan to advance them to a state of completion and test prior to delivery to Pilot Operations.
- That a suite of tests sufficient for verification and validation have been defined.
Review Plan
- This is an internal SRDP Project Office review, the Review Plan is completely described within this Confluence page
- The Review is scheduled for May 3, 2019
Participants
- Project Office: Jeff, John, Mark, Bob
- DMS: Mark Whitehead, Stephan, Kana, Morgan, Andy, David, James
Artifacts Under Review
| Date | Item or Event and Deadline for Availability | Responsible |
|---|---|---|
| 5/3/2019 | RVTM (Requirements Verification Traceability Matrix) | SRDP PM |
Test Environment Ready (including configuration list) to support the L1 Verification and Validation | DMS | |
| L2 Verification/Validation Complete | DMS/SRDP Heur. | |
L1 Verification Plan and Test Procedures Complete for the following:
| DMS | |
L1 Validation Plan for Heuristics and Operations Test procedures in Jira | SRDP Heur. / SRDP Ops. | |
| 5/8/2019 | Outstanding Issues and incurred Risk Defined | SRDP PM |
| Report on Outcome of Review - Delta TRR scheduled for May 17, 2019 | SRDP PD |
Pilot TRR Agenda
- SRDP Project Director: Opening Remarks
DMS: Test Environment Ready (including configuration list)
- SRDP PM: Present Verification and Validation RVTMs; review process to track V&V against the requirements
- DMS: Present L2 verification and validation completion report, based on Jira ticket status
- DMS: Present L1 Verification Plan and Test Procedures, defined within the set of Jira Test Tickets
- SRDP Project Scientist: Present L1 Validation Plan and Test procedures defined within the set of Jira Test Tickets
- SRDP Operations Mgr.: Present Operations Process Test Plan defined within the set of Jira Test Tickets: SRDP-336; SRDP-337; SRDP-338, SRDP-340
- SRDP Project Director: Preliminary assessment of Test Readiness, itemize any key blockers or major risk to resolve before proceeding
Outcome of Pilot Ops TRR
Report prepared by SRDP Project Director to include:
Outcome of review to be one of the following:
Initial outcome May 3, was a Fail. Significant issues were identified in both the test configuration control, and feature completion. Delta TRR scheduled for May 17 to review progress and assess.
Pilot (Delta) TRR Agenda - May 17, 2019
- SRDP Project Director: Opening Remarks
- SRDP PM: Review Open Actions from TRR
- SRDP-364 - Configuration profiles for Test and Production environments
- SRDP-363 - Scripts for workspace manager
SRDP PM: Review issues since TRR:
Issue Number Description References Impact Reported by Date Owner/Assigned in Jira 1 Outstanding requirement to allow selection of pre-release CASA versions within the Archive menu pull down described in SSA-5592 is not in the L1 Doc or model, should this be aded? SSA-5592 Revision to Requirements and all downstream artifacts (model, V&V Test, etc), added work to DMS Jeff Kern 5/13/2019 Richard Falardeau 2 Spectral cutouts within a spectral window (ALMA Cube Imaging) can only be exported to a single file, unsure if additional exports are overwriting a previously generated file. ALMA exports a single file since cutouts are not supported. PIPE-345 Significant inconvenience, workarounds are in discussion Joe Masters / John Tobin 5/13/2019 Kana 3 The export of calibration products from the VLA pipeline run is addressed in PIPE-47 is not working as expected Potential blocker to Pilot Ops John Tobin 5/13/2019 Kana 4 SRDP-251 (ALMA Metadata) missing EBs although the DB was reported as copied from production SRDP-251 (ALMA), SRDP-253 (VLA) & SSA-5583 Blocker to Pilot Ops due to partial validation John Tobin 5/13/2019 John Tobin 5 Permissions within archive to download to local directories SRDP-209, SRDP-218, SSA-5268 Significant inconvenience, no progress since Dec 2018 John Tobin 5/13/2019 John Tobin - Any Other issues?
- Pass: All inputs are satisfactory, no additional risks found, proceed as scheduled.
- Risk Identified: One or more risks were identified requiring additional attention. Risk is not deemed sufficient to affect the schedule. Risk management plan shall be updated.
- Partial Pass: One or more risks are likely to impact schedule of the release. Re-planning to address risk required.
- Fail: Sufficient risk identified to halt the release. Re-planning or rescoping required.
- Outcome less than an unconditional "Pass" shall include recommended steps and dates to rectify all discrepancies
SRDP Project Director: Closing Statement / next steps