...
Mid-Pilot TRR Agenda - July 9, 2019
Previous date for Mid-Pilot Go/No-Go Decision: July 19, 2019
Revised date for Mid-Pilot Go/No-Go Decision: July 26, 2019
Participants
SRDP Project Office: John Tobin, Mark lacy, Bob Treacy
...
- SRDP PM: Review Open Actions required to deliver Pilot Operations Capability to Validation
- PIPE-322 - Implement fluxboot2 fit order heuristics
- This appears to have converged, John to confirm
- Status: Ready to validateSSA has advised on approach, needs target for implementation
- SSA-5113 - Epic ticket: Implement ALMA optimized imaging cube capability
- Review Issues under Epic for Blockers and completion target dates
- Status: Actions captured to table below
- SSA-5330 Epic Ticket: Science Products, Ancillary Products and Associations
- Review Issues under Epic for completion target datesStill tagged for SRDP Pilot, No known blockers for Optimized Imaging
- Status: Actions captured to table below
- (ML) Status of SSA-5599 Epic ticket - workaround scripts for Optimized Imaging workflow corresponding to requirements on Requirements for SSA work-around scripts for pilot, including SSA-5604, SSA-5632, SSA-5605.
- Identify Configuration changes (i.e. versions reflecting changes from these tickets): CASA 5.4.2-7; Archive TBD
- Any Other issues?
- Account permissions etc for DAs and AoD (ML) to run jobs as almapipe. (Status: Captured as M7 in the table below)
- Account permissions etc for DAs and AoD (ML) to run jobs as almapipe. (Status: Captured as M7 in the table below)
- Review and Assign Action Items (Status: Actions captured to table below)
- Outcome:
Not ready for full testing yet, though some tests can be conducted.
Pipeline is ready, with a follow up SSA item to incorporate pipeline changes in the template (item M1).
SSA is in an all-hands effort to finish the integration work for the product system (SSA-5330), with an estimate of 1-2 days before this is complete. At that point (July 11) attention can be turned to wrapping up other action items listed below.
Changes, particularly to the Request Handler, will require extensive retesting of items previously tested for Pilot. John is confident that he knows what needs to be tested.
Action items in the table below are needed to close the Mid-Pilot TRR and will be reviewed again on July 16.
- PIPE-322 - Implement fluxboot2 fit order heuristics
| Issue Number | Description | References | Impact | Reported by | Date | Owner/Assigned in Jira | Status | Due Date |
|---|---|---|---|---|---|---|---|---|
| M1 | Apply PL changes to template | PIPE-389 | No CLI E2E testing until we do this, works with bespoke PPRs | John Tobin | 7/9 | SW/Jim Sheckard | 7/30 - Under validation. PIPE-389 is done, but John has held off on fully calling it validated until he can throw things through the workflow using its features. Ready to to integration testing, need CLI back up - | |
| M2 | CLI functional, but changes needed to make it useful for users; need about half a day to do, once product system working | John Tobin | 7/9 | Stephan Witz | 7/11 - memory management issues? 8/6 - SSA-5645 (Critical) looks like the only unresolved ticket in this epic, Ready to Verify + Jim to test today, verify that CLI is working | 8/13 - Jim 8/13 - should be viable after release | ||
| M3 | Adding continuum image (switch) | Generating continuum by default, on/off switch not a blocker | John Tobin | 7/9 | Stephan Witz | 8/6 - Closed  Enabled by default, deferred the GUI switch | Done | |
| M4 | GUI Interface for Archive | Stephan will provide ticket number | Not implemented on test yet, will be addressed after product system integration | John Tobin | 7/9 | Stephan Witz/ French | 8/6 - SSA-5392 (design/prototype) Resolved SSA-5173 - Ready to Validate, LSRK question Will get to test when "Rest Frequency" in GUI, won't wait for LSRK + John to send "must haves" for the GUI | 8/12 - Deployment Blockers to be addressed in conjunction with testing 8/12 - already deployed |
| M5 | Need time (day or two) to integrate, then will have status | SSA-5330 | Integration/delivery of the product system items is an all-hands effort on the part of the SSA team which blocks work on the other tickets. | Stephan | 7/9 | Stephan Witz | 8/6 - 20 tix. 2 completed/resolved, 0 validation, 7 verifying/ready, 10 scheduled, 1 open Integration of new DF into product system, end of day + Stephan will let Morgan know if it makes it by the EOD Operational workflows still being revived all user initiated workflows operational. | 8/12 - Deployment 8/13 Deployment to Test |
| M6 | SSA-5599, VLA implemented, ALMA in progress, 1) Script to notify Operations manager and DAs when imaging pipeline job is completed and ready for review: status - already exists 2) Script to rerun the imaging pipeline after edits to the PPR and/or extra flagging and/or changes to continuum subtraction: status - not yet done, but could be adapted from existing VLA recaldirs script. 3) Script to ingest image products into the archive and clean up the pipeline directory: status - not yet done (needs product system) | Scripts needed for ALMA, will address when product system items completed. | Mark Lacy | 7/9 | Stephan Witz | 7/29 - Are there critical tasks in this epic, or do they all need to be done? 8/6 - 14 tix, 3 closed/resolved, 4 ready for validation, 2 ready/under verification, 4 scheduled Cube has ancillary prod, need to ingest cube with these products, have to hook this together and ingest a cube, check that DF works, notification - 8/8 re-run - 8/8 ingest - later Stephan/Jim | 8/8 - Stephan/Jim 8/12 - status the same: done/on the way/future 8/16 - Deployed, ready to test | |
| M7 | Run jobs as almapipe in CV, as they run as vlapipe, need to check/configure ACLs | SSA-5689 | Operational efficiency, jobs should run the same way in both environments | Mark Lacy | 7/9 | Stephan Witz | 8/6 - still an issue? (ticket last updated 7/11) ACL's for directory, let analysts into almapipe account | Done |
Mid-Pilot Delta TRR Agenda - August 6, 2019
9:30 MT/ 11:30 ET SOC-280, ER-331
VideoHubIP: 192.33.117.12##6519
AudioHub: 434-817-6286
0) a) Review outcome of last TRR - Morgan, b) General status - Stephan
Products working, PL issue that we're working on, ingestion in progress (Rick & Jim), Rudumentary IF for triggering cube generation, working on feature requests (LSRK)
1) Review List from last TRR (above)
2) Scripts & script tickets - need to separate mid-Pilot script tickets from others: (SSA-5599 - see above, SSA-5621) - this epic has no tickets)
3) Any new things?
What needs to be re-ingested - VLASS (for ancillary data), old, 6 wks+ ALMA cals run a one-off script, a couple of days
4) Next steps
Sched a Friday tag up (Stephan, John, Jeff, 10 MT/12 ET)
Reset key dates on Friday (Jeff)
Test can go to 3.7
5.4.2-8 released as of yesterday, Stephan make sure symlink is modified to pick it up (can't ready Cycle 7 ASDMs, OK for test
Key Dates (Tentative)
Aug 6 Mid-Pilot Delta TRR (this meeting)
Aug 20 Ends validation window
Aug 22 Operations Readiness Review
Aug 27 Operations Go/NoGo
Participants
SRDP Project Office: John Tobin, Mark Lacy, Bob Treacy
DMS: Morgan Griffith, Mark Whitehead, Stephan Witz, Kana Sugimoto, Joe Masters
Review Open Issues from July 9
Mid-Pilot Delta TRR Agenda - August 15, 2019
Outcome: TRR is closed
Most critical items have been addressed so that partial testing can move forward. AAT/PPI version 3.7 has been deployed to the test environment using CASA 5.4.2-8, some cleanup continues with scripts as a pacing item for Ops validation