Updated 302.28.23 for sprint 50 (→ v0.2)01.2024
Detailed TTA Tools Sprint Feedback Page
...
| Table of Contents | ||
|---|---|---|
|
Summary of Available Solicitations, Facilities, and Capabilities
...
| Section | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Helpful Files for Testing
| File | Updated | Intended Capability | Description |
|---|---|---|---|
| Sprint 38 | GBT Spectral Line | 50 Field Sources from the Megamaser use case; the use case specifics a rms line sensitivity of 6 mJy | |
| Sprint 38 | GBT Spectral Line | 1 Spectral Spec from Megamaser use case; Units are GHz, km/s, km/s (extra spectral spec but can delete) | |
| Sprint 38 | GBT Spectral Line | General GBT Spectral Line SS. There are 2 SS in this file: KFPA and Q band | |
| Sprint 38 | VLA Continuum | 2 Field Sources from the polarization/continuum use case (W4); use case specifies a rms sensitivity of 100 microJy/bm. RA DEC in hms/dms. | |
| Sprint 38 | VLA Continuum | 2 SS (C-, X-band); Units in GHz, GHz, GHz | |
Sprint 39 v0.1.2 | VLA Continuum GBT Spectral Line | General Test Files |
Easy Navigation to Jira Epics and Sprints
| Name | Jira | Description | ||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Sprint 48 |
| Prototype Consensus, Finish out ISRs and hook up BE/FE ISRs + Conflicts Feb 28 | ||||||||||||||||||||||||||||
| Sprint 49 |
| Due March 14: Finish hooking up ISRs (Completed/Finalized), | ||||||||||||||||||||||||||||
| Sprint 50 |
| Initiate Consensus, see (SRP) scores as Conflicted and Non Conflicted SRP member, notification on finalized ISRs and less than 3 non conflicted reviewers. | ||||||||||||||||||||||||||||
| Sprint 51 |
| Consensus Comments and consensus related Scores, ability to export a file for ISR comments and score Start of UI overhaul | ||||||||||||||||||||||||||||
| SRP ProcessSprint 52 |
| Epic | Start UI/DM/CA reconciliation Utility functions: upload/export ISRs, print proposals BE work on finalizing consensus and generating NRL | |||||||||||||||||||||||||||
| Sprint 53SRP Configuration |
| Epic | OSR | Refactoring 1/? | ||||||||||||||||||||||||||
| Sprint 54 |
| Epic | Refactoring 2/? | |||||||||||||||||||||||||||
| Sprint 55Proposal Submission |
| Epic | Feasibility Reviews | Refactoring 3/? | ||||||||||||||||||||||||||
| Sprint 56 |
| Epic | Refactoring 4/? | |||||||||||||||||||||||||||
| Sprint 57 | ||||||||||||||||||||||||||||||
| Sprint 58V0.2 Bugs |
| Epic | Solicitation Configuration | connecting FE/BE consensus. System fully connected | ||||||||||||||||||||||||||
| Sprint 59 |
| Epic | Proposal Bugs | bug hunting and final feature push | ||||||||||||||||||||||||||
| Sprint 60 |
| Epic | Label: NotificationRelated |
| bug hunting and final feature push | |||||||||||||||||||||||||
| Sprint 61 | Label | Label: ConsensusReview |
| Label | bug hunting; final official sprint of version 0.2 | |||||||||||||||||||||||||
| Sprint 62Label: Conflicts |
| Label | prototype v0.2.1 interface; RIDs for internal view | |||||||||||||||||||||||||||
| SRP ProcessLabel: Configurability |
| Label |
| Epic | ||||||||||||||||||||||||||
| SRP ConfigurationLabel: ISR |
| Label | ||||||||||||||||||||||||||||
| Label: TTAMember |
| Label | ||||||||||||||||||||||||||||
| Epic | |||||||||||||||||||||||||||||
| OSR | Label: SRPChair |
| Label |
Current Report
Landing Page
| Epic | |||
| Proposal Submission |
|
- Message of the Day on landing page
|
|
| Status | ||||||
|---|---|---|---|---|---|---|
|
but! it would be nice if there was more feedback when the save successful.
Notifications
Notification for a Submitted Proposal
Epic | ||||||||||||||
| Feasibility Reviews |
| Epic | ||||||||||||
| V0.2 Bugs |
|
|
- upon a successful submission, a notification is sent to a mailing list (tta-notifications-test)
- this should be true on every resubmission
- this should work for OSRs and PPRs
- notifications to PI/Co-Is are blocked until Identity management system is up
| Epic | ||||||||||||||
| Solicitation Configuration |
| Epic | ||||||||||||
| Proposal Bugs |
|
|
- when the Finalize button is used by a TTA member in the Review Configuration, a notification is sent to a mailing list (tta-notifications-test)
- Allie, yes; Dana, no emailed received
- one email is sent per panel per reviewer
- Seems to be only per panel
- notifications per panel to SRP members/ Chairs are blocked until Identity management system is up
- did not send an email to feasibility reveiwers (on hold)
| Epic | ||||||||||||
| Label: NotificationRelated |
| Label | ||||||||||
| Label: ConsensusReview |
| Label | ||||||||||
| Label: Conflicts |
|
|
|
- one email per reviewer per change is sent out to the mailing list (tta-notifications-test)
- notifications to tta member/ srp chair are blocked until Identity management system is up
- The ticket says that "Conflict Reason, and updated Conflict State" should be included in email but it is currently not
- right now, theres is a bulk update on conflict cerification on the front end, so there are emails for every proposal instead of just the ones that were changed.
| Label | ||||||||||||
| Label: Configurability |
| Label | ||||||||||
| Label: ISR |
| Label | ||||||||||
| Label: TTAMember |
| Label | ||||||||||
| Label: SRPChair |
|
| Label |
Current Report
Landing Page
...
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
|
| ||||||||||
| key | STT-914 | ||||||||||
| Status | |||||||||||
| subtle | true | ||||||||||
| colour | Yellow | ||||||||||
| color | green | ||||||||||
| title | to test | Notification when all ISRs are finalized for a panel | jira
| 1036Sprint 50 |
| Sprint 34 | Sprint 37 | Sprint 37 |
but! it would be nice if there was more feedback when the save successful. |
Notifications
Create a Simple Solicitation from JSON for
- VLA
- GBT
not implemented/requirements not in a story:
- modify parameters such as frequency ranges on bands
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Notification for a Submitted Proposal
|
| 1037
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
Solicitation Creation
| Sprint 47 | Sprint 68 V0.2 | Sprint 68 V0.2 |
| ||||||||||||||||||||||||||
Notification when Review Configuration is Finalized
|
|
|
|
| Sprint |
| 47 | Sprint |
68 |
V0.2 | Sprint 68 V0.2 |
|
|
|
|
Only available to TTA Member
| |||||||||||||
| Notification when TTA Member changes Conflict State of Reviewer |
|
| Sprint |
| 47 | Sprint |
68 V0.2 | Sprint |
68 V0.2 |
|
|
|
|
|
Review Configuration Tab is with Solicitation creation now
Create a simple solicitation with hardcoded Science Categories and Hardware. The Proposal Process can be specified. The number of proposals it creates with 1 of 3 Science categories can be specified. The names and information on the proposal is randomly generated.
| ||||||||||||||
| Notification when Consensus Review is finalized |
|
|
|
|
Navigation
As an Author, I would like to view my proposals.
- in a list
in a detailed view (Card)
- would like to filter on proposals by Science Category
Saving within a CR
Capability Requests have their own save button. A user is warned if they will lose their changes from navigating.
| ||||||||
| Notification when all ISRs are finalized for a panel |
|
|
| Sprint 50 | Sprint 68 V0.2 | Sprint 68 V0.2 |
|
|
| ||
Notification when there are less than N available reviews for a proposal.
|
|
|
|
|
|
Prompt warns that user is overwriting their OS.
Pops up even if no OS is currently generated or if one cannot be generated (validation needed?)
If OS cannot be generated, tab is available but empty.
|
|
|
| Sprint 50 | Sprint |
61 V0.2 | Sprint |
61 V0.2 |
|
Not Implemented
Can see panels once Review Configuration is Finalized
Can see Review Panel as SRP Member for panel which they are assigned to
Can see Review Panel as SRP Chair for panel which they are assigned to
TTA Member can see both SRP and Chair views
Submission
|
Solicitation Creation
...
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Create a Simple Solicitation from JSON for
not implemented/requirements not in a story:
|
| Sprint 16 | Sprint 16 | Sprint 30 |
| ||||||||||||||||||||||||||
| Configure Field Source, SS, PP, CP |
| ||||||||||||||||||||||||||||||
| Configure Advance Tab options |
| ||||||||||||||||||||||||||||||
| Update/Test a solicitation when a different one is Open and has submitted proposals |
| ||||||||||||||||||||||||||||||
| Solicitation Tab | Sprint 61 V0.2 | Sprint 61 V0.2 | Only available to TTA Member | ||||||||||||||||||||||||||||
| A Proposal Prefix can be specified per solicitation |
|
- Submit a Proposal
- Proposal ID and timestamp generated
- Light Validation on Submission
- Submission affects Proposal State
- Submitted for PPR
- In Review for OSR
| Jira | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
| Sprint 40 | Sprint 40 | Sprint 40 |
| ||||||||||||||
| Create a Test Solicitation+Test Proposals | Sprint 46 | Create a simple solicitation with hardcoded Science Categories and Hardware. The Proposal Process can be specified. The number of proposals it creates with 1 of 3 Science categories can be specified. The names and information on the proposal is randomly generated. | ||||||||||||||||
| Close Solicitation |
|
|
| Sprint |
| 45 | Sprint |
61 V0.2 | Sprint |
61 |
timestamp is in MST, not local? – sprint 43 seems to be local now
Observatory Copy and Author Copy
- As an Author:
- Author Copy is viewable and modifiable when in Draft State and Submitted if the Solicitation is Open
- Observatory Copy is generated when Proposal is Submitted
- Author and Observatory Copies are both viewable if
- the Solicitation is open
- the Proposal State is Submitted
- Can edit Author Copy after a submit if solicitation open
- Can resubmit if Solicitation is open
- Cannot edit Observatory Copy ever
- Cannot edit an Author Copy when proposal is In Review
- Can only see Observatory Copy after Close of Call
- A Proposal with a Proposal State of Submitted should not be able to be deleted.
- As TTA member:
- Can edit Author Copy when the Proposal has any State (only up to In Review possible to test though).
- Can Save and it persists. Should not affect Obs Copy if one exists.
- Can Submit it (when call is open?)
- Can edit the Observatory Copy, if one exists. Save persists and affects downstream.
- A Proposal with a Proposal State of Hidden can be submitted if the Solictation is Open or Closed.
- A Proposal with a Proposal State of Hidden cannot be Withdrawn
- A Proposal with a Proposal State of Withdrawn should not appear in the Review Phase.
- Can edit Author Copy when the Proposal has any State (only up to In Review possible to test though).
V0.2 | Force close a Solicitation, sending all proposals into In Review (if PPR). |
Navigation
...
| Description | JIRA/Behavior | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
As an Author, I would like to view my proposals.
| <Sprint 29 | Sprint 37 | Sprint 37 |
| |||||||||||||||||||||||||
Saving within a CR | Capability Requests have their own save button. A user is warned if they will lose their changes from navigating.
|
|
|
| |||||||||||||||||
| Saving and AR | A user is warned if they will lose their changes from navigating away.
|
|
|
- As an Author:
- Author Copy is viewable and modifiable when in Draft State and Submitted if the Solicitation is Open
- Observatory Copy is generated when Proposal is Submitted
- Author and Observatory Copies are both viewable if
- the Solicitation is Open
- the Proposal State is Submitted
- Can edit Author Copy after a submit if solicitation open
- Can resubmit if Solicitation is open and PPR
- Cannot edit Observatory Copy ever
- Cannot edit or view an Author Copy when proposal is In Review
- Can view only Observatory Copy when Proposal State is In Review
- A Proposal with a Proposal State of Submitted should not be able to be deleted.
- As TTA member:
- Can edit Author Copy when the Proposal has any State (only up to In Review possible to test though).
- Can Save and it persists. Should not affect Obs Copy if one exists.
- Can Submit it only when call is open.
- Can edit Author Copy when the Proposal has any State (only up to In Review possible to test though).
| Observation Specification Generation | Prompt warns that user is overwriting their OS. Pops up even if no OS is currently generated or if one cannot be generated (validation needed?) If OS cannot be generated, tab is available but empty.
| <Sprint 35 | Sprint 38 | Sprint 38 |
|
|
- Can edit the Observatory Copy, if one exists but save applies to Author Copy only. There is no way to submit, so changes do not affect downstream (review phase) information.
- Can withdraw a proposal in the Hidden State.
- Withdrawn proposal still shows up in Review phase.
- A Hidden proposal cannot be submitted, regardless of the Solicitation being open or not. It should be allowed to be submitted at anytime.
| ||||||||||||
| Navigate and Edit OS on fresh AR | Not Implemented
|
|
| ||||
| Review Tab | Sprint 43 | Sprint 61 V0.2 | Sprint 61 V0.2 |
|
|
- Saving changes to author copy shows a warning on the list of proposals and allows resubmission only after navigating away and then back again. The button is not always available when it should be.
- Submitting a proposal works but the view of the proposal is missing afterwards and until a refresh is done.
Proposal State Changes
Allowed:
- Draft → Submitted
- Draft → Hidden
- Submitted → Withdrawn
- Submitted → In Review
- In Review → Withdrawn
- In Review → Completed
- Hidden → Submitted (TTA only)
Not Allowed:
- (Submitted, In Review, Completed, Closed) → Hidden
- Hidden → Withdrawn
- submission either goes to submitted or in review (DDT); Proposal State change to Completed is out of scope for v0.2
- Withdrawing a proposal works: the author can see the Observatory Copy but not edit either it or the author copy. Cannot even access the author copy. Tooltip shows the action is not available.
- can delete a proposal which causes the state to change to hidden; however, author can see the Observatory Copy!
- Draft → Withdrawn is currently allowed but it should not be.
- Withdraw button is only available in the edit mode of a proposal for the TTA member; it should be higher.
PPRs
PPRs - Vet Proposals
Can see panels once Review Configuration is Finalized Can see Review Panel as SRP Member for panel which they are assigned to Can see Review Panel as SRP Chair for panel which they are assigned to TTA Member can see both SRP and Chair views |
Submission
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| Sprint 41 | Sprint 43 | Sprint 43 |
timestamp is in MST, not local? – sprint 43 seems to be local now | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
Observatory Copy and Author Copy
|
|
- There is an interface with which to vet Science Categories
- Can see the Title, Abstract, and Requested Science Category per proposal
- the Vetted SC = the Requested SC at first, but it can be changed.
- There is a place to record notes; they persist.
- The proposal can be opened for viewing
- There is a check box per proposal to indicate it has been vetted; there is a "vet all" button.
- There is a save button
|
|
| Sprint |
| 42 | Sprint 42 | Sprint |
| 42 |
|
|
- ability to filter on requested/vetted SC
- changing a SC and back again does not revert the icon
- front-end not hooked to back-end so viewing proposal doesn't work
- Drop down menu on available Science Categories should either be linked to Solicitations or the drop down menu on the available science categories on the vetting should be linked to the master list.
PPRs - Review Configuration
Panels
- Create SRP panels with unique names
- Delete SRP Panels
- Associate panels with 1 or more Science Categories (edge cases)
- Assign 1 or more SRP Chairs
- Assign multiple SRP Members to panel
- Auto bulk assign proposals to panels based on SC
- Manually assign proposals to panels
- Save
- Feasibility groups (back burner)
- Assign independent science review to a member of a different SRP
- Upload and use a configuration file
- Filtering on Panels/proposals
- Should not be able to assign the same person to multiple panels
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| |||||||||||||||||||||||||||||||||||||||||
Proposal State Changes Allowed:
Not Allowed:
| Sprint 42 | Sprint | Sprint 42 |
| |||||||||||||||||||||||||||||||||||||
Print a single or multiple proposals
|
|
|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
________________________
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
| Sprint 52 |
Back end supports printable view
Navigation to this functionality missing in UI
Print view is missing Observation Specifications (need to tackle larger DM issues maybe) Print view is missing Science Justification (might be a trade off with other issues) |
PPRs
PPRs - Vet Proposals
...
| Description | JIRA/Requirements | Implemented | Last Working | Tested | Status | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
| Sprint |
| 44 | Sprint 61 |
V0.2 | Sprint 61 V0.2 |
|
|
|
|
- Automatic proposal to panel assignment based on Science Category
- saving
- finalizing
- feasibility groups on placeholder
|
| |||||
| TTA Member can access vetting comments after Configuration in Finalized and forever more. |
PPRs - Review Configuration
...
- Auto Conflicts based on authorship
| Description | JIRA | Implemented | Last Working | Tested | Status | |||||
|---|---|---|---|---|---|---|---|---|---|---|
Panels
|
| |||||||||
| Jira | ||||||||||
| server | DMS JIRA | columnIds | issuekey,summary,
| 884
| 889Sprint 45 | Sprint 47 | ||||
| Status | ||||||||||
| subtle | True | |||||||||
| colour | Red | |||||||||
| color | green | |||||||||
| title | to fix |
| Configuration and Vetting is available prior to the close of a Solicitation
| 1168Configuration and Vetting is part of the Solicitation UI now |
PPRs - Conflict Declaration/ Role Assignments
|
|
|
|
SRP Reviewer
- Must complete Conflicts before progressing to ISRs
- Cannot change Auto Conflict
- Default Conflict state is Unknown
- Reviewer must change to either Conflict or Available
- Reviewer may enter comments; persists
- Can view Conflict State per ISR
- Can see Proposal ID, Abstract, and Title
- Bulk Action of Certification (cannot certify some and not others)
|
|
- Must complete Conflicts before progressing to ISRs
- Cannot change Auto Conflict
- Default Conflict state is Unknown
- Reviewer must change to either Conflict or Available
- Reviewer may enter comments; persists
- Can view Conflict State per ISR
- Can see Proposal ID, Abstract, and Title
- Bulk Action of Certification (cannot certify some and not others)
SRP Chair
- Only 1 Primary, 1 Secondary, * Tertiary, * None per Proposal
- Default is None
- Can change Review Types unless ISR is Finalized
________________________
|
|
|
| Sprint 43 |
| server | DMS JIRA |
|---|---|
| columnIds | issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution |
| columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
| serverId | eb2e750b-a83a-387e-8345-36eee8a98f01 |
| key | STT-871 |
Sprint 61 V0.2 | Sprint 61 V0.2 |
|
|
|
|
|
- should not be able to assign Review Types to a conflicted reviewer
TTA Member
- Available → Available
- Available → Conflict
- Conflict → Available
- Conflict → Conflict
- AutoConflict → Available
- ISRs either become available or unavailable as necessary for the SRP Member.
- ISRs that are now Conflict State of Conflict that had Review Types other than None should automatically have Review Types changed to None.
| |||||||||||||
Finalize Review Configuration
|
|
|
|
| Sprint 45 |
Sprint 61 V0.2 | Sprint 61 V0.2 |
|
- Can update Conflict state and Certify (preferrable that it is done after user certifies)
- ISRs are not affected downstream yet.
...
| |||||||||||||||||
| Configuration and Vetting is part of the Proposal Process Tab |
PPRs - Conflict Declaration
| Description | JIRA | Implemented | Last Working | Tested | Status |
|---|
- See list of proposals (after conflict certification)
- Review Type is displayed
- Default is None; otherwise P,S,T
- Review State is displayed
- default is Blank; otherwise Saved, Completed, Finalized, Closed
- Conflict State is displayed
- Conflict/Available
- If not Conflicted, have an ISR in which to enter comments and a score and see the proposal
- can Save (Review State → Saved) per ISR
- validate if score not equal to 0; otherwise it cannot save
- does not validate comments
- can Complete (Review State → Completed) per ISR
- can Finalize (bulk action) if any ISRs with Review not equal to None are not Closed or Finalized
- can Save (Review State → Saved) per ISR
- If Conflicted, only see title, abstract, proposal ID and cannot enter any information
|
| Sprint 45 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
SRP Reviewer
|
| Sprint 46 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
SRP Chair
|
| Sprint 46/47 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TTA Member
|
| Sprint 45/47 | Sprint 61 V0.2 | Sprint 61 V0.2 |
|
PPRs - Review Type Assignments
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SRP Chair
| Sprint 46/47 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| |||||||||||||||||||||||||
TTA Member
| Sprint 45/47 | Sprint 61 V0.2 | Sprint 61 V0.2 |
|
PPRs - ISRs
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SRP Reviewer
|
| Sprint 46, 47 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
External Reviewer
|
| Sprint 59 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Import/Export ISRs
| Sprint 57? | Sprint 61 V0.2 | Sprint 61 V0.2 |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TTA Member
|
| Sprint 61 V0.2 | Sprint 61 V0.2 |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Adding external reviewers as TTA member
| Sprint 59 | Sprint 61 V0.2 | Sprint 61 V0.2 |
PPRs - Consensus
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
SRP Member
|
| Sprint | Sprint 61 V0.2 | Sprint 61 V0.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
SRP Chair
|
| Sprint 61 V0.2 | Sprint 61 V0.2 |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
External ISRs
| Sprint 59 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TTA Member
|
| Sprint 59 | Sprint 61 V0.2 | Sprint 61 V0.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Uploading PPR Proposal Reviews (Removed) As SRP
|
OSR Reviews
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
|
| Sprint 43 | Sprint 61 V0.2 | Sprint 61 V0.2 |
|
Review Process Simulation Tools
| Description | JIRA | Slice 1 | Future improvements |
|---|---|---|---|
Solicitation
|
|
|
|
- SRP Reviewer
- See list of proposals (after conflict certification)
- Review Type is displayed
- Default is None; otherwise P,S,T
- Review State is displayed
- default is Blank; otherwise Saved, Completed, Finalized, Closed
- If not Conflicted, have an ISR in which to enter comments and a score and see the proposal
- can Save (Review State → Saved) per ISR
- validate if score not equal to 0; otherwise it cannot save
- does not validate comments
- can Save (Review State → Saved) per ISR
- All comments and scores are saved (though not propagated to consensus; see later)
- can Complete (Review State → Completed) per ISR
- can Finalize (bulk action) if any ISRs with Review not equal to None are not Closed or Finalized
- Can a user state change from Completed to Saved in UI?
- If Conflicted, only see title, abstract, proposal ID and cannot enter any information
- Conflict State is displayed
- Conflict/Available
- Conflict state not preventing visibility to proposals when appropriate
TTA Member
- Auto changes Review Type to None
|
| ||||||||||||||
Proposal Generation
|
|
|
|
- When TTA member uses Finalize, as a bulk action for all ISRs for that reviewer
- Review Types of Primary, Secondary, Tertiary but have Review State of Blank are set to Close
- Review Type of None is ignored, regardless of Review State
- Review Types of P,S,T that have Review States in (Saved, Completed) are transitioned to Finalized
- A separate Close functionality will be per ISR
Adding exernal reviewers as TTA member
- If an external reviewer is added, the Conflict state is automatically Available.
PPRs - Consensus
|
| ||||||||||||||||||||||||||
| Close Solicitation | Use existing structure | ||||||||||||||||||||||||||
Panel Configuration
|
SRP Member
- Comments are not connected to reviewers
- Normalized Individual Score
- Finalized Normalized Individual Score
- Mean Normalized Score
- Standard Deviation of the Mean Normalized Score
- SRP Score
- Members can no longer edit, but chair can
|
|
|
|
|
| ||||||||||||||
Vetting
|
|
|
|
| |||||||||||||
| Finalize Panel Configuration |
|
| |||||||||||||
Conflicts
|
|
|
|
| |||||||||
ISRs
|
|
|
|
- Review States of Closed should have Review Types of None should not affect the Consensus Reviews
- Review States of Any and Review Type of None should not affect the Consensus Reviews
- Primary and Secondary should be able to enter scores and comments and complete consensus reviews.
SRP Chair
| |||||||||||||||
Finalize ISRs per panel, per reviewer, bulk options? |
| ||||||||||||||
| Initiate Consensus Phase |
|
- Forces update to MNS, STD_MNS, and SRP if the SRP score was not manually changed already
|
| |||||||||||||
Consensus
|
|
|
|
|
|
|
| Finalize PPR |
|
|
|
TTA Member
- Initiate Consensus per panel if all ISRs are Finalized
- Generate Normalized Linear Rank when all consensus reviews are finalized per panel.
|
| ||||||||||
| Simulate All |
|
|
|
More realistic Simulated Proposals
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
...
|
status
Description JIRA Implemented Last Working Tested Status
subtle True colour Blue color green title Working Status subtle True colour Yellow color green title not implemented Status subtle True colour Red color green title to fix
- Enter Comments for
- Science
- Technical
- Data Management
- Enter Binary Score
- View Proposal
- Save
- Finalized (no complete here)
| Description |
|---|
OSR Reviews
| Requirement | Implementation for v0.2.2 | |
|---|---|---|
Title | More than 20 characters | Simulated Proposal N for Test Solicitation |
Abstract | More than 10 characters | Lorem ipsum |
Authors | not a TTA member | Any user not a TTA member |
Scientific Justification | pdf less than 4 pages | Stopgap PDF |
Science Category | One SC | Select from Solicitation definition |
Allocation Requests |
|
| Create 1 to 3 Allocation Requests and randomly select the Facility from the ones defined in the Solicitation. | restricted to VLA, GBT | ||||||||||
Capability Request per Allocation Request
|
|
| Jira | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
|
- Can enter comments for PI, Technical, Data Management + an internal for each
- Score
- Needs to be Binary
- Can Save
- Can Finalize which "dangles" but next step is out of scope. It does change the review state to Finalized, as expected. Proposal State doesn't change yet (not in scope).
- Hard to tell which proposals have been reviewed.
Score needs to be binary
Version 0.3 Outline
| Per Allocation Request, create 2 to 10 Capability Requests. The Capability should be randomly selected from what is available for the Facility in the Solicitation. | restricted to VLA Continuum, GBT Spectral Line | |||||||||||
Field Sources per Capability Request | Per Capability Request, randomly select 1 Test Field Sources available to the Capability. | Use calibratorList.json to select 1 field source + spectral spec pairs per Capability Request If VLA Continuum
If GBT Spectral Line
| |||||||||||
Spectral Specifications per Capability Request | Per Capability Request, randomly select between 1 Test Spectral Specifications available to the Capability. | see above for center frequency If VLA Continuum
If GBT Spectral Line
| |||||||||||
Performance parameters per Capability Request | Per Capability Request, set Test Performance Parameters | If VLA Continuum:
If GBT Spectral Line
| |||||||||||
Calibration parameters per Capability Request | Per Capability Request, randomly select a Test Calibration Parameter | If VLA Continuum:
If GBT Spectral Line:
| |||||||||||
Fake Feasibility Reviews
| Pattern |
Scheduler (during ISRs)
- Source Conflicts
Scheduler (post Consensus)
- Construct Preliminary Allocation Dispositions (priorities and time)
- Inputs:
- Proposal Information (current Semester):
- Sources, Resources
- Cluster ID; Time; LST/GST range, Config (VLA); Band;Fixed Date?
- Linear Ranks
- Sources, Resources
- Other:
- Carryover from previous semesters
- Sponsored time
- Maintenance Time
- Proposal Information (current Semester):
- Fine Tuning inputs
- Manual inspection of carryover etc
- Algorithm to determine scheduling priorities and available time
- How initial priorities are determined are Facility specific
- e.g., VLBA is straight quartiles
- How initial priorities are determined are Facility specific
- Fine Tuning
- Manual inspection of pressure plot
- Annotate recommendations
- e.g., promote N → C to fill gaps
- Output to TAC
- Cluster ID; Time; LST/GST range, Config (VLA); Band; Priority
- Pressure Plots
- Inputs:
Create Proposal
...
Capability (General)
| Description | JIRA | Implemented | Last Working | Tested | Status | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Scientific Justification |
| <Sprint 32 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
Persists, can upload, can delete, can replace, can view | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| General Allocation Request | <Sprint 32 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 | Can Select a Facility Can add one or more AR Can delete AR Can rename | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| General Capability Requests |
| < Sprint 32 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
Can Delete Can Add Multiples Can Rename | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Import Field Sources, Spectral Specs |
| Sprint 30 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
Zeros import. Widget matches columns to headers mostly as excepted (doesn't match units) There are units on the headers at import
HMS DMS doesn't import Units not enforced on widget | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Field Source and Spectral Specs |
| < Sprint 30 |
Sprint 38
|
Sprint 39
v0.1.2 |
Zeros persist in fields Entries persists
Negative Values in Dec DMS entry do not display correctly
Units on fields Precision
GBT missing field of view shape text entries and labels for non point source requests | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Selection of Calibration Parameters affects STL and OS | Sprint 32 | Sprint 37.3 | Sprint 37.3 |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Calibration Parameters |
| Sprint 32 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Performance Parameters |
| Sprint 32 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Advanced Tab |
| Sprint 36 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
Filtering Works as expected Units exist on fields Angular Resolution is present for VLA Import Widget has units
Import Works as expected; feedback on unsuccessful import (was) great! Now it thinks nothing works when only 1 thing is bad. STT-993
Relationship and hierarchy on Advanced Tab + Performance Parameters
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Science Target List |
| Sprint 32 | Sprint 37.3 | Sprint 37.3 |
Removed from all tabs as it should only accessible to Product Owners and that role hasn't been configured | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Simple partitioning, calibration strategy, and capability specific slew time and requested time calculations |
| Sprint 30 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
working but not scientifically checked | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Editing Observation Specification |
| < Sprint 30 | Sprint 37.4 | Sprint 37.4 |
Can add by target Can add by Hardware (Simple) Moving Scans works as expect | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
General Observation Specification |
| Sprint 32 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
Times in tabs and summary are reporting consistently Filtering works
Precision on entries
GBT time calculation uses bandwidth instead of spectral resolution. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| One or more Capability Requests in an Allocation Request can generate one or more Observation Specifications | <Sprint 32 |
Sprint 39
v0.1.2 |
Sprint 39
v0.1.2 |
|
Version Reports
| Expand | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Landing PageUpdated 10.12.22 for sprint 39, v0.1.2
Solicitation Creation
Navigation
Create ProposalCapability (General)
|
Misc
| Expand | ||
|---|---|---|
| ||
Display Precision
|
...