Page History

Updated 78.2510.23 for sprint 58 59 (→ v0.2)

Detailed TTA Tools Sprint Feedback Page

...

Description

JIRA

Implemented

Last Working

Tested

Status

Panels

Create SRP panels with unique names
Delete SRP Panels
Associate panels with 1 or more Science Categories (edge cases)
Assign 1 or more SRP Chairs
Assign multiple SRP Members to panel
Auto bulk assign proposals to panels based on SC
Manually assign proposals to panels
Save
Feasibility groups (back burner)
Assign independent science review to a member of a different SRP
Upload and use a configuration file
Filtering on Panels/proposals
Should not be able to assign the same person to multiple panels

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-867

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-868

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-869

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-870

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-872

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-883

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-1066

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-998

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-1077

________________________

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-896

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-897

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-898

Sprint 43

Sprint

Sprint 43

Status


subtle	True
colour	Blue
color	green
title	Working

can create new SRP panels
can select from a pre-set list of SRP panels
can assign SRP members/chair
can assign proposals to SRP

Status


subtle	True
colour	Yellow
color	green
title	Testing

Automatic proposal to panel assignment based on Science Category
saving
finalizing

Status


subtle	True
colour	Yellow
color	green
title	Not implemented

feasibility groups on placeholder

Status


subtle	True
colour	Red
color	green
title	to fix

Should be able to select multiple chairs (currently can only do one)
Want a reviewer focused display
Icon on number of proposals assigned to panel needs updating.
Drop down menu on available Science Categories should either be linked to Solicitations or the drop down menu on the available science categories on the vetting should be linked to the master list.
Should not be able to assign the same person to multiple panels.

Finalize Review Configuration

Finalize can occur when
- all proposals are vetted
- the Solicitation is Closed
Pop-up asking to confirm Finalization

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-884

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-889

Sprint 45

Sprint 47

The Finalize button is available when all proposals are vetted and SC are assigned but I can use it before the close of a Solicitation.

Status


subtle	True
colour	Red
color	green
title	to fix

Finalize button gives an error but seems to work
The finalize button is available before the Solicitation is Closed. It would be nice it were there but grayed out. Eventually with a tooltip that states the condition necessary for it to work.
- If the Solicitation isn't Closed, I can see the Configured Review Panels in the Reviews tab, but the Assignment page does not populate.
No confirmation on Finalization
Error messaging should be more robust here.
Finalizing should prevent future edits to configuration.

Configuration and Vetting is available prior to the close of a Solicitation

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-1168

Configuration and Vetting is part of the Solicitation UI now

PPRs - Conflict Declaration

...

should not be able to assign Review Types to a conflicted reviewer

Description JIRA Implemented Last Working Tested Status
Auto Conflicts based on authorship

Jira
server DMS JIRA
columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId eb2e750b-a83a-387e-8345-36eee8a98f01
key STT-884
Sprint 45 Sprint 48 Sprint 48

Status
subtle True
colour Blue
color green
title Working

SRP Reviewer
Must complete Conflicts before progressing to ISRs
Cannot change Auto Conflict
Default Conflict state is Unknown
Reviewer must change to either Conflict or Available
Reviewer may enter comments; persists
Can view Conflict State per ISR
Can see Proposal ID, Abstract, and Title
Bulk Action of Certification (cannot certify some and not others)

Jira
server DMS JIRA
columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId eb2e750b-a83a-387e-8345-36eee8a98f01
key STT-885
Jira
server DMS JIRA
columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId eb2e750b-a83a-387e-8345-36eee8a98f01
key STT-875

Sprint 46 Sprint 48 Sprint 48
Status
subtle True
colour Blue
color green
title Working
Must complete Conflicts before progressing to ISRs
Cannot change Auto Conflict
Default Conflict state is Unknown
Reviewer must change to either Conflict or Available
Reviewer may enter comments; persists
Can view Conflict State per ISR
Can see Proposal ID, Abstract, and Title
Bulk Action of Certification (cannot certify some and not others)
Status
subtle True
colour Yellow
color green
title not implemented
Status
subtle True
colour Red
color green
title to fix

SRP Chair
must complete conflicts like a reviewer
can see a "matrix" of Reviewers in their panel and their Conflict State
can assign Review Type per ISR
Only 1 Primary, 1 Secondary, * Tertiary, * None per Proposal
Default is None
Can change Review Types unless ISR is Finalized
Should not be able to assign types of Conflicted reviewers
Jira
server DMS JIRA
columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId eb2e750b-a83a-387e-8345-36eee8a98f01
key STT-887
Jira
server DMS JIRA
columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId eb2e750b-a83a-387e-8345-36eee8a98f01
key STT-871
Sprint 46/47

Status
subtle True
colour Blue
color green
title Working
must complete conflicts like a reviewer
can see a "matrix" of Reviewers in their panel and their Conflict State
Only one Primary and one Secondary can be saved to a proposal.
Any number of None or Teritary can be saved to a proposal.
Status
subtle True
colour Yellow
color green
title not implemented
Status
subtle True
colour Red
color green
title to fix
TTA Member
Can change Conflict State of reviewers
Valid Conflict State transitions for a TTA Member:
Available → Available
Available → Conflict
Conflict → Available
Conflict → Conflict
AutoConflict → Available
Proposed Consequences
TTA Member
Can change Conflict State of reviewers
Valid Conflict State transitions for a TTA Member:
Available → Available
Available → Conflict
Conflict → Available
Conflict → Conflict
AutoConflict → Available
Proposed Consequences:
ISRs either become available or unavailable as necessary for the SRP Member.
ISRs that are now Conflict State of Conflict that had Review Types other than None should automatically have Review Types changed to None.
Notifications sent
Jira
server DMS JIRA
columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId eb2e750b-a83a-387e-8345-36eee8a98f01
key STT-886
Jira
server DMS JIRA
columnIds issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId eb2e750b-a83a-387e-8345-36eee8a98f01
key STT-1146
Sprint 45/47

Status
subtle True
colour Blue
color green
title Working
Can update Conflict state and Certify (preferrable that it is done after user certifies)
Status
subtle True
colour Red
color green
title to fix
ISRs are not affected downstream yet.

PPRs -

...

Review Type Assignments

Description

JIRA

Implemented

Last Working

Tested

Status

SRP Chair

can see a "matrix" of Reviewers in their panel, their Conflict States, the Review States of their ISRs
can assign Review Type per ISR
- Only 1 Primary, 1 Secondary, * Tertiary, * None per Proposal
- Default is None
- Can change Review Types unless ISR is Finalized
Cannot be able to assign types of Conflicted reviewers
Cannot change Review Type of External Reviewer
External Reviewer's name is redacted but can see the Review Type and Review State for the external ISR

Sprint 46/47

Sprint 59

Status


subtle	True
colour	Blue
color	green
title	Working

can see a "matrix" of Reviewers in their panel and their Conflict State
Only one Primary and one Secondary can be saved to a proposal.
Any number of None or Teritary can be saved to a proposal.
Cannot assign Review Types to a conflicted reviewer
Cannot change Review Type of External Reviewer
External Reviewer's name is redacted but can see the Review Type and Review State for the external ISR

TTA Member

Can change any Review Type even if the Review State is Finalized until Consensus starts
Can change the Review Type of external ISRs until Consensus of the hosting panel begins

Sprint 45/47

Sprint 59

Status


subtle	True
colour	Blue
color	green
title	Working

Can change RT of external ISR as long as Consensus for the hosting panel has not started
Can change RT of any ISR even in Finalized State until the start of Consensus

PPRs - ISRs

Reviewer

See list of proposals (after conflict certification)
Review Type is displayed
- Default is None; otherwise P,S,T
Review State is displayed
- default is Blank; otherwise Saved, Completed, Finalized, Closed
Conflict State is displayed
- Conflict/Available
If not Conflicted, have an ISR in which to enter comments and a score and see the proposal
- can Save (Review State → Saved) per ISR
  - validate if score not equal to 0; otherwise it cannot save
  - does not validate comments
- can Complete (Review State → Completed) per ISR
- can Finalize (bulk action) if any ISRs with Review not equal to None are not Closed or Finalized
If Conflicted, only see title, abstract, proposal ID and cannot enter any information

All comments and scores are saved (though not propagated to consensus; see later)

Normalized Individual Scores are calculated on Finalize

Edge cases to test:

If an external proposal is added after reviewer has finalized, they should be able to review and finalize that one proposal (finalize is still bulk in theory)
If consensus has started for their panel, the Finalized Normalized Individual Score in that panel may be inconsistent with their new Normalized Individual Score (since it has the extra proposal). This is acceptable.

Description

JIRA

Implemented

Last Working

Tested

Status

SRP Reviewer
- See list of proposals (after conflict certification)
- Review Type is displayed
  - Default is None; otherwise P,S,T
- Review State is displayed
  - default is Blank; otherwise Saved, Completed, Finalized, Closed
- Conflict State is displayed
  - Conflict/Available
- If not Conflicted, have an ISR in which to enter comments and a score and see the proposal
  - can Save (Review State → Saved) per ISR
    - validate if score not equal to 0; otherwise it cannot save
    - does not validate comments
  - can Complete (Review State → Completed) per ISR
  - can Finalize (bulk action) if any ISRs with Review not equal to None are not Closed or Finalized
- If Conflicted, only see title, abstract, proposal ID and cannot enter any information
All comments and scores are saved (though not propagated to consensus; see later)
Normalized Individual Scores are calculated on Finalize
Edge cases to test:
- If an external proposal is added after reviewer has finalized, they should be able to review and finalize that one proposal (finalize is still bulk in theory)
- If consensus has started for their panel, the Finalized Normalized Individual Score in that panel may be inconsistent with their new Normalized Individual Score (since it has the extra proposal). This is acceptable.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-877

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-878

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-873

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-879

Sprint 46, 47

Sprint

Status


subtle	True
colour	Blue
color	green
title	Working

SRP Reviewer
- See list of proposals (after conflict certification)
- Review Type is displayed
  - Default is None; otherwise P,S,T
- Review State is displayed
  - default is Blank; otherwise Saved, Completed, Finalized, Closed
- If not Conflicted, have an ISR in which to enter comments and a score and see the proposal
  - can Save (Review State → Saved) per ISR
    - validate if score not equal to 0; otherwise it cannot save
    - does not validate comments
- All comments and scores are saved (though not propagated to consensus; see later)

Status


subtle	True
colour	Yellow
color	green
title	Testing

can Complete (Review State → Completed) per ISR
can Finalize (bulk action) if any ISRs with Review not equal to None are not Closed or Finalized
Can a user state change from Completed to Saved in UI?
If Conflicted, only see title, abstract, proposal ID and cannot enter any information
Conflict State is displayed
- Conflict/Available

Status


subtle	True
colour	Red
color	green
title	to fix

Conflict state not preventing visibility to proposals when appropriate

External Reviewer

External Reviewer is someone who is on any one panel associated with the Solicitation in question
An external reviewer can be assigned an external ISR for any proposal as long as the Panel associated with that proposal has not started Consensus
External Reviewers do not have to declare conflicts on external ISRs. When assigned, the conflict state is automatically set to Available
External Reviewers can see the external ISR in their list of ISRs.
ER can provide comments, scores, save, complete, and finalize their external ISRs
ER do not have access to the Consensus UI or any responsibility at Consensus for the panel associated with the external ISR.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-877

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-878

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-873

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated

,due,assignee,reporter,priority,status,resolutionserverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySTT-879Sprint 46, 47SprintSprint StatussubtleTruecolourBluecolorgreentitleWorkingSRP Reviewer

See list of proposals (after conflict certification)

Review Type is displayed

Default is None; otherwise P,S,T

Review State is displayed

default is Blank; otherwise Saved, Completed, Finalized, Closed

If not Conflicted, have an ISR in which to enter comments and a score and see the proposal

can Save (Review State → Saved) per ISR
- validate if score not equal to 0; otherwise it cannot save
- does not validate comments

,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-1395

All comments and scores are saved (though not propagated to consensus; see later)

Status

colour

subtle	True

Yellow

title
Blue
color	green

Testing

can Complete (Review State → Completed) per ISR
can Finalize (bulk action) if any ISRs with Review not equal to None are not Closed or Finalized
Can a user state change from Completed to Saved in UI?

StatussubtleTruecolourYellowcolorgreentitlenot implemented

If Conflicted, only see title, abstract, proposal ID and cannot enter any information
Conflict State is displayed
- Conflict/Available

Working

External Reviewer is someone who is on any one panel associated with the Solicitation in question
An external reviewer can be assigned an external ISR for any proposal as long as the Panel associated with that proposal has not started Consensus
External Reviewers do not have to declare conflicts on external ISRs. When assigned, the conflict state is automatically set to Available
ER do not have access to the Consensus UI or any responsibility at Consensus for the panel associated with the external ISR.

Status


subtle	True
colour	Red
color	green
title	to fix

Conflict state not preventing visibility to proposals when appropriate

External Reviewers can see the external ISR in their list of ISRs.
ER can provide comments, scores, save, complete, and finalize their external ISRs

Import/Export ISRs

a CSV file is expected but it can use as a delimiter any of the following:
- , ; | tab
putting double quotes around the comment will keep the commas within the comment safe
if reviews exist when asked to export, it will export the reviews
cannot upload a file with any blank fields (fails and warning issued)
if a user changes the name of the reviewer within the file, it gives an error
protects against Bobby Drop Tables
on a successfull upload, the Review State of the ISR will changed to Saved (not sure what it does for completed or a re-upload)

TTA Member

can change Review State to Closed
- Auto changes Review Type to None
If a TTA member Finalizes a SRP member's ISRs (for the reviewer), it will finalize the ISRs that have a valid comment and score (Review State of Saved, Completed) and Review Type not equal to None. If a comment+score is not valid, regardless of the Review Type, it will Close the ISR (unsure if it still ignores review types of None)
can change Review Type until Consensus is initated for the SRP member's panel.
can change Review State utnil Consensus is initiated for the SRP member's panel.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	STT-1039

Status


subtle	True
colour	Blue
color	green
title	to test

When TTA member uses Finalize, as a bulk action for all ISRs for that reviewer
- Review Types of Primary, Secondary, Tertiary but have Review State of Blank are set to Close
- Review Type of None is ignored, regardless of Review State
- Review Types of P,S,T that have Review States in (Saved, Completed) are transitioned to Finalized
A separate Close functionality will be per ISR

Adding exernal reviewers as TTA member

If an external reviewer is added, the Conflict state is automatically Available.

...

Space shortcuts

Page tree

Versions Compared

Old Version 156

New Version 157

Key

PPRs - Conflict Declaration

PPRs -

Review Type Assignments

PPRs - ISRs