Page History

SRP Reviewer

• See list of proposals (after conflict certification)
• Review Type is displayed
  • Default is None; otherwise P,S,T
• Review State is displayed
  • default is Blank; otherwise Saved, Completed, Finalized, Closed
• Conflict State is displayed
  • Conflict/Available
• If not Conflicted, have an ISR in which to enter comments and a score and see the proposal
  • can Save (Review State → Saved) per ISR
    • validate if score not equal to 0; otherwise it cannot save
    • does not validate comments
  • can Complete (Review State → Completed) per ISR
  • can Finalize (bulk action) if any ISRs with Review not equal to None are not Closed or Finalized
• If Conflicted, only see title, abstract, proposal ID and cannot enter any information
• All comments and scores are saved (though not propagated to consensus; see later)
• Normalized Individual Scores are calculated on Finalize
• Cannot provide comments or scores for ISRs with a Review State of Closed
• Edge cases:
  • If an external proposal is added after reviewer has finalized, they should be able to review and finalize that one proposal (finalize is still bulk in theory)
  • If consensus has started for their panel, the Finalized Normalized Individual Score in that panel may be inconsistent with their new Normalized Individual Score (since it has the extra proposal). This is acceptable.
• Instructions present
• Finalize Reviews button always there but not active

Sprint 61

V0.2

Sprint 61

V0.2

• If an external proposal is added after reviewer has finalized, they should be able to review and finalize that one proposal (finalize is still bulk in theory)
• If consensus has started for their panel, the Finalized Normalized Individual Score in that panel may be inconsistent with their new Normalized Individual Score (since it has the extra proposal). This is acceptable.
• Cannot provide comments or scores for ISRs with a Review State of Closed
• Instructions present
• Finalize Reviews button always there but not active

External Reviewer

• External Reviewer is someone who is on any one panel associated with the Solicitation in question
• An external reviewer can be assigned an external ISR for any proposal as long as the Panel associated with that proposal has not started Consensus
• An external reviewer can be assigned an ISR even if their host panel is in Consensus.
• External Reviewers do not have to declare conflicts on external ISRs. When assigned, the conflict state is automatically set to Available
• External Reviewers can see the external ISR in their list of ISRs.
• ER can provide comments, scores, save, complete, and finalize their external ISRs
• ER do not have access to the Consensus UI or any responsibility at Consensus for the panel associated with the external ISR.
• ER scores and comment are available in Consensus and corretly correctly integrated

Sprint 61

V0.2

Sprint 61

V0.2

Import/Export ISRs

• a CSV file is expected but it can use as a delimiter any of the following:
  • , ; | tab
• putting double quotes around the comment will keep the commas within the comment safe
• if reviews exist when asked to export, it will export the reviews
• cannot upload a file with any blank fields (fails and warning issued)
• if a user changes the name of the reviewer within the file, it gives an error
• protects against Bobby Drop Tables
• on a successful upload, the Review State of the ISR will changed to Saved
• reuploading will update the comments/score
• Don't need every ISR in file to work

Sprint 61

V0.2

Sprint 61

V0.2

TTA Member

• can change Review State to Closed
  • Auto changes Review Type to None
• If a TTA member Finalizes a SRP member's ISRs (for the reviewer), it will finalize the ISRs that have a valid comment and score (Review State of Saved, Completed) and Review Type not equal to None. If a comment+score is not valid, regardless of the Review Type, it will Close the ISR (unsure if it still ignores review types of None)
• can change Review Type until Consensus is initated for the SRP member's panel.
• can change Review State until Consensus is initiated for the SRP member's panel.

Sprint 61

V0.2

Sprint 61

V0.2

Adding external reviewers as TTA member

• If an external reviewer is added, the Conflict state is automatically Available.
• TTA member can change Review Type until Consensus starts

Sprint 61

V0.2

Sprint 61

V0.2

Solicitation

• Specify name of Solicitation
• Specify Capabilities in Solicitation
• Set Execution and Call period

• Separate Solicitation and Proposal Generation
• Upload JSON for Solicitation Configuration

Proposal Generation

• specify number of proposalsspecify number of science categories
• use capabilities defined in Solicitation to generate demo/test proposalsFully supported proposals
• Realistic Demo or Test proposals
• can generate 100 proposals at a time and randomly distributes them across science categories

Panel Configuration

• Create SC based on SCs of proposals
  • Set Name, Science Category
• Associate users with SRP
• Specify a chair
• Associate proposals with SCs

Vetting

• Vet all proposals automatically

Conflicts

• Fill out Conflict Declarations
• Certify
• Per panel, per SRP? Bulk options

ISRs

• Assign Review Types satisfying minimum SRsPerProposal and 1 Primary and 1 Secondary per proposal
• If assigned P,S,T, fill out comments and score randomly
• If test solicitation, the comments should state the Proposal ID, the individual score, the reviewer name, and Review Type of reviewer
• If Demo solicitation, the comments should be simulated comments.
• Per panel, per reviewer, bulk options?

Finalize ISRs

per panel, per reviewer, bulk options?

Consensus

• Fill out Comments for each
• Complete PPR