Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Proposal PDFs.  All TAC members need access to the proposal PDFs for all proposals submitted within the current semester, even proposals for which they are conflicted.  Currently, these are gzip files organized either by telescope or proposal type: Large, GBT, VLA, VLBA, and GMVA.  We need to think about how best to present the proposals to the TAC with TTAT.
  • Facility Documents.  Since we discuss each Facility separately during the TAC meeting the documents are organized by Facility.  There are two main PDFs.   Currently the GBT has all of this information in one document but there is not reason it could not be put in two documents.
      1. Narrative.  This is a short report written by the scheduler that summarizes the proposals and discusses any issues with resources/scheduling.  They always contain a pressure plot which is a LST/GST histogram of the hours requested broken down by scheduling priority, frequency, and weather conditions.  Currently each Facility does this differently with some justification, but it would be useful to make these plots similar.  We should discuss whether the tools should generate the plots or data (e.g, csv file), or both.
      2. Summary.  This lists the proposals in descending order of linear-rank and includes information that has been deemed useful in past meetings.  Currently these are different between the GBT and VLA/VLBA.  We should discuss if these should be the same and if so how we combine the best of both approaches (e.g., here is a proposal).  Currently we generate different versions of these documents (e.g., only Large proposals, only Triggered proposals, etc.).
  • Active Large Proposal Reports.  Currently a web-based form is used to capture the relevant information and a PDF of all reports is generated.
  • Presentations.  There are several presentations given during the TAC meeting that are produced by TTA Group members.


TTA Page: https://safe.nrao.edu/wiki/bin/view/Software/TelescopeTimeAllocation


Notes from whiteboard discussion (5/4/23)

Image Added


The TAC discusses proposals by

  • (large proposal TAC meeting) large proposal, facility, NLR
  • (TAC meeting) facility, triggered, and NLR

where facilities are GBT, VLA, VLBA, HSA&GMVA.

The large proposal TAC meeting needs a large proposal focused Pressure Plot and focused a large proposal facility report.


We agreed to two comment boxes

  • TAC comments for the PI
    • filled out by TTA members before, during, and after TAC meeting
    • to be reviewed the TAC chair
  • Internal comments
    • filled out by TTA members before and during TAC meeting
    • will capture scheduler's comments for the TAC as they determine preliminary scheduling priorities prior to TAC
    • will capture notes during the TAC meeting that may inform the TAC comments for the SRP
    • assume various TTA members will communicate with each other as they edit the comments
    • Note, this is not the same comments as the Internal Comments from the SRP, which belong to the Proposal Review entityIn the System Description we have Comments for the PI and Internal Comments, similar to the review comments.  Here the Internal Comments were comments from the TAC to NRAO.  What I thought we agreed to was to add any comments from the TTA Group (e.g., comments from the scheduler to the TAC).  That is, combine different internal comments into one field.

We agreed that Scheduling Priorities should be assigned to a Observation Specification Disposition and NOT the Allocation Disposition.

  • There will be a 1-to-1 mapping between Allocation Requests and Allocation Dispositions
  • There may not be a 1-to-1 mapping between the OS and the OSDs still.

We need to loop back to a discussion about the Pressure Plots.


Collection of Usecases

As a TAC member, I am representing my panel while the TAC comes to consensus about scheduling priorities, proprietary periods, scheduling constraints, recommended times, and TAC Comments to the PI. The goal as a TAC member is to make recommendations for the Director's Review, not approve the requests; the Director's Review relies heavily on our recommendations. To do this, I need visibility to the entirety of a proposal, even the author list (as long as the Dual Anonymous Review Policies allows it). I also need visibility to all of the SRP Comments, Feasibility Comments, and the TTA member's Comments to the TAC. I need to know what the TTA member (scheduler) recommends (e.g., facility reports, proposal summaries) and how it compares to what the PI requested. There is a lot of information to keep track of here so I need slim, efficient views as well as detailed view. Usually in the TAC meeting, we talk through proposals first by the Large Proposal type, then Regular Proposals. We then order by Facility -  Triggered - Score, so it would be nice if these were easy "preset" filters (or tabs) for me to jump between. Oh, and I'd like to print out the proposals and the reports in case I won't have access to my computer during the meeting. Finally, I really do need full visibility into the proposals. Even if I was marked as conflicted on a proposal in my panel, that shouldn't mean anything now.

Expand
titleTAC member responsibilities

As a TAC member I want to review Proposals so I can make recommendations for the Director’s Review.







As a TAC member I want to have visibility without restriction to all Proposals just as I did in SRPs so I can review their details if needed. But this is not the same as during the SRP meeting.  During the SRP meeting the SRP chair could not see proposals for which they were conflicted.

As a TAC member I want to have visibility without restriction to all Proposals so I can review their details as needed.


As a TAC member I want to modify the Comments to the PI  and the TAC comments for the PI for proposals that belong to my panel. I do not think we want the TAC member to be able to modify the SRP comments at this stage.


As a TAC member I want access to the Facility Reports so I can understand what can be scheduled.

As a TAC member I want access to the Proposal Summary so I understand what the requested resources are.


As a TAC member I want to see the Proposal information which includes Allocation Requests, Author, Co-Is, Abstract, Title, Scientific Justification, Technical Justification so I understand resources of the PI and their request.

As a TAC member I want to filter on proposals so I can efficiently navigate the proposals for the TAC meeting.

As a TAC member I would like there to be a way in the UI to keep track of what Proposals we have come to a consensus on.

As a TAC member I want printable views of the Facility Reports so I don’t have to look at the computer during the TAC meeting.

As a TAC member I want printable views of the Proposal Summary so I don’t have to look at the computer during the TAC meeting.


As a TAC member I want to see the SRP Comments, Feasibility Comments, Scientific Merit Metric, and the TTA member’s comments for all the proposals.

As a TAC member I want printable view for one or all of the proposals so I do not have to look at the computer during the TAC meeting.

As a TAC member I would like one of the filter or sort options to be if we have come to consensus on a proposal.


As a TAC member I would like the Proposal Summary to compare the time/resources of the Allocation Request vs the Allocation Disposition.


As a TAC member I want to see the Allocation Dispositions so I can understand what the TTA member suggests as a Scheduling Priority.

As a TAC member I would like to filter on what proposals are included in the print out because we don’t always discuss the proposals by Proposal ID order or facility agnostic.



As a TAC member I want to know which proposals are Joint Proposals (external and internal) even if I am just reviewing ADs from a single Facility so I can holistically understand the request.


As a TAC member I want to some key pieces of information readily accessible to me so I can navigate the proposals in a summary mode and not be overwhelmed by the Proposal details unless I want them.

As a TAC member I want to know if I am conflicted on a Proposal.





As a TAC chair, I represent my panel but I also direct the meeting and am responsible for the finalizing the TAC's recommendations. I need to be able to do everything to a normal member does but I also need to be able to make edits to some comments and approve the comments.  Mostly I'll rely on the TTA members at the meeting to keep notes for me but I still need some editing powers.

Expand
titleTAC Chair Responsibilities
As TAC Chair I would like have boarder access to the Proposals than the normal TAC members.




As a TAC chair I want to modify some information about a proposal or AD.

As a TAC Chair I want to be able to modify the binary metric on External Facilities so I can indicate that they are recommended to be approved or not by the TAC.

As a TAC Chair I want to mark if I have completed my review of the Proposals and the TAC comments to the PI so I can sign off on the TAC recommendations.

As a TAC Chair I want to know who is conflicted on a Proposal even though the TAC member can still see its contents.

As a TAC chair I want to modify TAC comments to PI and internal comments for the TAC until Disposition Letters are sent.



As a TAC Chair I want to know which Panel a Proposal is on.

As a TAC chair I want to modify SRP comments to PI.  I do not think we want the TAC chair to be able to modify the SRP comments at this stage.





As a TTA member, I have many hats in during the TAC meeting. I may be taking notes in the Internal Comments or editing TAC comments for PI or even editing SRP Comments for PI. I could also be editing Observation Specification Dispositions on the fly, so I need access to all of the tools I had prior when I was building the ATM and OSDs. I'll likely just use versioning to make my edits, as I expect the information in the facility reports to be static once finalized for the TAC. However, I know I'm going to be preparing more reports for the Director's Review, based on the recommendations of the TAC.

Expand
titleTTA Member Responsibilities at the TAC

As a TTA member I want all of the powers that a TAC Chair and TAC member has.

As a TTA member I want access to the same editing powers I had when I was editing OSDs and building the ATM.