You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 24 Next »

Background

The NRAO Telescope Time Allocation Committee (TAC) makes recommendations to the Director about scheduling priorities, approved time, proprietary period, and disposition constraints.   These are all included in the Observation Specification Disposition after approval from the Director.  The TAC does not re-evaluate the scientific or technical merit of the proposal and therefore they do not change the consensus comments or linear-rank.  They can, however, point out errors in the consensus comments that lead to changes in the text if approved by the corresponding SRP chair.

In practice there are two TAC meetings for each Solicitation.  The first meeting discusses only Large proposals, whereas  the second meeting discusses all remaining proposals.  These are called the Large proposal meeting and TAC meeting, respectively.  The Large proposal meeting is held remotely, whereas the TAC meeting is a hybrid meeting located at one of the sites (Green Bank, Socorro, or Charlottesville).  

Procedures

Here we list the procedures for the Large proposal and TAC meetings.  The procedures for these two meetings are similar but there are some differences noted below.  The TAC chair runs the meeting with close coordination of a TTA Group member.

  1. Introductions/Guidelines.  We start with brief introductions and then a TTA Group member will give a short presentation with some guidelines.  The TAC chair will then add anything they want to emphasize.   A TTA Group member may also give other presentations (e.g., Gender Equity update).
  2. Discussion by Facility.  Since time is allocated by Facility we organize the discussion around each Facility. We usually combine HSA and GMVA since there are fewer proposals for these FacilitiesWe usually start with the Triggered proposals first.
    1. GBT.  The GBT scheduler will give a short presentation and then the TAC will begin their deliberations.
    2. VLA.  The VLA scheduler will give a short presentation and then the TAC will begin their deliberations.
    3. VLBA.  The VLBA scheduler will give a short presentation and then the TAC will begin their deliberations.
    4. HSA/GMVA (TAC Meeting Only).  The VLBA scheduler will give a short presentation and then the TAC will begin their deliberations.
  3.  Active Large Projects (Large Proposal Meeting Only).  During the Large proposal meeting the TAC will discuss and make recommendations about active Large projects.
  4. Joint External Proposals (TAC Meeting Only).  We will review the recommendations for allocating time for these external Facilities (e.g., HST).  For example, check that we are not going over the allotted time available and any issues.
  5. Postmortem (TAC Meeting Only).  The TTA Group member who coordinates the TAC meeting together with the relevant ADs will meet with the TAC to discuss any issues.

Documents

Here we list the relevant documents that are needed for the TAC meeting.  Currently, most documents are located on a secure wiki page with permissions given for the relevant people.  In principle since TTAT understands the permissions it would be useful to have them accessible within the tool.

  • Proposal PDFs.  All TAC members need access to the proposal PDFs for all proposals submitted within the current semester, even proposals for which they are conflicted.  Currently, these are gzip files organized either by telescope or proposal type: Large, GBT, VLA, VLBA, and GMVA.  We need to think about how best to present the proposals to the TAC with TTAT.
  • Facility Documents.  Since we discuss each Facility separately during the TAC meeting the documents are organized by Facility.  There are two main PDFs.   Currently the GBT has all of this information in one document but there is not reason it could not be put in two documents.
      1. Narrative.  This is a short report written by the scheduler that summarizes the proposals and discusses any issues with resources/scheduling.  They always contain a pressure plot which is a LST/GST histogram of the hours requested broken down by scheduling priority, frequency, and weather conditions.  Currently each Facility does this differently with some justification, but it would be useful to make these plots similar.  We should discuss whether the tools should generate the plots or data (e.g, csv file), or both.
      2. Summary.  This lists the proposals in descending order of linear-rank and includes information that has been deemed useful in past meetings.  Currently these are different between the GBT and VLA/VLBA.  We should discuss if these should be the same and if so how we combine the best of both approaches (e.g., here is a proposal).  Currently we generate different versions of these documents (e.g., only Large proposals, only Triggered proposals, etc.).
  • Active Large Proposal Reports.  Currently a web-based form is used to capture the relevant information and a PDF of all reports is generated.
  • Presentations.  There are several presentations given during the TAC meeting that are produced by TTA Group members.


TTA Page: https://safe.nrao.edu/wiki/bin/view/Software/TelescopeTimeAllocation


Notes from whiteboard discussion (5/4/23)


The TAC discusses proposals by

  • (large proposal TAC meeting) large proposal, facility, NLR
  • (TAC meeting) facility, triggered, and NLR

where facilities are GBT, VLA, VLBA, HSA&GMVA.

The large proposal TAC meeting needs a large proposal focused Pressure Plot and focused a large proposal facility report.


We agreed to two comment boxes

  • TAC comments for the PI
    • filled out by TTA members before, during, and after TAC meeting
    • to be reviewed the TAC chair
  • Internal comments
    • filled out by TTA members before and during TAC meeting
    • will capture scheduler's comments for the TAC as they determine preliminary scheduling priorities prior to TAC
    • will capture notes during the TAC meeting that may inform the TAC comments for the SRP
    • assume various TTA members will communicate with each other as they edit the comments
    • Note, this is not the same comments as the Internal Comments from the SRP, which belong to the Proposal Review entity

We agreed that Scheduling Priorities should be assigned to a Observation Specification Disposition and NOT the Allocation Disposition.

  • There will be a 1-to-1 mapping between Allocation Requests and Allocation Dispositions
  • There may not be a 1-to-1 mapping between the OS and the OSDs still.

We need to loop back to a discussion about the Pressure Plots.


Collection of Usecases

As a TAC member, I am representing my panel while the TAC comes to consensus about scheduling priorities, proprietary periods, scheduling constraints, recommended times, and TAC Comments to the PI. The goal as a TAC member is to make recommendations for the Director's Review, not approve the requests; the Director's Review relies heavily on our recommendations. To do this, I need visibility to the entirety of a proposal, even the author list (as long as the Dual Anonymous Review Policies allows it). I also need visibility to all of the SRP Comments, Feasibility Comments, and the TTA member's Comments to the TAC. I need to know what the TTA member (scheduler) recommends (e.g., facility reports, proposal summaries) and how it compares to what the PI requested. There is a lot of information to keep track of here so I need slim, efficient views as well as detailed view. Usually in the TAC meeting, we talk through proposals first by the Large Proposal type, then Regular Proposals. We then order by Facility -  Triggered - Score, so it would be nice if these were easy "preset" filters (or tabs) for me to jump between. Oh, and I'd like to print out the proposals and the reports in case I won't have access to my computer during the meeting.

As a TAC member I want to review Proposals so I can make recommendations for the Director’s Review.







As a TAC member I want to have visibility to all Proposals just as I did in SRPs so I can review their details if needed.


As a TAC member I want to modify the Comments to the PI  and the TAC comments for the PI for proposals that belong to my panel.

As a TAC member I want access to the Facility Reports so I can understand what can be scheduled.

As a TAC member I want access to the Proposal Summary so I understand what the requested resources are.


As a TAC member I want to see the Proposal information which includes Allocation Requests, Author, Co-Is, Abstract, Title, Scientific Justification, Technical Justification so I understand resources of the PI and their request.

As a TAC member I want to filter on proposals so I can efficiently navigate the proposals for the TAC meeting.

As a TAC member I would like there to be a way in the UI to keep track of what Proposals we have come to a consensus on.

As a TAC member I want printable views of the Facility Reports so I don’t have to look at the computer during the TAC meeting.

As a TAC member I want printable views of the Proposal Summary so I don’t have to look at the computer during the TAC meeting.


As a TAC member I want to see the SRP Comments, Feasibility Comments, Scientific Merit Metric, and the TTA member’s comments for all the proposals.

As a TAC member I want printable view for one or all of the proposals so I do not have to look at the computer during the TAC meeting.

As a TAC member I would like one of the filter or sort options to be if we have come to consensus on a proposal.


As a TAC member I would like the Proposal Summary to compare the time/resources of the Allocation Request vs the Allocation Disposition.


As a TAC member I want to see the Allocation Dispositions so I can understand what the TTA member suggests as a Scheduling Priority.

As a TAC member I would like to filter on what proposals are included in the print out because we don’t always discuss the proposals by Proposal ID order or facility agnostic.



As a TAC member I want to know which proposals are Joint Proposals (external and internal) even if I am just reviewing ADs from a single Facility so I can holistically understand the request.


As a TAC member I want to some key pieces of information readily accessible to me so I can navigate the proposals in a summary mode and not be overwhelmed by the Proposal details unless I want them.

As a TAC member I want to know if I am conflicted on a Proposal.





As a TAC chair, I represent my panel but I also direct the meeting and am responsible for the finalizing the TAC's recommendations. I need to be able to do everything to a normal member does but I also need to be able to make edits to some comments and approve the comments.  Mostly I'll rely on the TTA members at the meeting to keep notes for me but I still need some editing powers.

As TAC Chair I would like have boarder access to the Proposals than the normal TAC members.




As a TAC chair I want to modify some information about a proposal or AD.

As a TAC Chair I want to be able to modify the binary metric on External Facilities so I can indicate that they are recommended to be approved or not by the TAC.

As a TAC Chair I want to mark if I have completed my review of the Proposals and the TAC comments to the PI so I can sign off on the TAC recommendations.

As a TAC Chair I want to know who is conflicted on a Proposal.

As a TAC chair I want to modify TAC comments to PI



As a TAC Chair I want to know which Panel a Proposal is on.

As a TAC chair I want to modify SRP comments to PI





As a TTA member, I have many hats in during the TAC meeting. I may be taking notes in the Internal Comments or editing TAC comments for PI or even editing SRP Comments for PI. I could also be editing Observation Specification Dispositions on the fly, so I need access to all of the tools I had prior when I was building the ATM and OSDs. I'll likely just use versioning to make my edits, as I expect the information in the facility reports to be static once finalized for the TAC. However, I know I'm going to be preparing more reports for the Director's Review, based on the recommendations of the TAC.

As a TTA member I want all of the powers that a TAC Chair and TAC member has.

As a TTA member I want access to the same editing powers I had when I was editing OSDs and building the ATM.





  • No labels