You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 12 Next »

This page will hold our notes from implementing first fringes on an OUS level ALMA restore, as tracked in JIRA:

SSA-4811 - Getting issue details... STATUS .

In addition, for familiarization purposes, we should upgrade our current ACS installation:

SSA-4916 - Getting issue details... STATUS .


Test Data Set Details:

    Project 2017.1.00886.L

    MOUS ID: uid://A001/X1284/X265f

    made up of four ASDM EBs: uid://A002/Xc7111c/X3979,
    uid://A002/Xc7111c/X409e, uid://A002/X7111c/X86a7, uid://A002/Xc72427/X2dfe

        

        All these were processed recently, so have the calibration
        products stored separately (note though the data are still
        proprietary, so should not be shown too widely).

Adding the almapipe group to our accounts might make life easier (particularly for look-but-don't-touch access into the working areas).

PPR Examples:

Kana was kind enough to provide a few example PPRs that perform multi-eb processing:

I'm just starting in on understanding these, and comparing them with the PPRs for CIPL and Vlass quicklook imaging. 

Software Details:

For our test data set, we want to be using CASA/pipeline version 5.1.1-5r40896.  This is the ALMA-approved version of CASA for Cycle 5. See: https://almascience.nrao.edu/processing/science-pipeline

The new functionality for the ALMA Common Software (ACS) is built into the asdmExportLight command through a new option.  This hopefully will make it fairly easy (once we understand the Project & Database structures) to retrieve the desired calibration information.  One wrinkle, however, is that ACS is an overloaded acronym.  There is the 'base package' of ACS, and extensions to it.  Further investigation has revealed that we will need the Archive extension at minimum, and likely will want the Pipeline & ICD components as well. 

The pipelineMakeRequest tool will be useful for the creation of comparison scripts for our more extended PPR generation software.  It is ALMA focused, and builds the entire directory structure (including data download, if requested), complete with OUS Status files for each level. 

The NAASC keeps a set of ACS installations for their purposes in /home/acs.  Unfortunately, this area doesn't include the ACS-2018JUN release of the software with a fixed version of calibration retrieval.  I'll perform a test installation of an updated Enhanced-ACS in /home/alderaan_2/ for initial verification & prototyping.  

SSA may also need to update the version of ACSSW in /home/ssa/ACS, as we are currently using a version tagged for Cycle 3.  After the initial verification, the /home/ssa/ACS area can be updated with an updated version to support the restore functionality. 


ALMA Archive Questions:

We need to generally understand the layout of their archive, and how things interlink.  But if we come up with specific questions as well, record them.

  • Each OUS has a status associated with it. 
    • How are they used (observation? reduction? both?)
    • What are the possible status values?
    • What triggers a transition in status?
    • Are statuses at all levels equally important? 
  • Update Timescales.
    • periodic checks reasonable?
    • proprietary or calibration status clawback?
  • Full Structure:  Plan vs Observation vs Reduction
    • Potential:
      • Proposal
        • Science Goal(s)
          • SB(s)
    • Observation:
      • Project:
        • Science Goals
          • SB(s)
            • Session(s)
              • EB(s)
              • Failed observations handled how? 
    • Reduction:
      • Project
        • Science Goal(s)
          • Group(s)
            • Member(s)
              • Session(s)
                • EB(s)
  • Others?


Relevant Links:

  1. CIPL Restore Instructions
  2. Comparing Measurement Sets (Rough Draft)
  3. Base ACS homepage.
    1. Suggested Version: 2018Jun
  4. Other ACS component homes?
  • No labels