Versions Compared

Old Version 43

changes.mady.by.user John Tobin

Saved on

compared with

New Version Current

changes.mady.by.user Anthony Sowinski

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Below is a list of items that are priorities for Archive implementation, some of these are Legacy AAT retirement tickets, others are new development. The order in the tables is in priority order.


Main topics (click link to jump to section in page):

Data Delivery

Search/Data Selection

VLBA-specific

VLA(VLBA) Metadata presentation

Legacy VLA Data

Data Integrity

DA Tools

Missing Data

Other

ALMA

Product Versioning



Data Delivery

Anchor
DataDelivery
DataDelivery

Priority/Done?NoteshighScriptable query interfaceScriptable Query Interface to NRAO Archive

Fix Frequency-dependent FOV and position searches

Priority/Done?NotesJiRA ticket /Confluence page
CriticalDownloads via Scriptable query interface

Scriptable Query Interface to NRAO Archive  

 DMS JIRASSA7421serverSSA7106medium7353make tar downloads default to 'off'7344
critical (4.2.0)The email sent by the archive tool will include the wget command in the near future.

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

Jira
server

serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
key

WS-

1395


criticalA friendly error is needed when a users is not authorized to access proprietary data.

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-7474

confusing to staff as well

mediumPut warning that only one CMS at a time can be requested in AAT
Jira

-need to kill RH, WS 3.0+

criticalRestore data using same version of CASA as calibrated

Jira
server

DMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
key

WS-1405


mediumPut warning that only one CMS at a time can be requested in AATcould be a flyover text (currently has a flyover circle with slash)for pipelineoption to return UNTAR'd file does not work 
Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-
6495https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads		pipeline topic
7106


could be a flyover text (currently has a flyover circle with slash)
high (WS 2.8/2.9)high

Clean up the nested directory data delivery mess


legacy VLA data deliveries are one level deeper in directories than an SDM

*May need revisions to account for VLBA differences.

Delivery Directory Improvements

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-7000

WS 2.7 or 3.0?
planned attempted for 4.2.0 but is deferred2

Don't restrict download number limit.

New ticket to remove the '/100 string from webpage'

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-7352
Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-7436

We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.
4.2.1

Fix select-all functionality

  • Always have select all available (only displayed files/SDM or from all pages)


  • make select-all work properly with select/deselect
NEW TICKETmediumDownload weblogs directly (and/or serve them as well!)Direct weblog download from archive search return interface
Bulk download of Calibration tarballs

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-

7573

lowarchive should ask for confirmation to continue if the download or processing job is considered largeTo be requestedThe front end can show size estimates for various products.

mediumDownload weblogs directly (and/or serve them as well!)lowData Delivery times out if tar file(s) are too large/time consuming

Direct weblog download from archive search return interface 

SSA5096
will not be an issue with taring not being the default.lowarchive-new delivery not chmod'd/chowned
Jira
serverDMS JIRA

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
key

SSA-6083

WS-1388
Jira
serverDMS JIRA

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
key

WS-

1389
!


mediumBulk download of Calibration tarballs√open up local delivery restrictions (to /home and /lustre). 

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-7179
The part related to opening the download destination to nm-### accounts on lustre is
Jira
serverDMS JIRA
7353


lowarchive should ask for confirmation to continue if the download or processing job is considered largeTo be requestedThe front end can show size estimates for various products.
lowData Delivery times out if tar file(s) are too large/time consuming


Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-
7345
6083
will not be an issue with taring not being the default.
lowarchive-new delivery not chmod'd/chownedThis should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!√disable checksums by default


Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-
7343
5096

√ 2022.2 pipelineoption to return UNTAR'd file does not work 

Jira
serverDMS JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-

Search interface/Data Selection

6495
https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

pipeline topic
√ (4.2.0)The email sent by the archive tool will include the wget command in the near future.

 

Jira
serverDMS JIRA
serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
keySSA-

7395

7421

high

√open up local delivery restrictions (to /home and /lustre). 
  • exact same feature as legacy archive, must select to do the freq. dependent FOV
    • legacy archive has this feature

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    4915

    7179

    The part related to opening the download destination to nm-### accounts on lustre is

    Jira
    serverDMS JIRA

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7345

    		This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!
    √disable checksums by default

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,

    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,

    reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7497

    7343

    high

    Position searches provide distance from searched position and sort by distance

    • legacy archive feature

    √make tar downloads default to 'off'

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7344



    Search interface/Data Selection

    Anchor
    Search
    Search

    7387issuekey,summary7496

    Download number limit: 100 data sets, but download data volume limit to 10TB per request.

    Doesn't fully solve problem see also7352
    Priority/Done?Notes

    high

    Fix Frequency-dependent FOV and position searches

    • exact same feature as legacy archive, must select to do the freq. dependent FOV
    • legacy archive has this feature

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary

    		User request, but is a legacy AAT featuremedium

    Treat wild cards consistently in AAT search interface

    • account for * in source names
    Jira
    serverDMS JIRA
    columnIds

    ,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    		lowAllow search return of observation scans?

    4915
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-73887497


    high (4.2.2)

    Position searches provide distance from searched position and sort by distance

    • legacy archive feature

    Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

    		highAllow search filtering based on total time on source.

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7424

    		Based on legacy archive helpdisk question from user. UC feedback as well.Rearrange boxes in 'Search Inputs'Ticket to be created.√

    7387

    		User request, but is a legacy AAT feature
    medium

    Treat wild cards consistently in AAT search interface

    • account for * in source names

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    		This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

    VLBA Stuff

    issuekey,summary,issuetype,

    7496


    lowAllow search return of observation scans?Priority/Done?NotesJiRA ticket /Confluence pageHighAdd wget command in emails generated by the AAT upon downloading data

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7421

    		High

    VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

    • CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED

    columnIdsissuekey,summary,issuetype,

    https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

    proprietary period setter: 

    Jira
    serverDMS JIRA
    columnIds
    created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7350
    7388

    Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

    high

    Allow search filtering based on total time on source.

    needs follow up, some things are inconsistent (especially the topic of the tool's readiness to change the proprietary period of VLBA data).HighVLBA+EVLA projects without metadata and sometimes also mismatched PI

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-74237424

    Based on legacy archive helpdisk question from user. UC feedback as well.mediumFix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scan)HighProxy issue for huge VLBA projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7436WS-1365



    Rearrange boxes in 'Search Inputs'Ticket to be created.
    √ (4.2.0)Scriptable query interfaceMedWrong band designation in VLBA data (old data only?)

    Scriptable Query Interface to NRAO Archive

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7420

    This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.Med

    7395


    √

    Download number limit: 100 data sets, but download data volume limit to 10TB per request.


    Doesn't fully solve problem see also

    For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7185 but needs to be picked up in future AAT releases

    7352


    This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.


    VLBA Stuff

    Anchor
    VLBA
    VLBA

    issuekey,summary,issuetype,
    Priority/Done?NotesJiRA ticket /Confluence page
    High

    VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

    • CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED
    • Current tools should be able to add PI for USNO

    https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

    proprietary period setter: 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,

    		New JIRA ticket not yet created.MedDefault Instrument of VLBA projects in AAT/PPI

    Jira
    serverDMS JIRA
    columnIds
    created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7208
    7350

    Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

    The VLBA DA tools for changing PI and setting proprietary period have been complete for some time. The confluence page also mentions a tool for annotations; maybe that part should be moved to the Data Integrity section?

    HighVLBA+EVLA projects without metadata and sometimes also mismatched PIMedAdd PFT (proposal finder tool) link in Project View for VLBA projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-74617423


    High (4.2.1)Proxy issue for huge VLBA projectsLowImport remaining 8 GMVA files

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7438

    Low

    7436


    High (4.2.1)Slow VLBA indexingMark4 files with 0 length getting added to new archive metadata

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7297

    Small number of files affected.LowIncomplete VLBA data of observations crossing midnight (open in case more cases show up)

    7563
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-69167541

    High
    MedWrong band designation in VLBA data (old data only?)Create USNO download acknowledgement

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6952

    √ 4.1.1

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7420

    This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.Medimport FITSAIPS files without matching projects (51 files) and project GP0024
    • For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket 
    • Jira
      serverDMS JIRA
      columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
      keySSA-
    7426
    √ 4.1.1
    • 7185
      but needs to be picked up in future AAT releases
    Add FITSAIPS files to new archive and segment association

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7328
    7609

    Ticket created Anna Kapinska, Emmanuel Momjian, and Anthony Sowinski should check it to make sure it's correct and specifies all requirements.


    MedDefault Instrument of VLBA projects in AAT/PPI√ 4.1.1old VLBA project metadata issues

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7379

    √ 4.1.1VLBA data structure in the new archive - improved interface

    7208

    And a new ticket created:

    Jira
    serverDMS JIRA

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-7185

    Confluence: GUI (segment hierarchy) for VLBA data in the new archive

    √ (4.1.1)Database has zeros for min/max frequencies for some archive files

    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7619

    Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI


    MedAdd PFT (proposal finder tool) link in Project View for VLBA projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7277

    7461


    LowImport remaining 8 GMVA files√877 VLBA correlations with missing files entries JiraserverDMS JIRA

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7471

    √proprietary clock for VLBA data

    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    6552

    7438


    LowMark4 files with 0 length getting added to new archive metadatadone√VLBA Reingestion Refinements

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5917

    7297

    Small number of files affected.LowIncomplete VLBA data of observations crossing midnight (open in case more cases show up)ongoing → done√VLBA Polarization Duplication Jira

    Jira

    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5640

    6916


    HighCreate USNO download acknowledgementdone√String Terminators in VLBA fields

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5641

    6952

    done
    √BL473 unlock and missing segments(reopened) Low?
    Remove Legacy Archive label and link from new archive

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7375

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7148done√VLBA data structure in the new archive

    7627

    Update (26-Sep-2022, Anna): the link is still present on some of the AAT subpages, especially the download status page when request for data is submitted.

    The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

    √ 4.2.0Add wget command in emails generated by the AAT upon downloading data

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7421


    √ 4.1.1

    import FITSAIPS files without matching projects (51 files) and project GP0024

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,

    columnIdsissuekey,summary,issuetype,

    created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7426


    √ 4.1.1

    Add FITSAIPS files to new archive and segment association

    7076

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7328


    √ 4.1.1old VLBA project metadata issues7182

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7379


    √ 4.1.1VLBA data structure in the new archive - improved interface

    7183
    Jira
    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7185

    Confluence: GUI (segment hierarchy) for VLBA data in the new archive


    √ (4.1.1)Database has zeros for min/max frequencies for some archive files

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7184

    done

    7277


    √USNO Proprietary Download System/A way to deliver data from projects that are not archived

    VLBASYS 1008

    done877 VLBA correlations with missing files entries√Remove Legacy Archive label and link from new archive

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7375The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

    VLA Metadata Presentation

    Make scanlist information useful 7188 https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

    JT: revise to capture what we want about the frequency/setup information

    7471


    √proprietary clock for VLBA data

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6552

    		done
    √VLBA Reingestion RefinementsPriority/Done?NotesJiRA ticket /Confluence pageCritical

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    		This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.

    5917

    		ongoing → done
    √VLBA Polarization Duplication

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-5640

    		done
    √String Terminators in VLBA fields

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-5641

    		done
    √BL473 unlock and missing segments

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7148

    		done
    √VLBA data structure in the new archive

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7076
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7182
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7183
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7184

    		done
    √USNO Proprietary Download System/A way to deliver data from projects that are not archived

    VLBASYS 1008

    		done





    VLA Metadata Presentation 

    Anchor
    VLAMetadata
    VLAMetadata

    Priority/Done?NotesJiRA ticket /Confluence page
    critical

    Scan list does not show coordinates between dec= 00 and dec = -1 correctly

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7620


    Critical (4.3.0)Make scanlist information useful 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7188
     https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

    JT: revise to capture what we want about the frequency/setup information

    		This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.
    High (4.3/4.4)VLA Metadata display updates. 

    https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keyWS-1390

    		This has many items including 'telescope observing logs'.
    Medium

    Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7318


    MediumVLA/VLBA proposal code degeneracy
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-5538

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7318


    MediumIndexing of VLA low band projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7187


    √

    Subscans table holding both Radian and Degree positions

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-5275

    		done
    √archive search returning incorrect projects
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6192


    		done





    Legacy VLA Data

    Anchor
    Legacy
    Legacy

    Medium
    Priority/Done?NotesJiRA ticket /Confluence page
    Criticalcorrupt legacy VLA data in the AAT
    HighVLA Metadata display updates. https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+UpdatesThis has many items including 'telescope observing logs'.
    MediumIncorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-73187628


    HighVLA/VLBA proposal code degeneracyMetadata Issues in Legacy VLA data

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5538

    7192

    		Needs input from Bryan
    HighLegacy VLA data missing error codes in the new archive tool

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7318

    		Medium

    7191

    		Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.
    Highmetadata errors in VLBA (BD114) and old VLA data in new archiveIndexing of VLA low band projects
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7187    		√

    Subscans table holding both Radian and Degree positions

    7128

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    key

    SSA-7129

    		This has been split into two tickets: one VLBA and one VLA
    Mediumlegacy VLA metadata error: EBs that claim to have run for 2+ daysSSA-5275done√archive search returning incorrect projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    6192    		done

    Legacy VLA Data

    7129

    		requires re-ingestion


    Data Integrity

    Anchor
    Integrity
    Integrity

    Legacy VLA data missing error codes in the new archive tool71917129
    Priority/Done?NotesJiRA ticket /Confluence page
    BlockerGap Analysis Between Legacy and New ArchiveHighMetadata Issues in Legacy VLA data
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7192    		Needs input from BryanHigh
    6222


    		can be done once RLSW finishes the AIPSFITS files
    CriticalAutomated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7190
    https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools


    CriticalDisplay of archive ingestion/observation issuesMapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.Highmetadata errors in VLBA (BD114) and old VLA data in new archive
    Jira
    SSA-7128
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01key-36eee8a98f01
    keySSA-7189


    		related to SSA-7190
    CriticalIdentification of ingestion problems and automatically fixThis has been split into two tickets: one VLBA and one VLAMediumlegacy VLA metadata error: EBs that claim to have run for 2+ days

    Example ticket of a silent failure: 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7566

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7129

    		requires re-ingestion

    Data Integrity

    Automated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data7190

    7665


    √create missing db entries for Flag.xmlPriority/Done?NotesJiRA ticket /Confluence pageBlockerGap Analysis Between Legacy and New Archive
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6222
    		can be done once RLSW finishes the AIPSFITS filesCritical
    6273


    		Done
    √fix ASDM.xml files missing FlagTable entities
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    6274


    		Done


    DA Tools for Data Editing

    Anchor
    DATools
    DATools

    /displaySRDP/Archive+Data+Annotation+Tools
    Priority/Done?NotesJiRA ticket /Confluence page
    √Tool for setting Proprietary Period of science observations on the VLA and the VLBAhttps://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA
    CriticalDA annotation tools/Archive data annotation toolsCriticalDisplay of archive ingestion/observation issues
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7189
    related to SSA-7190√create missing db entries for Flag.xml

    https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    key

    SSA-6273Done√fix ASDM.xml files missing FlagTable entities

    WS-1392
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    key

    SSA

    WS-

    6274

    1393

    Done

    WS



    Missing Data

    Anchor
    Missing
    Missing
    DA Tools for Data Editing

    Priority/Done?NotesJiRA ticket /Confluence page√Tool for setting Proprietary Period of science observations on the VLA and the VLBAhttps://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA
    CriticalDA annotation tools/Archive data annotation tools
    • VLA/VLBA Image archive contents should be migrated into AAT (https://
    open-confluencedisplay/SRDP/Archive+Data+Annotation+Tools

    Missing Data

    Priority/Done?NotesJiRA ticket /Confluence pageCritical

    Tix to be created

    Tix to be created 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keyWS-1394

    May require discussion about how new archive will display images and the uvfits datasets.


    HighALMA Standard images into AAT

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7278


    HighLarge project support - ALFALFA + Other collection ingest

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7437
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-5712
    ALFALFA: SRAO and Collection Support



    Other

    Anchor
    Other
    Other

    Priority/Done?NotesJiRA ticket /Confluence pageDetails

    		Other tickets (so they are not forgotten)

    https://open-jira.nrao.edu/issues/?filter=11464

    		Tickets remaining are listed throughout their respective categories.
    Critical

    Proposal Contact Author not added to data.nrao.edu database

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7465

    		Bug when a project uses different PI and Contact Author
    MediumPreserve login between AAT and my.nrao.edu

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7322


    Medium √ (4.2.0)Remove pop-up page when accessing data.nrao.edu

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7502



    ALMA

    Anchor
    ALMA
    ALMA

    Priority/Done?NotesJiRA ticket /Confluence pageDetails
    CriticalALMA MOUS/calibration ingest unreliable; ALMA butler implementation into production

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7482



    Product Versioning

    Anchor
    Versioning
    Versioning

    Priority/Done?NotesJiRA ticket /Confluence pageDetails
    CriticalNeed to allow multiple versions of products (images/calibrations) in the archive

    Product Versioning and Replacement Design

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6476


    ...