Versions Compared

Old Version 60

changes.mady.by.user John Tobin

Saved on

compared with

New Version Current

changes.mady.by.user Anthony Sowinski

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Below is a list of items that are priorities for Archive implementation, some of these are Legacy AAT retirement tickets, others are new development. The order in the tables is in priority order.


Main topics (click link to jump to section in page):

Data Delivery

Search/Data Selection

VLBA-specific

VLA(VLBA) Metadata presentation

Legacy VLA Data

Data Integrity

DA Tools

Missing Data

Other

ALMA

Product Versioning



Data Delivery

Anchor
DataDelivery
DataDelivery
Data Delivery

Priority/Done?Noteshigh

Fix Frequency-dependent FOV and position searches

  • exact same feature as legacy archive, must select to do the freq. dependent FOV
    • legacy archive has this featureA friendly error is needed when a users is not authorized to access proprietary data.SSA74747353Data Delivery times out if tar file(s) are too large/time consuming6083archive-new delivery not chmod'd/chowned serverIdissuekey,summary,issuetype,created,updated,duedate
    Priority/Done?NotesJiRA ticket /Confluence page
    CriticalDownloads via Scriptable query interface

    Scriptable Query Interface to NRAO Archive  

    		critical

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    key

    WS-1395


    criticalA friendly error is needed when a users is not authorized to access proprietary data.

    confusing to staff as well

    -need to kill RH, WS 3.0+

    		mediumPut warning that only one CMS at a time can be requested in AAT

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7106    		could be a flyover text (currently has a flyover circle with slash)

    7474

    confusing to staff as well

    -need to kill RH, WS 3.0+

    criticalRestore data using same version of CASA as calibratedhigh (WS 2.8/2.9)

    Clean up the nested directory data delivery mess

    legacy VLA data deliveries are one level deeper in directories than an SDM
    *May need revisions to account for VLBA differences.

    Delivery Directory Improvements

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSAWS-7000

    		WS 2.7 or 3.0?

    1405


    mediumPut warning that only one CMS at a time can be requested in AATattempted for 4.2.0 but is deferred

    Don't restrict download number limit.

    New ticket to remove the '/100 string from webpage'

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7106


    		could be a flyover text (currently has a flyover circle with slash)
    high (WS 2.8/2.9)

    Clean up the nested directory data delivery mess


    legacy VLA data deliveries are one level deeper in directories than an SDM

    *May need revisions to account for VLBA differences.

    Delivery Directory Improvements

    7352
    Jira
    serverDMS JIRA
    columnIdsissuekey
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-74367000

    		WS 2.7 or 3.0?
    planned We would like no limit on the number of files, but keep the 10TB for the total downloaded volume. 4.2.1

    Fix select-all functionality

    • Always have select all available (only displayed files/SDM or from all pages)
    make select-all work properly with select/deselect2

    Don't restrict download number limit.

    New ticket to remove the '/100 string from webpage'

    		mediumBulk download of Calibration tarballs

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7573

    		mediumDownload weblogs directly (and/or serve them as well!)Direct weblog download from archive search return interface

    7352

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    lowarchive should ask for confirmation to continue if the download or processing job is considered largeTo be requestedThe front end can show size estimates for various products.

    7436

    		We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.
    4.2.1

    Fix select-all functionality

    • Always have select all available (only displayed files/SDM or from all pages)


    • make select-all work properly with select/deselect
    		low

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    		will not be an issue with taring not being the default.low

    7573


    mediumDownload weblogs directly (and/or serve them as well!)√ 2022.2 pipelineoption to return UNTAR'd file does not work 

    Direct weblog download from archive search return interface 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    key

    		SSA-5096

    WS-1388

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSAWS-6495
    https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

    		pipeline topic

    1389
    !


    mediumBulk download of Calibration tarballs√ (4.2.0)The email sent by the archive tool will include the wget command in the near future.

    Jira
    serverDMS JIRA

    		eb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7421
    √open up local delivery restrictions (to /home and /lustre). 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7179
    The part related to opening the download destination to nm-### accounts on lustre is
    7353


    lowarchive should ask for confirmation to continue if the download or processing job is considered largeTo be requestedThe front end can show size estimates for various products.
    lowData Delivery times out if tar file(s) are too large/time consuming


    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7345
    This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due
    		√disable checksums by default
    Jira
    serverDMS JIRA
    columnIds
    ,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6083
    will not be an issue with taring not being the default.lowarchive-new delivery not chmod'd/chowned


    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,
    columnskey,summary,
    type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7343
    5096

    √ make tar downloads default to 'off'2022.2 pipelineoption to return UNTAR'd file does not work 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7344

    6495

    Search interface/Data Selection

    https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

    		pipeline topic
    √ (4.2.0)The email sent by the archive tool will include the wget command in the near future.

     

    Jira
    serverDMS JIRA

    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverId

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    4915high (4.2.2)

    Position searches provide distance from searched position and sort by distance

    • legacy archive feature

    7421


    √open up local delivery restrictions (to /home and /lustre). 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7497issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution

    7179

    The part related to opening the download destination to nm-### accounts on lustre is

    Jira
    serverDMS JIRA

    		columnIds

    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionUser request, but is a legacy AAT featuremedium

    Treat wild cards consistently in AAT search interface

    • account for * in source names

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7387

    7345

    		This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!
    √disable checksums by default

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7496

    7343

    low

    √make tar downloads default to 'off'
    Allow search return of observation scans?

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7344



    Search interface/Data Selection

    Anchor
    Search
    Search

    7388
    Priority/Done?Notes

    high

    Fix Frequency-dependent FOV and position searches

    • exact same feature as legacy archive, must select to do the freq. dependent FOV
    • legacy archive has this feature

    Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

    		high

    Allow search filtering based on total time on source.

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7424

    		Based on legacy archive helpdisk question from user. UC feedback as well.mediumFix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scan)Rearrange boxes in 'Search Inputs'Ticket to be created.

    4915
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7497


    high √ (4.2.02)Scriptable query interface

    Position searches provide distance from searched position and sort by distance

    • legacy archive feature
    Scriptable Query Interface to NRAO Archive

    Jira
    serverDMS JIRAserverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7395

    		√

    Download number limit: 100 data sets, but download data volume limit to 10TB per request.

    Doesn't fully solve problem see also

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-73527387

    		User requestThis change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

    VLBA Stuff

    https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

    proprietary period setter: 7350

    is a legacy AAT feature
    medium

    Treat wild cards consistently in AAT search interface

    • account for * in source names
    		Priority/Done?NotesJiRA ticket /Confluence pageHigh

    VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

    • CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED
    • Current tools should be able to add PI for USNO
    Jira
    serverDMS JIRA
    columnIds

    Jira
    serverDMS JIRA
    columnIds

    issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7496


    lowAllow search return of observation scans?

    Jira
    serverDMS JIRA

    		needs follow up, some things are inconsistent (especially the topic of the tool's readiness to change the proprietary period of VLBA data).HighVLBA+EVLA projects without metadata and sometimes also mismatched PI

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-74237388

    Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

    high

    Allow search filtering based on total time on source.

    		High (4.2.1)Proxy issue for huge VLBA projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-74367424

    		Based on legacy archive helpdisk question from user. UC feedback as well.
    mediumFix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scanMedWrong band designation in VLBA data (old data only?)

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSAWS-74201365

    		This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.

    		Rearrange boxes in 'Search Inputs'Ticket to be created.
    √ (4.2.0)Scriptable query interfaceMed
    For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket 

    Scriptable Query Interface to NRAO Archive

    Jira
    serverDMS JIRA

    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a

    serverIdeb2e750b-a83a

    -387e-8345-36eee8a98f01
    keySSA-7395


    √

    Download number limit: 100 data sets, but download data volume limit to 10TB per request.


    Doesn't fully solve problem see also

    7185 but needs to be picked up in future AAT releases

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7609

    Ticket created Anna Kapinska, Emmanuel Momjian, and Anthony Sowinski should check it to make sure it's correct and specifies all requirements.

    7352


    This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.


    VLBA Stuff

    Anchor
    VLBA
    VLBA

    proprietary period setter: 
    Priority/Done?NotesJiRA ticket /Confluence page
    High

    VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

    • CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED
    • Current tools should be able to add PI for USNO
    		MedDefault Instrument of VLBA projects in AAT/PPI

    https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

    Jira
    serverDMS JIRA
    columnIds
    Jira
    serverDMS JIRA
    columnIds
    issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7208
    7350

    Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

    The VLBA DA tools for changing PI and setting proprietary period have been complete for some time. The confluence page also mentions a tool for annotations; maybe that part should be moved to the Data Integrity section?

    HighVLBA+EVLA projects without metadata and sometimes also mismatched PIMedAdd PFT (proposal finder tool) link in Project View for VLBA projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-74617423


    High (4.2.1)Proxy issue for huge VLBA projectsLowImport remaining 8 GMVA files

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7438

    Low

    7436


    High (4.2.1)Slow VLBA indexingMark4 files with 0 length getting added to new archive metadata

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7297

    Small number of files affected.LowIncomplete VLBA data of observations crossing midnight (open in case more cases show up)

    7563
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-69167541

    High
    MedWrong band designation in VLBA data (old data only?)Create USNO download acknowledgement

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6952

    √ 4.2.0Add wget command in emails generated by the AAT upon downloading data

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7421

    √ 4.1.1

    7420

    This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.Medimport FITSAIPS files without matching projects (51 files) and project GP0024
    • For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket 
    • Jira
      serverDMS JIRA
      columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
      columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
      serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
      keySSA-
    7426
    √ 4.1.1

    Add FITSAIPS files to new archive and segment association

    • 7185
      but needs to be picked up in future AAT releases

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-
    7328
    7609

    Ticket created Anna Kapinska, Emmanuel Momjian, and Anthony Sowinski should check it to make sure it's correct and specifies all requirements.


    MedDefault Instrument of VLBA projects in AAT/PPI√ 4.1.1old VLBA project metadata issues

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7379

    √ 4.1.1VLBA data structure in the new archive - improved interface√ (4.1.1)Database has zeros for min/max frequencies for some archive files JiraserverDMS JIRAcolumnIds

    7208

    And a new ticket created:

    Jira
    serverDMS JIRA

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-7185

    Confluence: GUI (segment hierarchy) for VLBA data in the new archive

    columnIds

    issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7277√877 VLBA correlations with missing files entries

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7471

    √proprietary clock for VLBA data

    7619

    Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI


    MedAdd PFT (proposal finder tool) link in Project View for VLBA projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    6552

    7461


    LowImport remaining 8 GMVA filesdone√VLBA Reingestion Refinements

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5917

    7438

    ongoing → done√VLBA Polarization Duplication
    LowMark4 files with 0 length getting added to new archive metadata

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5640

    7297

    Small number of files affected.LowIncomplete VLBA data of observations crossing midnight (open in case more cases show up)done√String Terminators in VLBA fields

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5641

    6916

    done√
    HighCreate USNO download acknowledgementBL473 unlock and missing segments

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7148done

    6952


    √VLBA data structure in the (reopened) Low?
    Remove Legacy Archive label and link from new archive

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7375

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7076 JiraserverDMS JIRAcolumnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

    7627

    Update (26-Sep-2022, Anna): the link is still present on some of the AAT subpages, especially the download status page when request for data is submitted.

    The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

    √ 4.2.0Add wget command in emails generated by the AAT upon downloading data

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7182

    7421


    √ 4.1.1

    import FITSAIPS files without matching projects (51 files) and project GP0024

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7426


    √ 4.1.1

    Add FITSAIPS files to new archive and segment association

    7183

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7184

    7328


    done√ USNO Proprietary Download System/A way to deliver data from projects that are not archived

    VLBASYS 1008

    done4.1.1old VLBA project metadata issues

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

    √Remove Legacy Archive label and link from new archive JiraserverDMS JIRA

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7375The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

    VLA Metadata Presentation

    Make scanlist information useful 7188 https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

    JT: revise to capture what we want about the frequency/setup information

    Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA7318Subscans table holding both Radian and Degree positions5275archive search returning incorrect projects6192done

    7379


    √ 4.1.1VLBA data structure in the new archive - improved interface

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7185

    Confluence: GUI (segment hierarchy) for VLBA data in the new archive


    √ (4.1.1)Database has zeros for min/max frequencies for some archive filesPriority/Done?NotesJiRA ticket /Confluence pageCritical (4.3.0)

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    		This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.
    High (4.3/4.4)VLA Metadata display updates. https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+UpdatesThis has many items including 'telescope observing logs'.

    7277


    √877 VLBA correlations with missing files entries

    Jira
    serverDMS JIRA
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7471


    √proprietary clock for VLBA dataMedium

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    6552

    		Mediumdone
    √VLBA Reingestion RefinementsVLA/VLBA proposal code degeneracy

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    5538

    5917

    		ongoing → done
    √VLBA Polarization Duplication

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-73185640

    		done
    √String Terminators in VLBA fieldsMediumIndexing of VLA low band projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-71875641

    		done
    √BL473 unlock and missing segments

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7148

    		done
    √VLBA data structure in the new archive

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7076

    Jira

    Legacy VLA Data

    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,

    		Priority/Done?NotesJiRA ticket /Confluence pageHighMetadata Issues in Legacy VLA data

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7192

    		Needs input from BryanHighLegacy VLA data missing error codes in the new archive toolHighmetadata errors in VLBA (BD114) and old VLA data in new archive

    7182
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7191

    		Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.

    7183

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    7128

    7184
    Jira

    		done
    √USNO Proprietary Download System/A way to deliver data from projects that are not archived

    VLBASYS 1008

    		done





    VLA Metadata Presentation 

    Anchor
    VLAMetadata
    VLAMetadata

    7129
    Priority/Done?NotesJiRA ticket /Confluence page
    critical

    Scan list does not show coordinates between dec= 00 and dec = -1 correctly

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-

    		This has been split into two tickets: one VLBA and one VLA

    7620


    Critical (4.3.0)Make scanlist information useful Mediumlegacy VLA metadata error: EBs that claim to have run for 2+ days

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7129

    		requires re-ingestion

    Data Integrity

    Gap Analysis Between Legacy and New ArchiveSSA6222Example ticket of a silent failure: -8345-36eee8a98f01

    7188
     https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

    JT: revise to capture what we want about the frequency/setup information

    		This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.
    High (4.3/4.4)VLA Metadata display updates. Priority/Done?NotesJiRA ticket /Confluence pageBlocker

    https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    key

    WS-1390

    		This has many items including 'telescope observing logs'.
    Medium

    Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

    		can be done once RLSW finishes the AIPSFITS filesCriticalAutomated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7190
    https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools
    7318


    MediumVLA/VLBA proposal code degeneracyCriticalDisplay of archive ingestion/observation issues
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7189
    		related to SSA-7190CriticalIdentification of ingestion problems and automaticallyfix
    5538

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e

    -8345-36eee8a98f01
    keySSA-7318


    MediumIndexing of VLA low band projects

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7187


    √

    Subscans table holding both Radian and Degree positions

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-5275

    		done
    √archive search returning incorrect projects
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6192


    		done





    Legacy VLA Data

    Anchor
    Legacy
    Legacy

    Priority/Done?NotesJiRA ticket /Confluence page
    Criticalcorrupt legacy VLA data in the AAT

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7628


    HighMetadata Issues in Legacy VLA data

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7192

    		Needs input from Bryan
    HighLegacy VLA data missing error codes in the new archive tool

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7191

    		Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.
    Highmetadata errors in VLBA (BD114) and old VLA data in new archive
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7128

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7129

    		This has been split into two tickets: one VLBA and one VLA
    Mediumlegacy VLA metadata error: EBs that claim to have run for 2+ days

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7129

    		requires re-ingestion


    Data Integrity

    Anchor
    Integrity
    Integrity

    Priority/Done?NotesJiRA ticket /Confluence page
    BlockerGap Analysis Between Legacy and New Archive
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6222


    		can be done once RLSW finishes the AIPSFITS files
    CriticalAutomated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7190
    https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools


    CriticalDisplay of archive ingestion/observation issues
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7189


    		related to SSA-7190
    CriticalIdentification of ingestion problems and automatically fix

    Example ticket of a silent failure: 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7566

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-7665


    √create missing db entries for Flag.xml
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6273


    		Done
    √fix ASDM.xml files missing FlagTable entities
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    keySSA-6274


    		Done


    DA Tools for Data Editing

    Anchor
    DATools
    DATools

    key,summary,type

    Priority/Done?NotesJiRA ticket /Confluence page
    √Tool for setting Proprietary Period of science observations on the VLA and the VLBAhttps://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA
    CriticalDA annotation tools/Archive data annotation tools
    keySSA-7566
    √create missing db entries for Flag.xml

    https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools 

    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
    columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01
    key

    SSA

    WS-

    6273    		Done√fix ASDM.xml files missing FlagTable entities

    1392
    Jira
    serverDMS JIRA
    columnIdsissuekey,summary,issuetype

    ,created,updated,duedate,assignee,reporter,priority,status,resolution    		columns
    ,created,updated,

    due

    duedate,assignee,reporter,priority,status,resolution

    serverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-6274Done