Page History

Below is a list of items that are priorities for Archive implementation, some of these are Legacy AAT retirement tickets, others are new development. The order in the tables is in priority order.

Main topics (click link to jump to section in page):

Data Delivery

Search/Data Selection

VLBA-specific

VLA(VLBA) Metadata presentation

Legacy VLA Data

Data Integrity

DA Tools

Missing Data

Other

ALMA

Product Versioning

Data Delivery

Anchor

	DataDelivery
	DataDelivery

Priority/Done?NoteshighScriptable query interfaceScriptable Query Interface to NRAO Archive JiraserverDMS JIRAserverId DMS JIRASSA7421Put warning that only one CMS at a time can be requested in AATSSA7106Bulk download of Calibration tarballsSSA7353SSA6083disable checksums by default7343

Priority/Done?

Notes

JiRA ticket /Confluence page

highCritical

Downloads via Scriptable query interface

Scriptable Query Interface to NRAO Archive

high (4.2.0)

The email sent by the archive tool will include the wget command in the near future.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

Jira

server

key

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

WS-

1395

highcritical

A friendly error is needed when a users is not authorized to access proprietary data.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7474

confusing to staff as well

medium

-need to kill RH, WS 3.0+

critical

Restore data using same version of CASA as calibrated

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

WS-1405

medium

Put warning that only one CMS at a time can be requested in AAT

could be a flyover text (currently has a flyover circle with slash)

for pipeline

option to return UNTAR'd file does not work

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6495https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

pipeline topic

7106

could be a flyover text (currently has a flyover circle with slash)

high (WS 2.8/2.9)

high

Clean up the nested directory data delivery mess

legacy VLA data deliveries are one level deeper in directories than an SDM

*May need revisions to account for VLBA differences.

Delivery Directory Improvements

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7000

WS 2.7 or 3.0?

planned attempted for 4.2.0 but is deferred2

Don't restrict download number limit.

New ticket to remove the '/100 string from webpage'

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7352

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7436

We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.

4.2.1

Fix select-all functionality

Always have select all available (only displayed files/SDM or from all pages)

make select-all work properly with select/deselect

NEW TICKET

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7573

medium

Download weblogs directly (and/or serve them as well!)

medium

Download weblogs directly (and/or serve them as well!)

Direct weblog download from archive search return interface

medium

Direct weblog download from archive search return interface

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

low

Data Delivery times out if tar file(s) are too large/time consuming

WS-

low

archive should ask for confirmation to continue if the download or processing job is considered large

To be requested

The front end can show size estimates for various products.

1388

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

WS-

1389

!

medium

Bulk download of Calibration tarballs

Jira

will not be an issue with taring not being the default.

low

archive-new delivery not chmod'd/chowned

jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5096

√

7353

low

archive should ask for confirmation to continue if the download or processing job is considered large

To be requested

The front end can show size estimates for various products.

low

Data Delivery times out if tar file(s) are too large/time consumingopen up local delivery restrictions (to /home and /lustre).

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7179The part related to opening the download destination to nm-### accounts on lustre is

6083

will not be an issue with taring not being the default.

low

archive-new delivery not chmod'd/chowned

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7345

This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!

√

5096

√ 2022.2 pipeline

option to return UNTAR'd file does not work

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6495

https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

pipeline topic

√ (4.2.0)

The email sent by the archive tool will include the wget command in the near future.

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

√

open up local delivery restrictions (to /home and /lustre).

Jira

columns
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution

√

make tar downloads default to 'off'

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7344

Search interface/Data Selection

7179

The part related to opening the download destination to nm-### accounts on lustre is

Jira

serverId
server	DMS JIRA

high

Fix Frequency-dependent FOV and position searches

exact same feature as legacy archive, must select to do the freq. dependent FOV
legacy archive has this feature

Jira

eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7395

7345

This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!

√

disable checksums by default

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

4915

7343

√

make tar downloads default to 'off'

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7344

Search interface/Data Selection

Anchor

	Search
	Search

74977496Allow search filtering based on total time on source.7424

Priority/Done?

Notes

high

Fix Frequency-dependent FOV and position searches

exact same feature as legacy archive, must select to do the freq. dependent FOV
legacy archive has this feature

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,

high

Position searches provide distance from searched position and sort by distance

legacy archive feature

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7387

User request, but is a legacy AAT feature

medium

Treat wild cards consistently in AAT search interface

account for * in source names

4915

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7497

high (4.2.2)

Position searches provide distance from searched position and sort by distance

legacy archive feature

low

Allow search return of observation scans?

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7388

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

high

7387

User request, but is a legacy AAT feature

medium

Treat wild cards consistently in AAT search interface

account for * in source names

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7496

low

Allow search return of observation scans?

Jira

Based on legacy archive helpdisk question from user. UC feedback as well.

√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

Doesn't fully solve problem see also

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7352

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

VLBA Stuff

7388

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

high

Allow search filtering based on total time on source.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

Priority/Done?

Notes

JiRA ticket /Confluence page

High

Add wget command in emails generated by the AAT upon downloading data

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-74217424

Based on legacy archive helpdisk question from user. UC feedback as well.

medium

Fix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scan)

High

VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

proprietary period setter:

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA

WS-

7350

needs follow up, some things are inconsistent (especially the topic of the tool's readiness to change the proprietary period of VLBA data).

High

1365

Rearrange boxes in 'Search Inputs'

Ticket to be created.

√ (4.2.0)

Scriptable query interface

VLBA+EVLA projects without metadata and sometimes also mismatched PI

Scriptable Query Interface to NRAO Archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7423

High

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7395

√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

Doesn't fully solve problem see also

Proxy issue for huge VLBA projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-74367352

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

VLBA Stuff

Anchor

	VLBA
	VLBA

VLBA data structure in the new archive - improved interface7185

Confluence: GUI (segment hierarchy) for VLBA data in the new archive

6552VLBA Reingestion Refinements5917VLBA Polarization Duplication5640String Terminators in VLBA fields5641BL473 unlock and missing segments7148VLBA data structure in the new archiveissuekey707671827375

Priority/Done?

Notes

JiRA ticket /Confluence page

High

VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED
Current tools should be able to add PI for USNO

https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

Med

Wrong band designation in VLBA data (old data only?)

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7420

This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.

Med

For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket

proprietary period setter:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7185 but needs to be picked up in future AAT releases

New JIRA ticket not yet created.

7350

The VLBA DA tools for changing PI and setting proprietary period have been complete for some time. The confluence page also mentions a tool for annotations; maybe that part should be moved to the Data Integrity section?

High

VLBA+EVLA projects without metadata and sometimes also mismatched PI

Med

Default Instrument of VLBA projects in AAT/PPI

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7208

Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

7423

High (4.2.1)

Proxy issue for huge

Low

Add PTF link in Project View for VLBA projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7461

Low

7436

High (4.2.1)

Slow VLBA indexingImport remaining 8 GMVA files

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7438

Low

Mark4 files with 0 length getting added to new archive metadata

7563

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7297

Small number of files affected.

Low

7541

Med

Wrong band designation in VLBA data (old data only?Incomplete VLBA data of observations crossing midnight (open in case more cases show up)

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6916

Low

7420

This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.

Med

Create USNO download acknowledgement

For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6952

4.1.1

import FITSAIPS files without matching projects (51 files) and project GP0024

7185
but needs to be picked up in future AAT releases

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-74267609

Ticket created Anna Kapinska, Emmanuel Momjian, and Anthony Sowinski should check it to make sure it's correct and specifies all requirements.

Med

Default Instrument of VLBA projects in AAT/PPI

4.1.1

Add FITSAIPS files to new archive and segment association

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7328

4.1.1

7208

And a new ticket created:

old VLBA project metadata issues

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7379

4.1.1

7619

Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

Med

Add PFT (proposal finder tool) link in Project View for VLBA projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7461

Low

Import remaining 8 GMVA files

√

877 VLBA correlations with missing files entries

Jira

server

DMS JIRA

Jira

server	DMS JIRA	serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7471

√

proprietary clock for VLBA data

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7438

done

√

Low

Mark4 files with 0 length getting added to new archive metadata

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

ongoing → done

√

7297

Small number of files affected.

Low

Incomplete VLBA data of observations crossing midnight (open in case more cases show up)

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6916

done

√

High

Create USNO download acknowledgement

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6952

done

√

(reopened) Low?

Remove Legacy Archive label and link from new archive

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7375

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

done

√

7627

Update (26-Sep-2022, Anna): the link is still present on some of the AAT subpages, especially the download status page when request for data is submitted.

The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

√ 4.2.0

Add wget command in emails generated by the AAT upon downloading data

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

√ 4.1.1

import FITSAIPS files without matching projects (51 files) and project GP0024

Jira

server	DMS JIRA
columnIds	issuekey

columnIds

,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7426

√ 4.1.1

Add FITSAIPS files to new archive and segment association

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7328

√ 4.1.1

old VLBA project metadata issues

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7379

√ 4.1.1

VLBA data structure in the new archive - improved interface

7183

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7185

Confluence: GUI (segment hierarchy) for VLBA data in the new archive

√ (4.1.1)

Database has zeros for min/max frequencies for some archive files

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7184

done

7277

√

USNO Proprietary Download System/A way to deliver data from projects that are not archived

VLBASYS 1008

done

877 VLBA correlations with missing files entries

√

Remove Legacy Archive label and link from new archive

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

VLA Metadata Presentation

7188 https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates731872775275archive search returning incorrect projects6192

7471

√

proprietary clock for VLBA data

Priority/Done?

Notes

JiRA ticket /Confluence page

Make scanlist information useful

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.

VLA Metadata display updates.

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

This has many items including 'telescope observing logs'.

6552

done

√

VLBA Reingestion Refinements

Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

Jira

server

Jira

server

DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-5917

ongoing → done

√

VLBA Polarization Duplication

VLA/VLBA proposal code degeneracy

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5538

5640

done

√

String Terminators in VLBA fields

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-73185641

done

√

BL473 unlock and missing segmentsIndexing of VLA low band projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7187

Database has zeros for min/max frequencies for some archive files

7148

done

√

VLBA data structure in the new archive

√

Subscans table holding both Radian and Degree positions

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7076

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

done

√

Priority/Done?

Notes

JiRA ticket /Confluence page

Metadata Issues in Legacy VLA data

7182

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

done

Legacy VLA Data

Legacy VLA data missing error codes in the new archive tool

7183

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7192

Needs input from Bryan

7184

done

√

USNO Proprietary Download System/A way to deliver data from projects that are not archived

VLBASYS 1008

done

VLA Metadata Presentation

Anchor

	VLAMetadata
	VLAMetadata

7191metadata errors in VLBA (BD114) and old VLA data in new archive7128issuekey,summarySSA7129 been split into two tickets: one VLBA and one VLA

Priority/Done?

Notes

JiRA ticket /Confluence page

critical

Scan list does not show coordinates between dec= 00 and dec = -1 correctly

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.

7620

Critical (4.3.0)

Make scanlist information useful

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7188

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

JT: revise to capture what we want about the frequency/setup information

This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.

High (4.3/4.4)

VLA Metadata display updates.

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

Jira

server	DMS JIRA
columnIds	issuekey,summary

Jira

server

DMS JIRA

columnIds

key
,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

WS-

1390

This has many items including 'telescope observing logs'.

Medium

Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

legacy VLA metadata error: EBs that claim to have run for 2+ days

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7129

requires re-ingestion

Data Integrity

Automated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data7190https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

7318

Medium

VLA/VLBA proposal code degeneracy

Priority/Done?

Notes

JiRA ticket /Confluence page

Gap Analysis Between Legacy and New Archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6222

can be done once RL finishes the AIPSFITS files

5538

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7318

Medium

Indexing of VLA low band projects

Display of archive ingestion/observation issues

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b

-a83a-387e-8345-36eee8a98f01

key

SSA-7189

related to SSA-7190

√

-a83a-387e-8345-36eee8a98f01
key	SSA-7187

√

Subscans table holding both Radian and Degree positions

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-5275

done

√

archive search returning incorrect projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6192

done

Legacy VLA Data

Anchor

	Legacy
	Legacy

Priority/Done?

Notes

JiRA ticket /Confluence page

Critical

corrupt legacy VLA data in the AAT

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7628

High

Metadata Issues in Legacy VLA data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7192

Needs input from Bryan

High

Legacy VLA data missing error codes in the new archive tool

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7191

Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.

High

metadata errors in VLBA (BD114) and old VLA data in new archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7128

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7129

This has been split into two tickets: one VLBA and one VLA

Medium

legacy VLA metadata error: EBs that claim to have run for 2+ days

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7129

requires re-ingestion

Data Integrity

Anchor

	Integrity
	Integrity

Priority/Done?

Notes

JiRA ticket /Confluence page

Blocker

Gap Analysis Between Legacy and New Archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6222

can be done once RLSW finishes the AIPSFITS files

Critical

Automated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7190

https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

Critical

Display of archive ingestion/observation issues

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7189

related to SSA-7190

Critical

Identification of ingestion problems and automatically fix

Example ticket of a silent failure:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7566

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7665

√

create missing db entries for Flag.xml

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6273

Done

√

fix ASDM.xml files missing FlagTable entities

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6274

Done

DA Tools for Data Editing

Anchor

	DATools
	DATools

Priority/Done?

Notes

JiRA ticket /Confluence page

√

Tool for setting Proprietary Period of science observations on the VLA and the VLBA

https://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA

Critical

DA annotation tools/Archive data annotation tools

create missing db entries for Flag.xml

https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-6273

Done

√

fix ASDM.xml files missing FlagTable entities

WS-1392

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-6274

Done

WS-1393

WS

Missing Data

Anchor

	Missing
	Missing

DA Tools for Data Editing

Priority/Done?	Notes	JiRA ticket /Confluence page
Critical	VLA/VLBA Image archive contents should be migrated into AAT (https://archive	Tool for setting Proprietary Period of science observations on the VLA and the VLBA	https://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA	DA annotation tools/Archive data annotation tools	https://open-confluence .nrao.edu/ display/SRDP/Archive+Data+Annotation+Tools

Missing Data

VLA/VLBA Image archive contents should be migrated into AAT (https://archive.nrao.edu/archive/archiveimage.html)

archive/archiveimage.html)

Tix to be created

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1394

May require discussion about how new archive will display images and the uvfits datasets.

High

Priority/Done?

Notes

JiRA ticket /Confluence page

ALMA Standard images into AAT

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7278

High

Large project support - ALFALFA + Other collection ingest

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7437

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-5712

ALFALFA: SRAO and Collection Support

Other

Anchor

	Other
	Other

EM submitting ticket

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Other tickets (so they are not forgotten)

https://open-jira.nrao.edu/issues/?filter=11464.edu/issues/?filter=11464

Tickets remaining are listed throughout their respective categories.

Critical

Proposal Contact Author not added to data.nrao.edu database

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7465

Bug when a project uses different PI and Contact Author

Medium

Preserve login between AAT and my.nrao.edu

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution	server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7465

Bug when a project uses different PI and Contact Author

7322

√ (4.2.0)

Remove pop-up page when accessing dataPreserve login between AAT and my.nrao.edu

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7322

Remove pop-up page when accessing data.nrao.edu

7502

ALMA

Anchor

	ALMA
	ALMA

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Critical

ALMA MOUS/calibration ingest unreliable; ALMA butler implementation into production

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7482

Product Versioning

Anchor

	Versioning
	Versioning

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Critical

Need to allow multiple versions of products (images/calibrations) in the archive

Product Versioning and Replacement Design

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6476

...

Space shortcuts

Page tree

Versions Compared

Old Version 28

New Version Current

Key