Page History

Below is a list of items that are priorities for Archive implementation, some of these are Legacy AAT retirement tickets, others are new development. The order in the tables is in priority order.

Main topics (click link to jump to section in page):

Data Delivery

Search/Data Selection

VLBA-specific

VLA(VLBA) Metadata presentation

Legacy VLA Data

Data Integrity

DA Tools

Missing Data

Other

ALMA

Product Versioning

Data Delivery

Anchor

	DataDelivery
	DataDelivery

Priority/Done?

Notes

JiRA ticket /Confluence page

Critical

Downloads via Scriptable query interface

Scriptable Query Interface to NRAO Archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,

The goal of this page is to compile both issues with the New Archive (AAT) and features the Legacy Archive (LA) has but not the AAT. The issues posted will be reviewed by John Tobin and Anna Kapinska (archive sub-system scientists) for submission as Jira tickets or submission of a requested development project for SSA planning. See the example for an issue posting below, we ask that whomever records an issue put their name and date along side it such that we can reach out if further information is needed.

Example:

The AAT does not allow me to do X, while in the LA this can be accomplished by doing Y. (John Tobin; 02/25/2022)
- Example data 1
- Example data 2

Real recorded issues start here:

...

key
due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

...

WS-

...

1395

critical

A friendly error is needed when a users is not authorized to access proprietary data.

...

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

...

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

...

7474

confusing to staff as well

-need to kill RH, WS 3.0+

critical

Restore data using same version of CASA as calibrated

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,

...

key
created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

...

WS-

...

1405

medium

Put warning that only one CMS at a time can be requested in AAT

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

...

7106

could be a flyover text (currently has a flyover circle with slash)

high (WS 2.8/2.9)

Clean up the nested directory data delivery mess

legacy VLA data deliveries are one level deeper in directories than an SDM

*May need revisions to account for VLBA differences.

Delivery Directory Improvements

...

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

...

7000

WS 2.7 or 3.0?

planned 4.2.2

Don't restrict download number limit.

New ticket to remove the '/100 string from webpage'

Jira

server

DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7352

...

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,

...

updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

...

7436

We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.

4.2.1

Fix select-all functionality

Always have select all available (only displayed files/SDM or from all pages)

make select-all work properly with select/deselect

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

...

7573

medium

Download weblogs directly (and/or serve them as well!)

Direct weblog download from archive search return interface

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1388

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

...

WS-1389

!

medium

Bulk download of Calibration tarballs

Issues already in JIRA/Confluence:

Done?TitleJiRA ticket /Confluence pageDetailsimport FITSAIPS files without matching projects (51 files)

Add FITSAIPS files to new archive

Jiraserver

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7426

7353

low

archive should ask for confirmation to continue if the download or processing job is considered large

To be requested

The front end can show size estimates for various products.

low

Data Delivery times out if tar file(s) are too large/time consuming

Jira

server

DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7328old VLBA project metadata issues

6083

will not be an issue with taring not being the default.

low

archive-new delivery not chmod'd/chowned

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7379Wrong band designation in VLBA data (old data only?)Add wget command in emails generated by the AAT upon downloading data JiraserverDMS JIRA

5096

√ 2022.2 pipeline

option to return UNTAR'd file does not work

Jira

server	DMS JIRA

serverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-7420this is in both the legacy archive and the new archive tool.

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7421√Remove Legacy Archive label and link from new archive

6495

https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

pipeline topic

√ (4.2.0)

The email sent by the archive tool will include the wget command in the near future.

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7375The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

7421

√

open up local delivery restrictions (to /home and /lustre).

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due

attempted for 4.2.0 but is deferredDon't restrict download number limit. JiraserverDMS JIRAcolumnIdsissuekey,summary,issuetype,created,updated,duedate

,assignee,reporter,priority,status,resolution

columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7179

The part related to opening the download destination to nm-### accounts on lustre is

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7352We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.4.1.1

7345

This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!

√

disable checksums by default

open up local delivery restrictions (to /home and /lustre).

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7179The part related to opening the download destination to nm-### accounts on lustre is

7343

√

make tar downloads default to 'off'

Jira

server	DMS JIRA

serverIdeb2e750b-a83a-387e-8345-

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7345This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!4.1.1disable checksums by default

7344

Search interface/Data Selection

Anchor

	Search
	Search

Priority/Done?

Notes

high

Fix Frequency-dependent FOV and position searches

exact same feature as legacy archive, must select to do the freq. dependent FOV
legacy archive has this feature

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

73434.1.1make tar downloads default to 'off'

4915

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7344archive-new delivery not chmod'd/chowned

7497

high (4.2.2)

Position searches provide distance from searched position and sort by distance

legacy archive feature

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5096Bulk download of Calibration tarballs

7387

User request, but is a legacy AAT feature

medium

Treat wild cards consistently in AAT search interface

account for * in source names

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7353legacy VLA data deliveries are one level deeper in directories than an SDM

7496

low

Allow search return of observation scans?

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7000Will happen with workspaces later

7388

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

high

Allow search filtering based on total time on source.

metadata errors in VLBA (BD114) and old VLA data in new archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7128

7424

Based on legacy archive helpdisk question from user. UC feedback as well.

medium

Fix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scan)

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA

WS-

7129This has been split into two tickets: one VLBA and one VLAVLA/VLBA proposal code degeneracy

1365

Rearrange boxes in 'Search Inputs'

Ticket to be created.

√ (4.2.0)

Scriptable query interface

Scriptable Query Interface to NRAO Archive

Jira

server	DMS JIRA

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-5538


serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7395

√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

Doesn't fully solve problem see also

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7318√create missing db entries for Flag.xml JiraserverDMS JIRAcolumnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumnskey,summary,type,created,updated,due,

7352

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

VLBA Stuff

Anchor

	VLBA
	VLBA

Priority/Done?

Notes

JiRA ticket /Confluence page

High

VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED
Current tools should be able to add PI for USNO

https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

proprietary period setter:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution

serverIdeb2e750b

columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6273Done√fix ASDM.xml files missing FlagTable entities

7350

The VLBA DA tools for changing PI and setting proprietary period have been complete for some time. The confluence page also mentions a tool for annotations; maybe that part should be moved to the Data Integrity section?

High

VLBA+EVLA projects without metadata and sometimes also mismatched PI

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6274DoneGap Analysis Between Legacy and New Archive

7423

High (4.2.1)

Proxy issue for huge VLBA projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6222can be done once RL finishes the AIPSFITS filesPut warning that only one CMS at a time can be requested in AATcould be a flyover textData Delivery times out if tar file(s) are too large/time consuming

7436

High (4.2.1)

Slow VLBA indexing

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7106

7563

will not be an issue with taring not being the default.√archive search returning incorrect projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6083

7541

Med

Wrong band designation in VLBA data (old data only?)

Jira

server	DMS JIRA

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumns

key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6192done√VLBA data structure in the new archive

7420

This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.

Med

For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7076 Jiraserver

7185
but needs to be picked up in future AAT releases

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7182

7609

Ticket created Anna Kapinska, Emmanuel Momjian, and Anthony Sowinski should check it to make sure it's correct and specifies all requirements.

Med

Default Instrument of VLBA projects in AAT/PPI

Jira

server

DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7183

7208

And a new ticket created:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7184doneVLBA data structure in the new archive - improved interface

7619

Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

Med

Add PFT (proposal finder tool) link in Project View for VLBA projects

Jira

server	DMS JIRA

serverId

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7185

Confluence: GUI (segment hierarchy) for VLBA data in the new archive

Default Instrument of VLBA projects in AAT/PPIproprietary period setter:

7461

Low

Import remaining 8 GMVA files

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7208

Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

7438

Low

Mark4 files with 0 length getting added to new archive metadata

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7350needs follow up, somethings are inconsistent (especially the topic of the tool's readiness to change the proprietary period of VLBA data).proprietary clock for VLBA data

7297

Small number of files affected.

Low

Incomplete VLBA data of observations crossing midnight (open in case more cases show up)

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6552should have been done for 4.1.0. Stephan will follow up to confirm.

6916

High

Create USNO download acknowledgement

VLBA Reingestion Refinements

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5917

6952

ongoing

√

Subscans table holding both Radian and Degree positions

(reopened) Low?

Remove Legacy Archive label and link from new archive

Jira

server	DMS JIRA

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverIdeb2e750b-a83a-387edone√VLBA Polarization Duplication

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5275

7375

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5640doneIncomplete VLBA data of observations crossing midnight (open in case more cases show up)

7627

Update (26-Sep-2022, Anna): the link is still present on some of the AAT subpages, especially the download status page when request for data is submitted.

The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

√ 4.2.0

Add wget command in emails generated by the AAT upon downloading data

Jira

server	DMS JIRA

columnIdsissuekey,summary,issuetype,

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

√ 4.1.1

import FITSAIPS files without matching projects (51 files) and project GP0024

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6916

7426

√

4.1.1

Add FITSAIPS files to new archive and segment association

String Terminators in VLBA fields

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5641done

7328

√

4.1.1

old VLBA project metadata issues

BL473 unlock and missing segments

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7148doneAutomated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

7379

√ 4.1.1

VLBA data structure in the new archive - improved interface

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7185

Confluence: GUI (segment hierarchy) for VLBA data in the new archive

√ (4.1.1)

Database has zeros for min/max frequencies for some archive files

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7190https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

7277

√

877 VLBA correlations with missing files entries

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7471

√

proprietary clock for VLBA data

√USNO Proprietary Download System/A way to deliver data from projects that are not archived

VLBASYS 1008

doneLegacy VLA data missing error codes in the new archive tool

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7191Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.

6552

done

√

VLBA Reingestion Refinements

Make scanlist information useful

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7188 https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+UpdatesThis ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.archive should ask for confirmation to continue if the download or processing job is considered largeTo be requestedThe front end can show size estimates for various products.Tool for setting Proprietary Period of science observations on the VLA and the VLBAhttps://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA

5917

ongoing → done

√

VLBA Polarization Duplication

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due

DA annotation tools/Archive data annotation toolshttps://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+ToolsCreate USNO download acknowledgement JiraserverDMS JIRAcolumnIdsissuekey,summary,issuetype,created,updated,duedate

,assignee,reporter,priority,status,resolution

columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverIdeb2e750b-a83a-

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6952legacy VLA metadata error: EBs that claim to have run for 2+ days

5640

done

√

String Terminators in VLBA fields

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7129requires re-ingestionoption to return UNTAR'd file does not work pipeline topicIndexing of VLA low band projects

5641

done

√

BL473 unlock and missing segments

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6495https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

7148

done

√

VLBA data structure in the new archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7187Display of archive ingestion/observation issuesrelated to SSA-7190Metadata Issues in Legacy VLA data

7076

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7189

7182

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7192Needs input from BryanVLA Metadata display updates. https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+UpdatesThis has many items including 'telescope observing logs'.

Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

JiraserverDMS JIRAcolumnIds

7183

Jira

columnIds
server	DMS JIRA

issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7184

done

√

USNO Proprietary Download System/A way to deliver data from projects that are not archived

VLBASYS 1008

done

VLA Metadata Presentation

Anchor

	VLAMetadata
	VLAMetadata

7318Mark4 files with 0 length getting added to new archive metadata Jiraserver

Priority/Done?

Notes

JiRA ticket /Confluence page

critical

Scan list does not show coordinates between dec= 00 and dec = -1 correctly

Jira

server

DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7297Small number of files affected.Database has zeros for min/max frequencies for some archive files

7620

Critical (4.3.0)

Make scanlist information useful

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7277Other tickets (so they are not forgotten)

7188

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

JT: revise to capture what we want about the frequency/setup information

This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.

High (4.3/4.4)

VLA Metadata display updates.

https://open-

jiraFrequency-dependent FOV searches

confluence.nrao.edu/

issues/?filter=11464Position searches provide distance from searched position

display/SRDP/VLA+Metadata+Display+Updates

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-4915

WS-1390

This has many items including 'telescope observing logs'.

Medium

Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7387User request, but is a legacy AAT featureAllow search return of observation scans?

7318

Medium

VLA/VLBA proposal code degeneracy

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7388

5538

Jira

server	DMS

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

Allow search filtering based on integration time.

JiraserverDMS

JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7424Based on legacy archive helpdisk question from user.Proposal Contact Author not added to data.nrao.edu database

7318

Medium

Indexing of VLA low band projects

Jira

server	DMS JIRA

serverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-7465Bug when a project uses different PI and Contact Author

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

877 VLBA correlations with missing files entries JiraserverDMS JIRA


serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7471A friendly error is needed when a users is not authorized to access proprietary data.Web pageWeb linkJIRA ticket (if applicable)my.nrao.edu dashboard (Under My Information - My Data)https://my.nrao.edu/nrao-2.0/secure/Home.htm?index=1

7187

√

Subscans table holding both Radian and Degree positions

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7474

For completeness, in the table below we give web pages that will not work once the legacy archive becomes internal only (we can move this to another confluence page if needed)

5275

done

√

archive search returning incorrect projects

Jira

server	DMS JIRA

serverId

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7317

6192

done

Legacy VLA Data

Anchor

	Legacy
	Legacy

Priority/Done?

Notes

JiRA ticket /Confluence page

Critical

corrupt legacy VLA data in the AAT

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7322

7628

High

Metadata Issues in Legacy VLA data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7192

Needs input from Bryan

High

Legacy VLA data missing error codes in the new archive tool

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7191

Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.

High

metadata errors in VLBA (BD114) and old VLA data in new archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7128

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7129

This has been split into two tickets: one VLBA and one VLA

Medium

legacy VLA metadata error: EBs that claim to have run for 2+ days

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7129

requires re-ingestion

Data Integrity

Anchor

	Integrity
	Integrity

Priority/Done?

Notes

JiRA ticket /Confluence page

Blocker

Gap Analysis Between Legacy and New Archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6222

can be done once RLSW finishes the AIPSFITS files

Critical

Automated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7190

https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

Critical

Display of archive ingestion/observation issues

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7189

related to SSA-7190

Critical

Identification of ingestion problems and automatically fix

Example ticket of a silent failure:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7566

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7665

√

create missing db entries for Flag.xml

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6273

Done

√

fix ASDM.xml files missing FlagTable entities

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6274

Done

DA Tools for Data Editing

Anchor

	DATools
	DATools

Priority/Done?

Notes

JiRA ticket /Confluence page

√

Tool for setting Proprietary Period of science observations on the VLA and the VLBA

https://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA

Critical

DA annotation tools/Archive data annotation tools

https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1392

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1393

WS

Missing Data

Anchor

	Missing
	Missing

Priority/Done?

Notes

JiRA ticket /Confluence page

Critical

VLA/VLBA Image archive contents should be migrated into AAT (https://archive.nrao.edu/archive/archiveimage.html)

Tix to be created

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1394

May require discussion about how new archive will display images and the uvfits datasets.

High

ALMA Standard images into AAT

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7278

High

Large project support - ALFALFA + Other collection ingest

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7437

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-5712

ALFALFA: SRAO and Collection Support

Other

Anchor

	Other
	Other

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Other tickets (so they are not forgotten)

https://open-jira.nrao.edu/issues/?filter=11464

Tickets remaining are listed throughout their respective categories.

Critical

Proposal Contact Author not added to data.nrao.edu database

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7465

Bug when a project uses different PI and Contact Author

Medium

Preserve login between AAT and my.nrao.edu

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7322

√ (4.2.0)

Remove pop-up page when accessing data.nrao.edu

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7502

ALMA

Anchor

	ALMA
	ALMA

VLA plone pageshttps://science.nrao.edu/facilities/vla/archive/indexSW provided a wget example to be added to the science webpage. We need to add this example to the plone page, see the ticket SSA-7421 for the example. The email sent by the archive tool will include the wget command in the near future. JiraserverDMS JIRA

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Critical

ALMA MOUS/calibration ingest unreliable; ALMA butler implementation into production

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7421VLBA plone pageshttps://science.nrao.edu/facilities/vlba/facilities/data-archive/indexSW provided a wget example to be added to the science webpages. We should include the example (see SSA-7421) in the plone pages (VLA, and VLBA). The email sent by the archive tool will include the wget command in the near future.

7482

Product Versioning

Anchor

	Versioning
	Versioning

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Critical

Need to allow multiple versions of products (images/calibrations) in the archive

Product Versioning and Replacement Design

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7421Computing guidehttps://info.nrao.edu/computing/guide/cluster-processing/data-storage-and-retrievalNumerous CASA Guides referencing the archivehttps://casaguides.nrao.edu/index.php?title=Main_Page

6476

Space shortcuts

Page tree

Versions Compared

Old Version 1

New Version Current

Key