Page History

Below is a list of items that are priorities for Archive implementation, some of these are Legacy AAT retirement tickets, others are new development. The order in the tables is in priority order (aside from VLBA at the moment).

Data Delivery

.

Main topics (click link to jump to section in page):

Data Delivery

Search/Data Selection

VLBA-specific

VLA(VLBA) Metadata presentation

Legacy VLA Data

Data Integrity

DA Tools

Missing Data

Other

ALMA

Product Versioning

Data Delivery

Anchor

	DataDelivery
	DataDelivery

Priority/Done?

Notes

JiRA ticket /Confluence page

Critical

Downloads via Scriptable query interface

Scriptable Query Interface to NRAO Archive

The email sent by the archive tool will include the wget command in the near future.

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

Jira

server

A friendly error is needed when a users is not authorized to access proprietary data. Jiraserver

key
	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA

WS-

7474Put warning that only one CMS at a time can be requested in AAT

1395

critical

A friendly error is needed when a users is not authorized to access proprietary data.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7106could be a flyover text

Clean up the nested directory data delivery mess

legacy VLA data deliveries are one level deeper in directories than an SDM

Delivery Directory Improvements

7474

confusing to staff as well

-need to kill RH, WS 3.0+

critical

Restore data using same version of CASA as calibrated

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA

WS-

7000attempted for 4.2.0 but is deferredDon't restrict download number limit.

1405

medium

Put warning that only one CMS at a time can be requested in AAT

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7352We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.Download weblogs directly (and/or serve them as well!)Direct weblog download from archive search return interfaceBulk download of Calibration tarballs

7106

could be a flyover text (currently has a flyover circle with slash)

high (WS 2.8/2.9)

Clean up the nested directory data delivery mess

legacy VLA data deliveries are one level deeper in directories than an SDM

*May need revisions to account for VLBA differences.

Delivery Directory Improvements

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7353archive should ask for confirmation to continue if the download or processing job is considered largeTo be requestedThe front end can show size estimates for various products.

7000

WS 2.7 or 3.0?

planned 4.2.2

Don't restrict download number limit.

New ticket to remove the '/100 string from webpage'

Data Delivery times out if tar file(s) are too large/time consuming

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6083will not be an issue with taring not being the default.archive-new delivery not chmod'd/chowned

7352

Jiraserver

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5096option to return UNTAR'd file does not work

7436

We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.

4.2.1

Fix select-all functionality

Always have select all available (only displayed files/SDM or from all pages)

make select-all work properly with select/deselect

Jira

server

DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6495https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloadspipeline topic4.1.1

7573

medium

Download weblogs directly (and/or serve them as well!)

Direct weblog download from archive search return interface

open up local delivery restrictions (to /home and /lustre).

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA

WS-

7179The part related to opening the download destination to nm-### accounts on lustre is

1388

Jira

server	DMS JIRA

serverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-7345This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!


columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due

4.1.1disable checksums by default JiraserverDMS JIRAcolumnIdsissuekey,summary,issuetype,created,updated,duedate

,assignee,reporter,priority,status,resolution

columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverIdeb2e750b

key
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA

WS-

7343

1389

!

medium

Bulk download of Calibration tarballs

4.1.1make tar downloads default to 'off'Priority/Done?NotesScriptable query interface

Scriptable Query Interface to NRAO Archive

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7395

Fix Frequency-dependent FOV and position searches

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7344

Search interface/Data Selection

7353

low

archive should ask for confirmation to continue if the download or processing job is considered large

To be requested

The front end can show size estimates for various products.

low

Data Delivery times out if tar file(s) are too large/time consuming

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

4915

6083

will not be an issue with taring not being the default.

low

archive-new delivery not chmod'd/chowned

Jira

server	DMS

JiraserverDMS

JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7497Position searches provide distance from searched position

5096

√ 2022.2 pipeline

option to return UNTAR'd file does not work

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7387User request, but is a legacy AAT featureTreat wild cards consistently in AAT search interface

6495

https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

pipeline topic

√ (4.2.0)

The email sent by the archive tool will include the wget command in the near future.

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

√

open up local delivery restrictions (to /home and /lustre).

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7496Allow search return of observation scans?

7179

The part related to opening the download destination to nm-### accounts on lustre is

Jira

server	DMS JIRA

columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution


serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7388

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

Allow search filtering based on integration time.

7345

This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!

√

disable checksums by default

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7424Based on legacy archive helpdisk question from user.√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

VLBA Stuff

7343

√

make tar downloads default to 'off'

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7344

Search interface/Data Selection

Anchor

	Search
	Search

Priority/Done?

Notes

high

Fix Frequency-dependent FOV and position searches

exact same feature as legacy archive, must select to do the freq. dependent FOV
legacy archive has this feature

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-4915

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7497

high (4.2.2)

Position searches provide distance from searched position and sort by distance

legacy archive feature

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7387

User request, but is a legacy AAT feature

medium

Treat wild cards consistently in AAT search interface

account for * in source names

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7496

low

Allow search return of observation scans?

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7388

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

high

Allow search filtering based on total time on source.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7424

Based on legacy archive helpdisk question from user. UC feedback as well.

medium

Fix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scan)

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1365

Rearrange boxes in 'Search Inputs'

Ticket to be created.

√ (4.2.0)

Scriptable query interface

Scriptable Query Interface to NRAO Archive

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7395

√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

Doesn't fully solve problem see also

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7352

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

VLBA Stuff

Anchor

	VLBA
	VLBA

-8345-36eee8a98f01Add wget command in emails generated by the AAT upon downloading 7421877 VLBA correlations with missing files entriesMark4 files with 0 length getting added to new archive metadata

Priority/Done?

Notes

JiRA ticket /Confluence page

High

VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED
Current tools should be able to add PI for USNO

https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

proprietary period setter:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7350

The VLBA DA tools for changing PI and setting proprietary period have been complete for some time. The confluence page also mentions a tool for annotations; maybe that part should be moved to the Data Integrity section?

High

VLBA+EVLA projects without metadata and sometimes also mismatched PI

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7423

High (4.2.1)

Proxy issue for huge VLBA projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7436

High (4.2.1)

Slow VLBA indexing

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7563

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7541

Med

Wrong band designation in VLBA data (old data only?)

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7420

This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.

Med

For observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7185

but needs to be picked up in future AAT releases

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7609

Ticket created Anna Kapinska, Emmanuel Momjian, and Anthony Sowinski should check it to make sure it's correct and specifies all requirements.

Med

Default Instrument of VLBA projects in AAT/PPI

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7208

And a new ticket created:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7619

Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

Med

Add PFT (proposal finder tool) link in Project View for VLBA projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7461

Low

Import remaining 8 GMVA files

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7438

Low

Mark4 files with 0 length getting added to new archive metadata

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7297

Small number of files affected.

Low

Incomplete VLBA data of observations crossing midnight (open in case more cases show up)

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6916

High

Create USNO download acknowledgement

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6952

√(reopened) Low?

Remove Legacy Archive label and link from new archive

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7375

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7627

Update (26-Sep-2022, Anna): the link is still present on some of the AAT subpages, especially the download status page when request for data is submitted.

The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

√ 4.2.0

Add wget command in emails generated by the AAT upon downloading data

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

√ 4.1.1

import FITSAIPS files without matching projects (51 files) and project GP0024

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7426

√ 4.1.1

Add FITSAIPS files to new archive and segment association

Priority/Done?

Notes

JiRA ticket /Confluence page

import FITSAIPS files without matching projects (51 files) and project GP0024

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7426

7328

√ 4.1.1

old VLBA project metadata issuesAdd FITSAIPS files to new archive and segment association

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7379

√ 4.1.1

VLBA data structure in the new archive - improved interface

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e

-8345-36eee8a98f01
key	SSA-7185

Confluence: GUI (segment hierarchy) for VLBA data in the new archive

√ (4.1.1)

Database has zeros for min/max frequencies for some archive files

key

SSA-7328

old VLBA project metadata issues

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7277

√

877 VLBA correlations with missing files entries7379Wrong band designation in VLBA data (old data only?)

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7420

this is in both the legacy archive and the new archive tool.

7471

√

proprietary clock for VLBA data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6552

done

√

VLBA Reingestion RefinementsFor observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7185 but needs to be picked up in future AAT releases

5917

ongoing → done

√

VLBA Polarization Duplication

Jira

server	DMS JIRA

serverId

eb2e750b-a83a-387e-8345-36eee8a98f01

key

SSA-7471

VLBA data structure in the new archive - improved interface

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7185

Confluence: GUI (segment hierarchy) for VLBA data in the new archive

5640

done

√

String Terminators in VLBA fieldsDefault Instrument of VLBA projects in AAT/PPI

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7208

Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

-8345-36eee8a98f01
key	SSA-5641

done

√

BL473 unlock and missing segments

VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

proprietary period setter:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA

-7350

needs follow up, somethings are inconsistent (especially the topic of the tool's readiness to change the proprietary period of VLBA data).

-7148

done

√

VLBA data structure in the new archiveproprietary clock for VLBA data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6552

should have been done for 4.1.0. Stephan will follow up to confirm.

VLBA Reingestion Refinements

7076

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-5917

ongoing

Small number of files affected.

Incomplete VLBA data of observations crossing midnight (open in case more cases show up)

7182

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-7297

SSA-7183

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-69167184

done

√Create USNO download acknowledgement

USNO Proprietary Download System/A way to deliver data from projects that are not archived

VLBASYS 1008

done

VLA Metadata Presentation

Anchor

	VLAMetadata
	VLAMetadata

VLBA Polarization Duplication-387e-8345-36eee8a98f01String Terminators in VLBA fieldsBL473 unlock and missing segments71487184Remove Legacy Archive label and link from new archive7375

Priority/Done?

Notes

JiRA ticket /Confluence page

critical

Scan list does not show coordinates between dec= 00 and dec = -1 correctly

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-6952

√

7620

Critical (4.3.0)

Make scanlist information useful

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a

key

SSA-5640

done

√

-387e-8345-36eee8a98f01
key	SSA-7188

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

JT: revise to capture what we want about the frequency/setup information

This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.

High (4.3/4.4)

VLA Metadata display updates.

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-5641

done

√

WS-1390

This has many items including 'telescope observing logs'.

Medium

Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7318

doneMedium

√

VLBA data structure in the new archiveVLA/VLBA proposal code degeneracy

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7076

5538

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-71827318

Medium

Indexing of VLA low band projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-71837187

√

Subscans table holding both Radian and Degree positions

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

done

√

USNO Proprietary Download System/A way to deliver data from projects that are not archived

VLBASYS 1008

done

5275

done

√

archive search returning incorrect projects

√

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

The new archive has a link to the legacy archive at the top. This needs to be removed since the legacy archive will not be accessible from outside.

6192

done

Legacy VLA Data

Anchor

	Legacy
	Legacy

VLA Metadata Presentation

Incorrect metadata sometimes displayed for projects with duplicate proposal IDs between VLA and VLBA-7318

Priority/Done?

Notes

JiRA ticket /Confluence pageMake scanlist information useful

Critical

corrupt legacy VLA data in the AAT

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7188

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

This ticket has multiple points to make the new tool match the Legacy archive and to have the displayed data be much more useful.

VLA Metadata display updates.

https://open-confluence.nrao.edu/display/SRDP/VLA+Metadata+Display+Updates

This has many items including 'telescope observing logs'.

-a83a-387e-8345-36eee8a98f01
key	SSA-7628

High

Metadata Issues in Legacy VLA data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA

-7192

Needs input from Bryan

High

Legacy VLA data missing error codes in the new archive toolVLA/VLBA proposal code degeneracy

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

5538

7191

Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.

High

metadata errors in VLBA (BD114) and old VLA data in new archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7318

Indexing of VLA low band projects

7128

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7187

key	SSA-7129

This has been split into two tickets: one VLBA and one VLA

Medium

legacy VLA metadata error: EBs that claim to have run for 2+ daysDatabase has zeros for min/max frequencies for some archive files

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7277

√

7129

requires re-ingestion

Data Integrity

Anchor

	Integrity
	Integrity

Subscans table holding both Radian and Degree positions5275

Priority/Done?

Notes

JiRA ticket /Confluence page

Blocker

Gap Analysis Between Legacy and New Archive

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6222

can be done once RLSW finishes the AIPSFITS files

Critical

Automated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

done

√

archive search returning incorrect projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6192

done

Legacy VLA Data

Legacy VLA data missing error codes in the new archive tool7191legacy VLA metadata error: EBs that claim to have run for 2+ days-7129

7190

https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

Critical

Display of archive ingestion/observation issues

Priority/Done?

Notes

JiRA ticket /Confluence page

Metadata Issues in Legacy VLA data

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7189

related to SSA-7192

Needs input from Bryan

7190

Critical

Identification of ingestion problems and automatically fix

Mapping of quality errors were lost. Stephan will continue following up with Bryan. Blocker for LA retirement.

metadata errors in VLBA (BD114) and old VLA data in new archive

Example ticket of a silent failure:

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7566

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7665

√

create missing db entries for Flag.xml7128

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA

-7129

This has been split into two tickets: one VLBA and one VLA

-6273

Done

√

fix ASDM.xml files missing FlagTable entities

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA

requires re-ingestion

Data Integrity

-6274

Done

DA Tools for Data Editing

Anchor

	DATools
	DATools

Automated annotations for missing scans/BDF, Automated Error Recognition of Ingested Data

Priority/Done?

Notes

JiRA ticket /Confluence page

√

Tool for setting Proprietary Period of science observations on the VLA and the VLBA

https://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA

Critical

DA annotation tools/Archive data annotation tools

Priority/Done?

Notes

JiRA ticket /Confluence page

Gap Analysis Between Legacy and New Archive

https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-6222

can be done once RL finishes the AIPSFITS files

WS-1392

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-7190

	WS-1393

WS

Missing Data

Anchor

	Missing
	Missing

open-confluencedisplay/SRDP/Archive+Data+Annotation+Tools7189create missing db entries for Flag.xml6273fix ASDM.xml files missing FlagTable entities6274

Priority/Done?

Notes

JiRA ticket /Confluence page

Critical

VLA/VLBA Image archive contents should be migrated into AAT (https://

archive.nrao.edu/

archive/archiveimage.html)

Display of archive ingestion/observation issues

Tix to be created

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due

,assignee,reporter,priority,status,resolution

,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1394

May require discussion about how new archive will display images and the uvfits datasets.

High

ALMA Standard images into AAT

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

related to SSA-7190

√

7278

High

Large project support - ALFALFA + Other collection ingest

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

Done

√

7437

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

Done

5712

ALFALFA: SRAO and Collection Support

Other

Anchor

	Other
	Other

DA Tools for Data Editing

Tool for setting Proprietary Period of science observations on the VLA and the VLBAconfluencepagesviewpage.actionspaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA

Priority/Done?	Notes	JiRA ticket /Confluence page		Details
	Other tickets (so they are not forgotten)	https://open-	jira.nrao.edu/	issues/	?	DA annotation tools/Archive data annotation tools	https://open-confluence.nrao.edu/display/SRDP/Archive+Data+Annotation+Tools

Missing Data

filter=11464

Tickets remaining are listed throughout their respective categories.

Critical

Proposal Contact Author not added to data.nrao.edu database

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7465

Bug when a project uses different PI and Contact Author

Medium

Preserve login between AAT and my.nrao.edu

Priority/Done?

Notes

JiRA ticket /Confluence page

VLA/VLBA Image archive contents should be migrated into AAT (https://archive.nrao.edu/archive/archiveimage.html)

ALMA Standard images into AAT

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7278

Large project support - ALFALFA + Other collection ingest

Other


columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7322

√ (4.2.0)

Remove pop-up page when accessing data.nrao.edu

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Other tickets (so they are not forgotten)

https://open-jira.nrao.edu/issues/?filter=11464

Proposal Contact Author not added to data.nrao.edu database

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7465

Bug when a project uses different PI and Contact Author

7502

ALMA

Anchor

	ALMA
	ALMA

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Critical

ALMA MOUS/calibration ingest unreliable; ALMA butler implementation into productionPreserve login between AAT and my.nrao.edu

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7482

Product Versioning

Anchor

	Versioning
	Versioning

Priority/Done?

Notes

JiRA ticket /Confluence page

Details

Critical

Need to allow multiple versions of products (images/calibrations) in the archive

Product Versioning and Replacement Design

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-73226476

Space shortcuts

Page tree

Versions Compared

Old Version 17

New Version Current

Key