Page History

Below is a list of items that are priorities for Archive implementation, some of these are Legacy AAT retirement tickets, others are new development. The order in the tables is in priority order.

Main topics (click link to jump to section in page):

Data Delivery

Search/Data Selection

VLBA-specific

VLA(VLBA) Metadata presentation

Legacy VLA Data

Data Integrity

DA Tools

Missing Data

Other

ALMA

Product Versioning

Data Delivery

Anchor

	DataDelivery
	DataDelivery

Scriptable Query Interface to NRAO Archive

Priority/Done?

Notes

JiRA ticket /Confluence page

Critical

Downloads via Scriptable query interface

Scriptable Query Interface to NRAO Archive

SSA7421Put warning that only one CMS at a time can be requested in AATSSA7106Bulk download of Calibration tarballs7353

critical (4.2.0)

The email sent by the archive tool will include the wget command in the near future.

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

WS-

1395

critical

A friendly error is needed when a users is not authorized to access proprietary data.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7474

confusing to staff as well

-need to kill RH, WS 3.0+

medium

critical

Restore data using same version of CASA as calibrated

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

WS-1405

medium

Put warning that only one CMS at a time can be requested in AAT

could be a flyover text (currently has a flyover circle with slash)

for pipeline

option to return UNTAR'd file does not work

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

6495https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

pipeline topic

7106

could be a flyover text (currently has a flyover circle with slash)

high (WS 2.8/2.9)

high

Clean up the nested directory data delivery mess

legacy VLA data deliveries are one level deeper in directories than an SDM

*May need revisions to account for VLBA differences.

Delivery Directory Improvements

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7000

WS 2.7 or 3.0?

attempted for planned 4.2.0 but is deferred2

Don't restrict download number limit.

New ticket to remove the '/100 string from webpage'

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7352

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7436

We would like no limit on the number of files, but keep the 10TB for the total downloaded volume.

4.2.1

Fix select-all functionality

Always have select all available (only displayed files/SDM or from all pages)

make select-all work properly with select/deselect

NEW TICKET

medium

Download weblogs directly (and/or serve them as well!)

Direct weblog download from archive search return interface

medium

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7573

low

archive should ask for confirmation to continue if the download or processing job is considered large

To be requested

The front end can show size estimates for various products.

medium

Download weblogs directly (and/or serve them as well!)

low

Data Delivery times out if tar file(s) are too large/time consuming

Direct weblog download from archive search return interface

issuekey,summary,issuetype,created,

will not be an issue with taring not being the default.

low

archive-new delivery not chmod'd/chowned

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-6083

WS-1388

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	WS-1389

!

medium

Bulk download of Calibration tarballs

SSA-5096

√

open up local delivery restrictions (to /home and /lustre).

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7179

The part related to opening the download destination to nm-### accounts on lustre is

7353

low

archive should ask for confirmation to continue if the download or processing job is considered large

To be requested

The front end can show size estimates for various products.

low

Data Delivery times out if tar file(s) are too large/time consuming

Jira

server	DMS JIRA

serverId

eb2e750b-a83a-387e-8345-36eee8a98f01

key

SSA-7345

This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!

columnIds	issuekey,summary,issuetype,created,

√

disable checksums by default

Jira

server

DMS JIRA

columnIds

updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7343

6083

will not be an issue with taring not being the default.

low

archive-new delivery not chmod'd/chowned

√

make tar downloads default to 'off'

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7344

Search interface/Data Selection

5096

√ 2022.2 pipeline

option to return UNTAR'd file does not work

Priority/Done?

Notes

high

Scriptable query interface

Jira

server	DMS JIRA

serverIdeb2e750b-a83a-387e-8345-36eee8a98f01keySSA-7395

columnIds	issuekey,summary,issuetype,created,updated,

high

Fix Frequency-dependent FOV and position searches

exact same feature as legacy archive, must select to do the freq. dependent FOV
legacy archive has this feature

JiraserverDMS JIRAcolumnIdsissuekey,summary,issuetype,created,updated,

duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

4915

6495

https://open-confluence.nrao.edu/display/SRDP/Product+lists+for+Basic+and+Calibrated+Measurement+Set+downloads

pipeline topic

√ (4.2.0)

The email sent by the archive tool will include the wget command in the near future.

Jira

server	DMS JIRA
serverId	eb2e750b-a83a

JiraserverDMS JIRAcolumnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolutioncolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverIdeb2e750b-a83a

-387e-8345-36eee8a98f01
key	SSA-

7497

7421

high

Position searches provide distance from searched position and sort by distance

legacy archive feature

User request, but is a legacy AAT featuremedium

Treat wild cards consistently in AAT search interface

account for * in source names

√

open up local delivery restrictions (to /home and /lustre).

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7387issuekey

7179

The part related to opening the download destination to nm-### accounts on lustre is

Jira

server	DMS JIRA

columnIds

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7345

This should cover users with visitor accounts wanting to download data to lustre, and local staff wanting to download data to their local machines. We have a problem with the quota of the observer accounts (I downloaded 8 TB of data to my observer account!); CIS remains irresponsive!

√

disable checksums by default

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7496

7343

low


√	make tar downloads default to 'off'

Allow search return of observation scans?

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7344

Search interface/Data Selection

Anchor

	Search
	Search

7388

Priority/Done?

Notes

high

Fix Frequency-dependent FOV and position searches

exact same feature as legacy archive, must select to do the freq. dependent FOV
legacy archive has this feature

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

high

Allow search filtering based on total time on source.

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7424

Based on legacy archive helpdisk question from user. UC feedback as well.

4915

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,

medium

Fix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scan)

Rearrange boxes in 'Search Inputs'

Ticket to be created.

√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

Doesn't fully solve problem see also

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7352

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

VLBA Stuff

issuekey,summary,issuetype,created,updated,duedate

7497

high (4.2.2)

Position searches provide distance from searched position and sort by distance

legacy archive feature

Priority/Done?

Notes

JiRA ticket /Confluence page

High

Add wget command in emails generated by the AAT upon downloading data

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7421

High

VLBA: DA archive tools (note specifically the limitation of USNO data not having PI)

CHECK IF ALL REQUIREMENTS ON CONFLUENCE ARE SATISFIED
Current tools should be able to add PI for USNO


columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due

https://open-confluence.nrao.edu/display/SPR/VLBA%3A+DA+archive+tools

proprietary period setter:

Jira

server

DMS JIRA

columnIds

,assignee,reporter,priority,status,resolution

columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolutionserverIdeb2e750b

serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7350

needs follow up, some things are inconsistent (especially the topic of the tool's readiness to change the proprietary period of VLBA data).HighVLBA+EVLA projects without metadata and sometimes also mismatched PI

7387

User request, but is a legacy AAT featuremedium

Treat wild cards consistently in AAT search interface

account for * in source names

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-

7423

7496

High
lowAllow search return of observation scans?Proxy issue for huge VLBA projects

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-74367388

Helpdesk ticket for a search return we do not have in AAT, but legacy archive provides.

high

Allow search filtering based on total time on source.

MedWrong band designation in VLBA data (old data only?)

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7420

This is in both the legacy archive and the new archive tool. Issue needs more research on how prevalent it is; unclear.

columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7424

Based on legacy archive helpdisk question from user. UC feedback as well.mediumFix mosaic position searches for VLASS and ALMA mosaics (subscan vs. scan)MedFor observing VLBA projects that incorporate other dishes (e.g. +Y1, +Y27 etc), the VLA files should be associated with the relevant VLBA segment and not considered as "mixed" projects. This has been descoped from ticket

Jira

key
server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01

SSA-7185 but needs to be picked up in future AAT releases

New JIRA ticket not yet created.

WS-1365

Rearrange boxes in 'Search Inputs'Ticket to be created.
√ (4.2.0)Scriptable query interface

Scriptable Query Interface to NRAO Archive

Jira

server	DMS JIRA
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7395

√

Download number limit: 100 data sets, but download data volume limit to 10TB per request.

Doesn't fully solve problem see also

MedDefault Instrument of VLBA projects in AAT/PPI

Jira

server	DMS JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	eb2e750b-a83a-387e-8345-36eee8a98f01
key	SSA-7208

Confluence req: VLBA: Default Instrument of VLBA projects in AAT/PPI

MedAdd PFT (proposal finder tool) link in Project View for VLBA projects

7352

This change has already been made by Stephan, but 100 files is too limiting for various cases (take BM360 as one example). We would more likely want no limit on the number of files, but keep the 10TB for the total downloaded volume.

Priority/Done?	Notes	JiRA ticket /Confluence	page
Critical	VLA/VLBA Image archive contents should be migrated into AAT (https://archive	√	Tool for setting Proprietary Period of science observations on the VLA and the VLBA	https://open-confluence.nrao.edu/pages/viewpage.action?spaceKey=SPR&title=Tool+for+setting+Proprietary+Period+of+science+observations+on+the+VLA+and+the+VLBA	Critical	DA annotation tools/Archive data annotation tools	https://open-confluence .nrao.edu/ display/SRDP/Archive+Data+Annotation+Tools

Space shortcuts

Page tree

Versions Compared

Old Version 46

New Version Current

Key