...
The archive project will improve the user experience with the NRAO archive for the raw (visibility or otherwise) and image data from the VLA, VLBA, ALMA, and other telescopes, while not accruing significant new technical debt and retiring technical debt where necessary to improve the user experience. Interdependencies between the Workspaces system and the archive will be address addressed within this project, but significant changes to the Workspaces software is are out of scope, though limited enhancements are possible
The archive predates architectural analysis at the NRAO. Therefore, this project will begin with a limited architectural review with the aim of capturing the architectural drivers, quality attributes, and overall architecture of the archive, in order to inform the rest of the project.
Key Goals
- Improve the scripting interface to the NRAO archive
- Allow downloading of data
- Display additional metadata (and/or refactor database) to enable better filtering of data
- Download improvements (inclusion of wget commands to retrieve data).
- Search improvements.
- Position search fixes.
- Frequency-dependent FOV search
- Search based on integration time.
- VLA-metadata display improvements (helps enable VUDI)
- scan list improvements
- sources,
- frequency setup(s)
- total integration times)
- QA state
- weblogs
- VLBA data presentation and display
- Completion of VLBA data collection: Fixing corrupted Mark IV files, and adding a few missing GMVA, HSA, and Global VLBI data.
- Downloading large numbers (>500) of correlation files for VLBA projects in bulk via the 'Select All' option.
- Fixing the missing or incomplete metadata of some VLBA+EVLA (i.e. +Y1, +Y27) projects, without which download is impossible.
- Improve restore capability
- Increased robustness of ALMA MOUS ingestion of EBs and calibrations (ALMA Butler)
- Allow subsets to be downloaded(select on target, intents, spectral windows)
- Select CASA versions automatically
- Improve User-Defined Imaging
- Improvements to AUDI (ALMA User-Defined Imaging) and reimplementation into Workspaces
- Add VLA User Defined Imaging Capabilitiy
- Enable the retirement of the legacy AAT/PPI
- IDM? (Identity Management; might be mostly done?)
- Support ngVLA archive workspaces (what is this???)
...