I (RickL) have connection information for the GBT Archive metadata database. This connection information can also be set up in IntelliJ. Ask if you don't know how to do it and I haven't yet updated the docs.

Information is extracted from this database into .csv files as describe in John's Notes and then ftp'ed to Socorro to ingest into the (old) archive database. On our end the data is located in /home/ngas_staging/gbt_metadata in daily exports that look like GBTArchive_2018-02-13T06:30:02.csv_aatexport, for example.

There are multiple files in the directory, for example:

-rw-r--r-- 1 archmgr e2emgr   921 Feb 13 06:27 GBTArchive_2018-02-13T06:30:02.csv__datadesc.txt

-rw-r--r-- 1 archmgr e2emgr   411 Feb 13 06:27 GBTArchive_2018-02-13T06:30:02.csv__archfilelocation.txt

-rw-r--r-- 1 archmgr e2emgr  1027 Feb 13 06:27 GBTArchive_2018-02-13T06:30:02.csv__archive.txt

-rw-r--r-- 1 archmgr e2emgr   692 Feb 13 06:27 GBTArchive_2018-02-13T06:30:02.csv__file_set_properties.txt

-rw-r--r-- 1 archmgr e2emgr   506 Feb 13 06:27 GBTArchive_2018-02-13T06:30:02.csv__projects.txt

"PROJECT_CODE","OBSERVER","STARTTIME","STOPTIME","TELESCOPE","OBS_BANDS","NUM_SEGMENTS","ARCH_FILES"

"AGBT15B_160","Joseph Swiggum, Scott Ransom, Emmanuel Fonseca, Ryan Lynch, Kevin Stovall, Paul Demorest","58159.5308565","58160.8112847","GBT","P, L","3","87"

"AGBT17A_477","Duncan Lorimer","58159.7867361","58159.8070139","GBT","P","1","4"

"AGBT18A_246","Jay Lockman","58159.8213542","58159.9735532","GBT","L","1","42"

"AGBT18A_268","Duncan Lorimer","58159.9971296","58160.0590046","GBT","P","1","5"

-rw-r--r-- 1 archmgr e2emgr 28482 Feb 13 06:27 GBTArchive_2018-02-13T06:30:02.csv__observation.txt

which possibly correspond to one file per table in the old archive.


To start, you can take the project code above, AGBT15B_160, and search for it in metadata table:

select * from project where name = 'AGBT15B_160';

That gives the projectID which can be used to query other tables.


/home/archive.nrao.edu/bin/autoingestGBTintoArchive_aocngas-master
    creates sql insert files to load the GBT metadata into the Archive DB.
    The sql files are written into :
    /home/archive/e2e/archive/catalogs/NRAO/sqlscripts like
    GBTAGBT14B_339_71.sql

/home/ngas_staging/log All telescopes




  • No labels