Attendees: Chris Clark, Laura Jensen, Amy Kimball, Mark Lacy, Matthew McCleary, Drew Medlin, Tony Remijan, Jim Sheckard, John Tobin, Stephan Witz
Purpose: Near term crisis that the Lustre was at 95% usage last week. Need to develop near and longer term solutions and storage management strategies.
Minutes:
- Stephan: For VLASS, can we check that the UMASS through the ACL is set properly. Makes sure that files being written to pipeline are group writable.
- Astra: Short term, need to add storage. Need a number for how much we need to buy. Set 75% as capacity target and then let us figure out what we need to buy ASAP.
- Chris: Currently have 2.2 PB. Propose to buy 1 additional 1 PB? Need to make sure we have enough infiniband space. Astra asks that SSR provide a number for how much storage is needed.
- Astra: Currently short on headroom and don't have enough room for growth.
- Mark Lacy: VLASS will need 200 TB quota for VLASS Ops.
- Drew: For each Sci Ops internal users, assigned 10TB each. 83 directories in Sci Ops. Do any belong to people who have left?
- Tony R: Synthesis Imaging Workshop - everyone works on their own laptops, so storage need should be zero.
- Amy: ngVLA growth should be considered.
- Amy: Include student usages too.
- Jim: Besides VLASS, there are other projects. e.g., HERA.
- Tony R: Will need to designate someone monitor storage and be responsible for making people manage/clean up the data. In the short term, he can police this, but need a longer term plan.
- Drew: Already performing some of the storage management functions - monitoring data for deletion, limited visitor data, etc.
Action Items:
- All - SSR needs to provide a number for how much storage they want SIS to provision, and DMS will be it and provision it.
- Astra - SIS team will meet and discuss the hardware.
- Matthew/Chris check with Peter whether there is space available on the existing Infiniband switch.
- Chris - find out how much space we've also allocated for visitor accounts. Drew - visitor accounts get 5 TBs.
- Chris - next storage group meeting, add a Jira item for Tim to look at quota metrics reporting
- SIS - will put together storage management policies and plans