Attendees: Chris Clark, Laura Jensen, Amy Kimball, Mark Lacy, Matthew McCleary, Drew Medlin, Tony Remijan, Jim Sheckard, John Tobin, Stephan Witz 

Purpose: Near term crisis that the Lustre was at 95% usage last week. Need to develop near and longer term solutions and storage management strategies.

Minutes:

  • Stephan: For VLASS, can we check that the UMASK through the ACL is set properly. Makes sure that files being written to pipeline are group writable.
  • Astra: Short term, need to add storage. Need a number for how much we need to buy. Set 75% as capacity target and then let us figure out what we need to buy ASAP.
  • Chris: Currently have 2.2 PB. Propose to buy 1 additional 1 PB? Need to make sure we have enough infiniband space. Astra asks that SSR provide a number for how much storage is needed.
  • Astra: Currently short on headroom and don't have enough room for growth.
  • Mark Lacy: VLASS will need 200 TB quota for VLASS Ops. 
  • Drew: For each Sci Ops internal users, assigned 10TB each. 83 directories in Sci Ops. Do any belong to people who have left?
  • Tony R: Synthesis Imaging Workshop - everyone works on their own laptops, so storage need should be zero.
  • Amy: ngVLA growth should be considered.
  • Amy: Include student usages too.
  • Jim: Besides VLASS, there are other projects. e.g., HERA.
  • Tony R: Will need to designate someone monitor storage and be responsible for making people manage/clean up the data. In the short term, he can police this, but need a longer term plan.
  • Drew: Already performing some of the storage management functions - monitoring data for deletion, limited visitor data, etc. 


Action Items:

  • All - SSR needs to provide a number for how much storage they want SIS to provision, and DMS will buy it and provision it.
  • Astra - SIS team will meet and discuss the hardware. 
  • Matthew/Chris check with Peter whether there is space available on the existing Infiniband switch.
  • Chris - find out how much space we've also allocated for visitor accounts. Drew - visitor accounts get 5 TBs.
  • Chris - at the next storage group meeting, add a Jira item for Tim to look at quota metrics reporting.
  • SIS - will put together storage management policies and plans.






  • No labels