0. Introduction

It has been decided to drop the 1TB max bufferV organization of /data/procdata disk area. Instead of that we will have a folder organization by "activities", with no size limit but quotas following each activities needs. Of course the total size is not changing.

Livio is in charge of doing the move.

1. New folders organization:

burst
CBC
CW
SGWB
DAQ
calibration
injections (contains files that are injected)
hrec (contains frame files generated online)
RDS (contains frame files generated online)
MBTA (contains frame files generated online)
ER (contains low latency h(t) data that are injected & collected during ERs)
detchar
web (only 1 browserable space --> no detchar/web)

Sub-folder organization (no need to freeze this part as quota will be defined by folder). Just given for information

web/Omicron
web/Omega
web/Omegascan
web/Omiscan
web/veto/DQperf
web/veto/UPVreport
web/veto/DQsafety
web/injections
web/nmapi

burst/Omicron/
burst/triggers/Omicron/
burst/triggers/Omega

detchar/triggers
detchar/dq
detchar/spectro
detchar/noise/noemi
detchar/noise/nonlinear/sfos
detchar/noise/nonlinear/regression
detchar/noise/wdf
detchar/noise/coherence
detchar/noise/nonstationary

2. Organization move

Remark:
As few buffervX contents are similar, in some cases we need to proceed in 2 steps with a temporary copy in sub-folders named after the original buffervX. For instance in bufferv24 and bufferv25 there are twice VSR4-CW_RDS and VSR4-CW_RDS-prod with slightly different content. The proposal is to move bufferv24 in RDS/bufferv24 ad bufferv25 in RDS/bufferv25 and then let the "owner" arrange files as they should.

Proposal:

bufferv6 ->hrec
bufferv7 ->hrec
bufferv8 ->hrec
bufferv10->ER
bufferv11->ER
bufferv12->hrec
bufferv13->hrec
bufferv14->hrec (please rename VSR2-HrecV3 to VSR2-HrecV3-1)
bufferv15->hrec (please rename VSR2-HrecV3 to VSR2-HrecV3-2)
bufferv18->MBTA
bufferv19->MBTA
bufferv23->ER
bufferv24->RDS

bufferv9  --> hrec/mours/
bufferv17 --> hrec/mours/
bufferv25 --> hrec/mours/

bufferv1 --> detchar/spectro/bufferv1
bufferv2 --> calibration/bufferv2
bufferv3 --> detchar/bufferv3 (complete mess, including symbolic links)
bufferv4 --> CBC
bufferv5/Bursts --> burst/bufferv5/Bursts (remove bufferv5/storage_p which is empty)
bufferv16 --> burst/bufferv16
bufferv20 --> ER

bufferv21/SB --> SGWB
bufferv21/CW --> CW
bufferv21/NoeMi --> detchar/bufferv21

bufferv22 --> detchar/bufferv22

bufferv25/Damir --> CBC
bufferv25/michael --> CBC
bufferv25/sipho --> CW
bufferv25/VSR4-CW_RDS --> RDS/bufferv25/VSR4-CW_RDS
bufferv25/VSR4-CW_RDS-prod --> RDS/bufferv25/VSR4-CW_RDS-prod

bufferv26 --> detchar/spectro/bufferv26
bufferv27 --> calibration/bufferv27

bufferv28 : delete all files

bufferv29 --> detchar/bufferv29
bufferv30 --> detchar/bufferv30
bufferv31 --> burst/bufferv31
bufferv32 --> burst/buferrv32

3. Cleanup table

Folder	Responsible	status	Current size [TB] 21/08/2013	Back-up (crash recovery or recovery with history)	Quota
burst	Florent		0.47		5 TB
calibration	Loic		1.66	no back-up needed	3 TB
CBC	Frederique		>14.2		20 TB
CW	Alberto		0.08		1 TB
DAQ	Didier		0		1 TB
detchar	Didier/Elena		>4.9	spectro and omicron folders in crash recovery mode	20 TB
ER	Benoit		1.6		6 TB
hrec	Benoit		4.5		6 TB
injections	Benoit		1.7		4 TB
MBTA	Frederique		1.7		5 TB
RDS	Benoit		1.7		4 TB
SGWB	Giancarlo		0.12		1 TB
web	Didier		5.1	no back-up	10 TB

4. Storage system content

st1 rawdata 32 TB
st2 rawdata 32 TB (1 TB optics)
st3 rawdata 32 TB (few TB broken)
st4 rawdata 30 TB (4 TB suspensions)
st5 rawdata 22 TB
st6 50Hz   + trenddata (archive)            11.0 TB
    nikhef + repro + sysmgr + vesf          11.0 TB
    rd                               11.0 TB
    archive_users + ligo              27.0 TB
    df.unipi      + mdc                  27.0 TB
st7 procdata (all)                  62.0 TB

Totale: 298.6 TB

Online storage:

stol1    4.0    rawdata writing process
stol2    10.0    rawdata writing process
stol3    4.0    rawdata tmp writing process
    4.0    50Hz writing process
    2.0    trenddata writing process

5. Back-up status for the full storage system at Cascina