Minutes by Luca Dell Angnelo

Attendees: Vladimir, Luca DA, Alberto C. Cristiano P., Antonella B. Marie Anne B., ... 

---------


VIRGO asks to move 25 TB from the data fs (gpfs_virgo4) to the user fs (gpfs_virgo4)
CNAF is going to move all the data from CASTOR to GEMSS, i.e. copying all the data into a GPFS fs with the automatic archival activated. This
activity is starting this week in order to phase out CASTOR before the end of November 2010.
This implies that all the data will be archived into GEMSS (which is using TSM as tape back-end) and the data already archived in CASTOR will be
copied to TSM.
CNAF proposes to modify the present configuration (2 fs) unifying all the disk space in a unique fs with different policies applied to the different
paths. A possible scenario is the following:


DataSet         File System      FileSet       Mount point                                  Comment
------------------------------------------------------------------------------------

virgo           gpfs_virgo       Virgo         /storage/gpfs_virgo                    1,2     (permanent data storage )
home            gpfs_virgo       Home          /storage/gpfs_virgo/home      2,3,4   (user's data)
scratch         gpfs_virgo       Scratch       /storage/gpfs_virgo/scratch     2,3,4,5 (temporary storage)
archive         gpfs_virgo       Archive       /storage/gpfs_virgo/archive     1,2,4   (user's data archive)

1) HSM, everything goes to tape, garbage collector starting at 80% of FS occupancy
2) fileset quota enforced, user quota enabled
3) no archiving on tape
4) user access enabled
5) automated removal of files older than N months (or weeks or even days)

In more complicated case, any number of filesets with any of above mentioned functionality can be created inside any fileset

Questions:

1) is this scenario ok?
2) on which paths, if any, are you using or are you going to use StoRM (i.e. the grid access)?
3) how should we map the old castor paths in the new system? please read below for a listing of the directories in CASTOR:

[root@castor-4 migrazione_castor_tsm]# nsls -l /castor/cnaf.infn.it/virgo/virgo-cnaf
drwxr-xr-x  11 virgodat virgodat                  0 Oct 19  2006 50Hz_vol1
drwxr-xr-x   4 virgodat virgodat                  0 Oct 19  2006 50Hz_vol2
drwxr-xr-x 1180 virgodat virgodat                  0 Oct 25  2006 50Hz_vol3
drwxr-xr-x 1303 virgodat virgodat                  0 Oct 26  2006 50Hz_vol4
drwxr-xr-x 663 virgodat virgodat                  0 Oct 27  2006 50Hz_vol5
drwxr-xr-x 858 virgodat virgodat                  0 Nov 03  2006 50Hz_vol6
drwxr-xr-x 489 virgodat virgodat                  0 Nov 03  2006 50Hz_vol7
drwxr-xr-x   1 virgodat virgodat                  0 Jun 08  2006 C0_50Hz
drwxr-xr-x   3 virgodat virgodat                  0 May 16  2006 C0_dirty_beam
drwxr-xr-x  69 virgodat virgodat                  0 Jun 08  2006 C0_raw
drwxr-xr-x   1 virgodat virgodat                  0 Jun 08  2006 C0_trend
drwxr-xr-x  45 virgodat virgodat                  0 May 12  2006 C1_50Hz
drwxr-xr-x 955 virgodat virgodat                  0 May 13  2006 C1_raw
drwxr-xr-x  35 virgodat virgodat                  0 May 16  2006 C1_spectrogram
drwxr-xr-x   4 virgodat virgodat                  0 May 16  2006 C1_trenddata
drwxr-xr-x  39 virgodat virgodat                  0 Nov 07  2007 C2_50Hz
drwxr-xr-x 914 virgodat virgodat                  0 Nov 07  2007 C2_raw
drwxr-xr-x  33 virgodat virgodat                  0 Jun 09  2006 C2_spectrogram
drwxr-xr-x   4 virgodat virgodat                  0 Jun 09  2006 C2_trend
drwxrwxr-x 630 virgodat virgodat                  0 Sep 24  2007 C3_50Hz
drwxrwxr-x 1257 virgodat virgodat                  0 Nov 08  2007 C3_raw
drwxrwxr-x   5 virgodat virgodat                  0 Sep 21  2007 C3_trenddata
drwxrwxr-x  62 virgodat virgodat                  0 Sep 21  2007 C4_50Hz
drwxrwxr-x   0 virgodat virgodat                  0 May 10  2007 C4_proc
drwxrwxr-x 1831 virgodat virgodat                  0 Nov 14  2007 C4_raw
drwxrwxr-x   6 virgodat virgodat                  0 Jun 18  2007 C4_trenddata
drwxrwxr-x  84 virgodat virgodat                  0 May 28  2007 C5_50Hz
drwxrwxr-x  12 virgodat virgodat                  0 May 28  2007 C5_proc
drwxrwxr-x 1260 virgodat virgodat                  0 May 28  2007 C5_raw_p1
drwxrwxr-x 659 virgodat virgodat                  0 May 29  2007 C5_raw_p2
drwxrwxr-x   8 virgodat virgodat                  0 May 28  2007 C5_trenddata
drwxrwxr-x 167 virgodat virgodat                  0 Sep 24  2007 C6_50Hz
drwxrwxr-x 373 virgodat virgodat                  0 Sep 18  2007 C6_proc
drwxrwxr-x 1424 virgodat virgodat                  0 Jun 03  2007 C6_raw_p1
drwxrwxr-x 1510 virgodat virgodat                  0 Jun 02  2007 C6_raw_p2
drwxrwxr-x 1434 virgodat virgodat                  0 Jun 23  2007 C6_raw_p3
drwxrwxr-x 671 virgodat virgodat                  0 Jun 06  2007 C6_raw_p4
drwxrwxr-x  17 virgodat virgodat                  0 Jun 06  2007 C6_trend
drwxrwxr-x  57 virgodat virgodat                  0 Jun 11  2007 C7_50Hz
drwxrwxr-x 100 virgodat virgodat                  0 Oct 28  2009 C7_proc
drwxrwxr-x 1380 virgodat virgodat                  0 Oct 28  2009 C7_raw_p1
drwxrwxr-x 315 virgodat virgodat                  0 Oct 28  2009 C7_raw_p2
drwxrwxr-x   6 virgodat virgodat                  0 Jun 11  2007 C7_trend
drwxr-xr-x 439 virgodat virgodat                  0 Apr 19  2006 E0_50Hz
drwxr-xr-x   7 virgodat virgodat                  0 Apr 20  2006 E0_badtrend
drwxr-xr-x   1 virgodat virgodat                  0 Apr 20  2006 E0_calib
drwxr-xr-x  98 virgodat virgodat                  0 Apr 20  2006 E0_processed
drwxr-xr-x 443 virgodat virgodat                  0 May 02  2006 E0_raw
drwxr-xr-x   2 virgodat virgodat                  0 May 02  2006 E0_trenddata
drwxr-xr-x 893 virgodat virgodat                  0 May 11  2006 E1_raw
drwxr-xr-x 867 virgodat virgodat                  0 May 11  2006 E2_raw
drwxr-xr-x 810 virgodat virgodat                  0 May 13  2006 E3_raw
drwxr-xr-x 168 virgodat virgodat                  0 Jun 09  2006 E4.1_raw
drwxr-xr-x 906 virgodat virgodat                  0 May 12  2006 E4_raw
drwxr-xr-x  18 virgodat virgodat                  0 Jun 18  2009 data
mrw-r--r--   1 virgodat virgodat              16561 Apr 19  2006 dd.root
mrwxr-xr-x   1 virgodat virgodat         1589372519 May 15  2007 glore-1
mrwxr-xr-x   1 virgodat virgodat         1589372519 May 15  2007 glore-2
mrwxr-xr-x   1 virgodat virgodat         1490050316 May 15  2007 glore-test-1
drwxr-xr-x  52 virgodat virgodat                  0 Apr 20  2007 grid
drwxrwxr-x   2 virgodat virgodat                  0 Sep 12  2007 prova
mrw-r--r--   1 virgodat virgodat                626 Oct 10  2006 test1
mrw-r--r--   1 virgodat virgodat                626 Oct 10  2006 test2
mrw-r--r--   1 virgodat virgodat                626 Oct 10  2006 test3
drwxrwxr-x   0 virgodat virgodat                  0 May 10  2007 trenddata_vol1