2013 software alignement organization
1. Introduction
The goal is to “realign” all Virgo packages with a special emphasis on data analysis software installation at CCIN2P3 and CNAF. Recent changes have been introduced in the Virgo software management (virgoStaging / virgoDev suppression, PackageBuild to install external packages, Pm to install software in /virgoStaging…). Migration to SL6 has also already started for a number of packages.
2. Sites & platforms:
Sites: Cascina, CCIN2P3 and CNAF
Linux:
Architecture |
Cascina |
CCIN2P3 |
CNAF |
SL4 32 bits |
Linux-i686-SL4 |
|
|
SL5 32 bits |
Linux-i686-SL5 |
|
|
SL5 64 bits |
Linux-x86_64-SL5 |
amd64_sl5 |
Linux-x86_64-SL5 |
SL6 32 bits |
Linux-i686-SL6 |
|
|
SL6 64 bits |
Linux-x86_64-SL6 |
amd64_sl6 |
Linux-x86_64-SL6 |
RealTime:
Linux-i686-SL4-2.6.32.11-x86-hal-2.6.03-rtai-3.8.1: Real Time Linux running on the RTPC machines, need strongly to be supported
RIO806X: obsolescent, should disappear soon. Existing applications which need to still run there could remain at frozen version level. There should be no need to be part of the realignment process. To Be Confirmed
VMTR2X: CETIA of Environment Monitoring, frozen for long time, being substituted, no need to be part of the realignment process
OS9: The Vacuum subsystem has been already out of the realignment effort for some time. No need to realign for OS9 now that is getting substituted
Testing hosts:
Architecture |
Cascina |
CCIN2P3 |
CNAF |
SL4 32 bits |
ctrlvtf.virgo.infn.it |
|
|
SL5 32 bits |
farmn3.virgo.infn.it |
|
|
SL5 64 bits |
olnode03.virgo.infn.it |
ccage.in2p3.fr |
ui02-virgo.cnaf.infn.it |
SL6 32 bits |
sl6test32.virgo.infn.it |
|
|
SL6 64 bits |
sl6test64.virgo.infn.it |
ccagesl6.in2p3.fr |
no specific machine is available but a specific queue on the batch system: ce03-lcg.cr.cnaf.infn.it:8443/cream-lsf-emitest |
RT SL4 32 bits |
rtpctest2.virgo.infn.it |
|
|
At CNAF and CCIN2P3, SL6 migration is possible. At CCIN2P3, there is not yet any precise schedule nor any queue available for SL6 but a test machine for software compilation is available. At CNAF, a dedicated queue is available for SL6 jobs.
3. Package alignment program
Step 0: CMT package version: v1r24
Step 1: "basic" packages preparation.
Here is the order of preparation:
1. VirgoPolicy
2. Cset/TCm/Cm/El/Su/Db
3. Cbf/Cfg
4. PackageBuild
5. root/FFTW
6. Fr/Frv
7. Fd
Remarks:
1/ A new version of VirgoPolicy (v2r6) will be prepared first. Obsolete tags removal and compilation flags check up are the major goals of this new version of VirgoPolicy. Any requests are welcome. Note that VirgoPolicy/v2r6 will also provide the CMT pdflatex fragments. If other fragments are available for general use, they could be integrate in VirgoPolicy v2r6
2/ We need to agree on an upgraded version of root that satisfies all root clients (bug free and compliant with Virgo software). Version 5.34.05 has been proposed. This choice must still be validated for SL4 (see Franco's SL4 problems with v5r34p4) and by Dy on all platforms. That means that root and thus PackageBuild should be available asap.
3/ There exists a FFTW 3.3.3 release. We are using 3.3.2. It does not seem that FFTW 3.3.3 fixings are fundamental for our use (http://www.fftw.org/release-notes.html), but we would like to hear from users. Any opinion against fftw 3.3.3 ?
4/ Are all basic packages ready for realignement?
5/ A new package Pm dedicated to the software installation @ Cascina is still under development/tests. It has been proposed to extend its application to any remote site (Tiers 1/2 and personal laptops).
Step 2: All other external packages (installed from sources)
-
lalsuite
-
omega
-
gsl
-
mysql
-
...
The list needs to be completed. What are the requested packages, and versions? This is the right moment to collect demands of new packages/versions
Step 3: All other packages
4. Schedule/manpower:
Goal : VCS-9.0 ready for ER4.
Step 1 milestone: April 15th
Manpower:
-
Franco + all package managers for Cascina alignment.
-
Alberto to check installation @ CNAF.
-
MAB for CCIN2P3
Step 1 must be validated at Tiers 1 before April 15th.
VirgoPolicy ready March1 15th.
5. Packages' versions
5.1 Basic packages
Package |
Version |
Responsible |
Status |
VirgoPolicy |
v2r6 |
Franco/MAB/Alberto |
Cvs tagged |
CSet |
v2r14 |
MAB |
Cvs tagged |
Cm |
v8r9 |
MAB |
Cvs tagged |
TCm |
v1r11 |
MAB |
Cvs tagged |
El |
v4r15 |
MAB |
Cvs tagged |
Su |
v6r10 |
MAB |
Cvs tagged |
Db |
v4r16 |
MAB |
Cvs tagged |
Cbf |
v4r13 |
Emmanuel |
CVS tagged |
Cfg |
v7r06 |
Emmanuel |
CVS tagged |
PackageBuild |
v0r7 |
Emmanuel |
CVS tagged |
root |
v5r34p050 |
MAB |
CVS tagged |
FFTW |
v3r3p30 |
MAB |
CVS tagged |
Fr |
v8r19p1 |
Benoit |
CVS tagged |
Frv |
v4r20p1 |
Benoit |
CVS tagged |
Fd |
v7r05p3 |
Benoit |
CVS tagged |
5.2 Other packages
Package | Version | Responsible | Status |
ligotools | v2r59 | MAB | CVS tagged, stable |
lalsuite | v2 | MAB | CVS tagged, but still under debugging in virgoDev. Compiled only on SL5 64bits SL6 64 bits |
omega | v1 | MAB | CVS tagged, stable. Require to set MATLABROOT to /opt/sw/MATLAB/R2011a64bit at Cascina. Does not compile at cascina: stats toolbox not available |
Help | v0r4 | Didier | Do not use /virgoDev/omega/v1 Should we keep WOD and GOTI aliases? Still investigating a core dump in virgostate.exe |
Moni | v2r6p1 | Didier | CVS tagged |
Fbm | v6r4p10 | Didier | CVS tagged |
Dy | v9r12p15 | Didier | Use Cm v8r9, Fr v8r19p1 and VirgoPolicy v2r6 but keep ROOT v5r26p0. Problem : the use of Fr v8r19p1 seems to force the use of ROOT v5r34p050 |
GWOLLUM | v1r0 |
Florent |
CVS tagged, stable |
Omicron | v0r4 |
Florent |
CVS tagged, stable |
OnlineOmicron | v4r1 |
Nicolas |
CVS tagged, stable |