Personal tools
You are here: Home Virgo Data Analysis VDAS 2013 software alignement organization
Navigation
Log in


Forgot your username or password?
 
Document Actions

2013 software alignement organization

by Marie Anne Bizouard last modified 2013-06-20 17:34

1. Introduction

The goal is to “realign” all Virgo packages with a special emphasis on data analysis software installation at CCIN2P3 and CNAF. Recent changes have been introduced in the Virgo software management (virgoStaging / virgoDev suppression, PackageBuild to install external packages, Pm to install software in /virgoStaging…). Migration to SL6 has also already started for a number of packages.

2. Sites & platforms:

Sites: Cascina, CCIN2P3 and CNAF

Linux:

Architecture

Cascina

CCIN2P3

CNAF

SL4 32 bits

Linux-i686-SL4



SL5 32 bits

Linux-i686-SL5



SL5 64 bits

Linux-x86_64-SL5

amd64_sl5

Linux-x86_64-SL5

SL6 32 bits

Linux-i686-SL6



SL6 64 bits

Linux-x86_64-SL6

amd64_sl6

Linux-x86_64-SL6


RealTime:

Linux-i686-SL4-2.6.32.11-x86-hal-2.6.03-rtai-3.8.1: Real Time Linux running on the RTPC machines, need strongly to be supported


RIO806X: obsolescent, should disappear soon. Existing applications which need to still run there could remain at frozen version level. There should be no need to be part of the realignment process. To Be Confirmed


VMTR2X: CETIA of Environment Monitoring, frozen for long time, being substituted, no need to be part of the realignment process

OS9: The Vacuum subsystem has been already out of the realignment effort for some time. No need to realign for OS9 now that is getting substituted


Testing hosts:

Architecture

Cascina

CCIN2P3

CNAF

SL4 32 bits

ctrlvtf.virgo.infn.it



SL5 32 bits

farmn3.virgo.infn.it



SL5 64 bits

olnode03.virgo.infn.it

ccage.in2p3.fr

ui02-virgo.cnaf.infn.it

SL6 32 bits

sl6test32.virgo.infn.it



SL6 64 bits

sl6test64.virgo.infn.it

ccagesl6.in2p3.fr

no specific machine is available but a specific queue on the batch system:

ce03-lcg.cr.cnaf.infn.it:8443/cream-lsf-emitest

RT SL4 32 bits

rtpctest2.virgo.infn.it




At CNAF and CCIN2P3, SL6 migration is possible. At CCIN2P3, there is not yet any precise schedule nor any queue available for SL6 but a test machine for software compilation is available. At CNAF, a dedicated queue is available for SL6 jobs.


3. Package alignment program

Step 0: CMT package version: v1r24


Step 1: "basic" packages preparation.


Here is the order of preparation:


1. VirgoPolicy

2. Cset/TCm/Cm/El/Su/Db

3. Cbf/Cfg

4. PackageBuild

5. root/FFTW

6. Fr/Frv

7. Fd


Remarks:

1/ A new version of VirgoPolicy (v2r6) will be prepared first. Obsolete tags removal and compilation flags check up are the major goals of this new version of VirgoPolicy. Any requests are welcome. Note that VirgoPolicy/v2r6 will also provide the CMT pdflatex fragments. If other fragments are available for general use, they could be integrate in VirgoPolicy v2r6


2/ We need to agree on an upgraded version of root that satisfies all root clients (bug free and compliant with Virgo software). Version 5.34.05 has been proposed. This choice must still be validated for SL4 (see Franco's SL4 problems with v5r34p4) and by Dy on all platforms. That means that root and thus PackageBuild should be available asap.


3/ There exists a FFTW 3.3.3 release. We are using 3.3.2. It does not seem that FFTW 3.3.3 fixings are fundamental for our use (http://www.fftw.org/release-notes.html), but we would like to hear from users. Any opinion against fftw 3.3.3 ?


4/ Are all basic packages ready for realignement?


5/ A new package Pm dedicated to the software installation @ Cascina is still under development/tests. It has been proposed to extend its application to any remote site (Tiers 1/2 and personal laptops).


Step 2: All other external packages (installed from sources)

  • lalsuite

  • omega

  • gsl

  • mysql

  • ...


The list needs to be completed. What are the requested packages, and versions? This is the right moment to collect demands of new packages/versions


Step 3: All other packages

4. Schedule/manpower:

Goal : VCS-9.0 ready for ER4.


Step 1 milestone: April 15th


Manpower:

  • Franco + all package managers for Cascina alignment.

  • Alberto to check installation @ CNAF.

  • MAB for CCIN2P3

Step 1 must be validated at Tiers 1 before April 15th.

VirgoPolicy ready March1 15th.


5. Packages' versions

5.1 Basic packages

Package

Version

Responsible

Status

VirgoPolicy

v2r6

Franco/MAB/Alberto

Cvs tagged

CSet

v2r14

MAB

Cvs tagged

Cm

v8r9

MAB

Cvs tagged

TCm

v1r11

MAB

Cvs tagged

El

v4r15

MAB

Cvs tagged

Su

v6r10

MAB

Cvs tagged

Db

v4r16

MAB

Cvs tagged

Cbf

v4r13

Emmanuel

CVS tagged

Cfg

v7r06

Emmanuel

CVS tagged

PackageBuild

v0r7

Emmanuel

CVS tagged

root

v5r34p050

MAB

CVS tagged

FFTW

v3r3p30

MAB

CVS tagged

Fr

v8r19p1

Benoit

CVS tagged

Frv

v4r20p1

Benoit

CVS tagged

Fd

v7r05p3

Benoit

CVS tagged


5.2 Other packages

Package Version Responsible Status
 ligotools  v2r59  MAB  CVS tagged, stable
 lalsuite  v2  MAB  CVS tagged, but still under  debugging in virgoDev. Compiled only on SL5 64bits SL6 64 bits
 omega  v1  MAB  CVS tagged, stable. Require to set  MATLABROOT to /opt/sw/MATLAB/R2011a64bit at Cascina. Does not compile at cascina: stats toolbox not available
 Help  v0r4  Didier Do not use /virgoDev/omega/v1
Should we keep WOD and GOTI aliases?
Still investigating a core dump in virgostate.exe
 Moni  v2r6p1  Didier  CVS tagged
 Fbm  v6r4p10  Didier  CVS tagged
 Dy  v9r12p15  Didier Use Cm v8r9, Fr v8r19p1 and VirgoPolicy v2r6 but keep ROOT v5r26p0.
Problem : the use of Fr v8r19p1 seems to force the use of ROOT v5r34p050

 GWOLLUM v1r0
Florent
CVS tagged, stable
 Omicron v0r4
Florent
CVS tagged, stable
 OnlineOmicron v4r1
Nicolas
CVS tagged, stable