Date post: | 03-Jan-2016 |
Category: |
Documents |
Upload: | delling-ull |
View: | 30 times |
Download: | 0 times |
Status of CAF
Marco MEONIJan Fiete GROSSE-OETRINGHAUS
CERN - Offline Week – 28.10.2009
AliEn SEs
CAF
...
Staging
CASTOR MSS
CERN Analysis Facility (CAF)
AuthenticationProof master,
xrootd redirector
LDAP
DirectAccess
2
SW• ROOT v5-24-00a
• ROOT v5-25-02 in preparation
• AliRoot v4-17-Release– deployed to AFS and enabled via meta par-files containing no source code
• AF-v4-17.par (loads VMC, Net, Tree, Physics, STEERBase, ANALYSIS, ESD, AOD, ANALYSISalice)
• AF-v4-17-rec.par (enables the full AliRoot)
• New features– Direct access to Grid files (read/write)
– Raw reconstruction (see Cvetan’s talk)
How to use CAF athttp://aliceinfo.cern.ch/Offline/Activities/Analysis/CAF/index.htmlHow to use CAF athttp://aliceinfo.cern.ch/Offline/Activities/Analysis/CAF/index.html
3
HW• Very few interventions on the CAF machines over the last 4 months
• 30 more machines in two batches of 15– one by end November– one by beginning of next year with similar configuration
CAF
Arch. Intel Xeon
CPU 15 x 8-core (IT standard)
Disk 15 x 2.33 TBRAID5
Workers 26 (2/node)
Mperf 8570
4
CAF UsageGroups #Users
PWG0 21
PWG1 3
PWG2 57
PWG3 30
PWG4 44
13 SUB-
DETECTORS
53
Not assigned 13
Up to 21 users in parallel
Not assigned users will be refused access to CAF in the future
They receive an email every hourCAF user ’foo' running in group 'default'
-Number of groups: 20-Number of unique users: 154 (a user can belong to several groups)
5
DatasetDisk space 30.0
TB
Disk used (COMMON) 5.4 TB +8%
Disk used (users) 4.4 TB +76%
#DSs (COMMON) 30 +50%
#DSs (users) 169 +302%
#DS has increased a lot and users should also remember cleanup
Dataset URI | # Files | Default tree | # Events | Disk | Staged…/COMMON/COMMON/LHC08c11_10TeV_0.5T | 1850 | /esdTree | 277500 | 129 GB | 100 %/COMMON/COMMON/LHC08c12_0.9TeV_0.5T | 2126 | /esdTree | 318900 | 101 GB | 100 %/COMMON/COMMON/LHC08c13_10TeV_0T | 2312 | /esdTree | 346350 | 213 GB | 99 %/COMMON/COMMON/LHC08c14_0.9TeV_0T | 1646 | /esdTree | 246900 | 94 GB | 100 %/COMMON/COMMON/LHC08c15_10TeV_0.5T_Phojet | 1526 | /esdTree | 222300 | 98 GB | 97 %/COMMON/COMMON/LHC08c16_0.9TeV_0.5T_Phojet| 1415 | /esdTree | 201750 | 71 GB | 95 %/COMMON/COMMON/LHC08c17_10TeV_0T_Phojet | 1314 | /esdTree | 180750 | 109 GB | 91 %/COMMON/COMMON/LHC08c18_0.9TeV_0T_Phojet | 1554 | /esdTree | 222750 | 96 GB | 95 %/COMMON/COMMON/LHC09a14_0.9TeV_0.5T | 1349 | /esdTree | 222780 | 38 GB | 99 %/COMMON/COMMON/LHC09a15_0.9TeV_0T | 1093 | /esdTree | 212600 | 42 GB | 97 %/COMMON/COMMON/LHC09a2_run8000X | 9795 | /esdTree | 683850 | 1 TB | 46 %/COMMON/COMMON/LHC09a4_10TeV | 6831 | /HLTesdTree | 1343400 | 486 GB | 98 %/COMMON/COMMON/LHC09a4_10TeV_200k | 989 | /HLTesdTree | 194000 | 70 GB | 98 %/COMMON/COMMON/LHC09a4_run8010X | 3042 | /HLTesdTree | 603400 | 250 GB | 99 %/COMMON/COMMON/LHC09a4_run8100X | 2947 | /HLTesdTree | 587800 | 154 GB | 99 %/COMMON/COMMON/LHC09a4_run81011 | 989 | /HLTesdTree | 197600 | 52 GB | 99 %/COMMON/COMMON/LHC09a4_run8101X | 7744 | /esdTree | 1547000 | 408 GB | 99 %/COMMON/COMMON/LHC09a4_run8158X | 9683 | /HLTesdTree | 1936600 | 512 GB | 100 %/COMMON/COMMON/LHC09a4_run8159X | 5745 | /HLTesdTree | 1149000 | 303 GB | 100 %/COMMON/COMMON/LHC09a5_run9000X | 8125 | /HLTesdTree | 1620600 | 452 GB | 99 %/COMMON/COMMON/LHC09a6_run9200X | 5791 | /HLTesdTree | 1148600 | 488 GB | 99 %/COMMON/COMMON/LHC09b10_0.9TeV_0.5T_Phojet| 1935 | /esdTree | 282000 | 75 GB | 72 %/COMMON/COMMON/LHC09b11_0.9TeV_0T_Phojet | 1176 | /esdTree | 232000 | 73 GB | 98 %/COMMON/COMMON/LHC09b12_7TeV_0.5T | 298 | /esdTree | 59600 | 22 GB | 100 %/COMMON/COMMON/LHC09b13_7TeV_0T | 1533 | /esdTree | 276600 | 127 GB | 90 %/COMMON/COMMON/LHC09b14_7TeV_0.5T_Phojet | 1157 | /esdTree | 217800 | 76 GB | 94 %/COMMON/COMMON/LHC09b15_7TeV_0T_Phojet | 1104 | /esdTree | 175400 | 76 GB | 79 %/COMMON/COMMON/LHC09b8_0.9TeV_0.5T | 468 | /esdTree | 93600 | 21 GB | 100 %/COMMON/COMMON/LHC09b9_0.9TeV_0T | 1883 | /esdTree | 275800 | 81 GB | 73 %/COMMON/COMMON/tutorial_small | 200 | /esdTree | 20000 | 8 GB | 100 %…
Dataset URI | # Files | Default tree | # Events | Disk | Staged…/COMMON/COMMON/LHC08c11_10TeV_0.5T | 1850 | /esdTree | 277500 | 129 GB | 100 %/COMMON/COMMON/LHC08c12_0.9TeV_0.5T | 2126 | /esdTree | 318900 | 101 GB | 100 %/COMMON/COMMON/LHC08c13_10TeV_0T | 2312 | /esdTree | 346350 | 213 GB | 99 %/COMMON/COMMON/LHC08c14_0.9TeV_0T | 1646 | /esdTree | 246900 | 94 GB | 100 %/COMMON/COMMON/LHC08c15_10TeV_0.5T_Phojet | 1526 | /esdTree | 222300 | 98 GB | 97 %/COMMON/COMMON/LHC08c16_0.9TeV_0.5T_Phojet| 1415 | /esdTree | 201750 | 71 GB | 95 %/COMMON/COMMON/LHC08c17_10TeV_0T_Phojet | 1314 | /esdTree | 180750 | 109 GB | 91 %/COMMON/COMMON/LHC08c18_0.9TeV_0T_Phojet | 1554 | /esdTree | 222750 | 96 GB | 95 %/COMMON/COMMON/LHC09a14_0.9TeV_0.5T | 1349 | /esdTree | 222780 | 38 GB | 99 %/COMMON/COMMON/LHC09a15_0.9TeV_0T | 1093 | /esdTree | 212600 | 42 GB | 97 %/COMMON/COMMON/LHC09a2_run8000X | 9795 | /esdTree | 683850 | 1 TB | 46 %/COMMON/COMMON/LHC09a4_10TeV | 6831 | /HLTesdTree | 1343400 | 486 GB | 98 %/COMMON/COMMON/LHC09a4_10TeV_200k | 989 | /HLTesdTree | 194000 | 70 GB | 98 %/COMMON/COMMON/LHC09a4_run8010X | 3042 | /HLTesdTree | 603400 | 250 GB | 99 %/COMMON/COMMON/LHC09a4_run8100X | 2947 | /HLTesdTree | 587800 | 154 GB | 99 %/COMMON/COMMON/LHC09a4_run81011 | 989 | /HLTesdTree | 197600 | 52 GB | 99 %/COMMON/COMMON/LHC09a4_run8101X | 7744 | /esdTree | 1547000 | 408 GB | 99 %/COMMON/COMMON/LHC09a4_run8158X | 9683 | /HLTesdTree | 1936600 | 512 GB | 100 %/COMMON/COMMON/LHC09a4_run8159X | 5745 | /HLTesdTree | 1149000 | 303 GB | 100 %/COMMON/COMMON/LHC09a5_run9000X | 8125 | /HLTesdTree | 1620600 | 452 GB | 99 %/COMMON/COMMON/LHC09a6_run9200X | 5791 | /HLTesdTree | 1148600 | 488 GB | 99 %/COMMON/COMMON/LHC09b10_0.9TeV_0.5T_Phojet| 1935 | /esdTree | 282000 | 75 GB | 72 %/COMMON/COMMON/LHC09b11_0.9TeV_0T_Phojet | 1176 | /esdTree | 232000 | 73 GB | 98 %/COMMON/COMMON/LHC09b12_7TeV_0.5T | 298 | /esdTree | 59600 | 22 GB | 100 %/COMMON/COMMON/LHC09b13_7TeV_0T | 1533 | /esdTree | 276600 | 127 GB | 90 %/COMMON/COMMON/LHC09b14_7TeV_0.5T_Phojet | 1157 | /esdTree | 217800 | 76 GB | 94 %/COMMON/COMMON/LHC09b15_7TeV_0T_Phojet | 1104 | /esdTree | 175400 | 76 GB | 79 %/COMMON/COMMON/LHC09b8_0.9TeV_0.5T | 468 | /esdTree | 93600 | 21 GB | 100 %/COMMON/COMMON/LHC09b9_0.9TeV_0T | 1883 | /esdTree | 275800 | 81 GB | 73 %/COMMON/COMMON/tutorial_small | 200 | /esdTree | 20000 | 8 GB | 100 %…
6
4 months, 1.1x109 secs
CPUtime=0.53x108 secs
CPU Usage
9 months, 2.47x109 secsCPUtime=1.03x108 secs
Average CPU Usage =
4.2%
Average CPU Usage =
4.2%
Average CPU Usage =
4.8%
Average CPU Usage =
4.8%
• CAF usage is significantly increased• Group default is not any more the most relevant• CAF usage is significantly increased• Group default is not any more the most relevant
CAF 10/08-06/09 06/09-10/09 +/-
Bytes read 234TB 332TB +219%
Events 4.8G 4.2G +97%
Queries 19200 12613 +48%
Overview• CAF
• Reached a proved stability, few reboots
• Current SW suite includes ROOT v5/24-00a + AliRoot v4-17-Release
• User support• Monthly tutorials at CERN, ~700 people attended so far• Mailing list: [email protected]• Web page: http://aliceinfo.cern.ch/Offline/Analysis/CAF
• Under development• Top hits in Gerri’s talk
• Regular biweekly meeting among CAF/PROOF/Grid experts
8