HEPMARK2

Consiglio di Sezione 9 Luglio 2012Michele Michelotto - Padova

Why

• INFN procurements for Millions of Euro of Worker Node / year– Simulation and Recostruction of HEP events

(mainly offline, so High Troughput Computing)

• How to get the best price/performance

• How to measure the performance

Benchmark

• CERN UNIT, VUPS, MIPS, MHz!– We have about 18000 GHz of CPU ?

• Synthetic Benchmark

• SPEC INT 95– HLT paper model (1996-2000)

• SPEC INT 2000– Computing TDRs (2000-2005)

Different usage of SI2K

• From 2000 to 2006 the default was SPEC CPU INT 2000, (a.k.a. SI2K) used in several ways – Taking data of one cpu from SPEC site– Multiply by the number of cpu in your site– Speed or Rate– Measuring SI2K on real machines with our

compiler (gcc) and the default set of optimization switches

CMS sw SIM and Pythia• CMS Montecarlo

simulation (32bit) and Pythia (64bit) show the same performance once normalized

• Both Specint 2006 pubblished and Specint 2006 with gcc show the same behaviour

• SI2K pubblished does not match HEP sw

• SI2K measured by CERN better but not as good as SI2006

Working group in

• CERN, INFN, GridKa, Desy, RAL, Univ of Victoria

• + Esperts from CMS, ATLAS, ALICE, LHCB

• HEP SPEC 06– Based not only on INT but also on FP– The same ratio of PF as the job running on

lxbatch– Validated against the HEP simulation and

reconstruction code

Validation by

• Working group by WLCG

• HEP SPEC 06 accepted as reference benchmark in HEP and GRID farm

• Pledges are now expressed in HS06

• T0, T1, T2 measured in HS06

HEP SPEC 06 paper

What we need

• At least one Worker node for each new family of processor– One from Intel, one from AMD– Always available. Impossibile on make

measurements on evaluations machine– Need to rerun on old machines

HEP-SPEC06 Westmere processor (dual CPU box)

0

50

100

150

200

250

300

0 5 10 15 20 25 30

Running instances

HEP

-SPE

C 06

5650 64 bit HT OFF

5650 32 bit HT OFF

5650 64 bit HT ON

5640 32 bit HT ON

HEP-SPEC06 Westmere processor (5650 vs 6174)

0.00

50.00

100.00

150.00

200.00

250.00

0 5 10 15 20 25Running instances

HEP

-SPE

C 06

5650 64bit HT ON

5650 32bit HT ON

6174-HP 64bit

6174-HP 32bit

Milestone 1

• SPEC has released in September the version 1.2 of the CPU suite– The score should not change for CPU INT, FP

and hence for our HEP SPEC 06– Need to rerun on all HEPMARK machines

Milestone 2

• HEP SPEC 06 at 64 bit

• Experiments finally moved to full 64bit/64bit

• HEP SPEC 06 still on 32 bit

• HEPIX group addressed this issue in the last meeting.

• We stay with 32 bit since the improvment from 32 to 64 is similar in all processors

New AMD processor

• 2 x 8 Bulldozer core

• Each Bulldozer core has 2 int scheduler

• 32 x-86 core

Many integrated core• In contact with G.Maron (LNL) to start

exploring the “manycore” processors (MIC)

• Mainly in the CNAF area of interest:

Backup slides

michele michelotto - INFN Padova 18

5520 32 bit - HT ON/OFF32 bit HT OFF vs ON

0

20

40

60

80

100

120

140

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

core

HE

P-S

PE

C06

32 bit - HT OFF

32 bit HT ON

HT ON:81.81HT OFF: 95.96HT OFF is better up to 11concurrent run

michele michelotto - INFN Padova 19

5520(2266) vs 2427(2200)

Speed vs Rate

Gcc (gridka) vs SPEC site