Transcript HEPMARK2 - INFN - Sezione di Padova

HEPMARK2
Consiglio di Sezione 9 Luglio 2012
Michele Michelotto - Padova
Why
• INFN procurements for Millions of Euro of
Worker Node / year
– Simulation and Recostruction of HEP events
(mainly offline, so High Troughput Computing)
• How to get the best price/performance
• How to measure the performance
Benchmark
• CERN UNIT, VUPS, MIPS, MHz!
– We have about 18000 GHz of CPU ?
• Synthetic Benchmark
• SPEC INT 95
– HLT paper model (1996-2000)
• SPEC INT 2000
– Computing TDRs (2000-2005)
Different usage of SI2K
• From 2000 to 2006 the default was SPEC
CPU INT 2000, (a.k.a. SI2K) used in
several ways
– Taking data of one cpu from SPEC site
– Multiply by the number of cpu in your site
– Speed or Rate
– Measuring SI2K on real machines with our
compiler (gcc) and the default set of
optimization switches
CMS sw SIM and Pythia
• CMS Montecarlo
simulation (32bit) and
Pythia (64bit) show the
same performance once
normalized
• Both Specint 2006
pubblished and Specint
2006 with gcc show the
same behaviour
• SI2K pubblished does not
match HEP sw
• SI2K measured by CERN
better but not as good as
SI2006
Working group in
• CERN, INFN, GridKa, Desy, RAL, Univ
of Victoria
• + Esperts from CMS, ATLAS, ALICE,
LHCB
• HEP SPEC 06
– Based not only on INT but also on FP
– The same ratio of PF as the job running on
lxbatch
– Validated against the HEP simulation and
reconstruction code
Validation by
• Working group by WLCG
• HEP SPEC 06 accepted as reference
benchmark in HEP and GRID farm
• Pledges are now expressed in HS06
• T0, T1, T2 measured in HS06
HEP SPEC 06 paper
What we need
• At least one Worker node for each new
family of processor
– One from Intel, one from AMD
– Always available. Impossibile on make
measurements on evaluations machine
– Need to rerun on old machines
HEP-SPEC06 Westmere processor (dual CPU box)
300
250
HEP-SPEC 06
200
150
5650 64 bit HT OFF
5650 32 bit HT OFF
5650 64 bit HT ON
100
5640 32 bit HT ON
50
0
0
5
10
15
Running instances
20
25
30
HEP-SPEC06 Westmere processor (5650 vs 6174)
250.00
HEP-SPEC 06
200.00
150.00
5650 64bit HT ON
5650 32bit HT ON
100.00
6174-HP 64bit
6174-HP 32bit
50.00
0.00
0
5
10
15
Running instances
20
25
Milestone 1
• SPEC has released in September the
version 1.2 of the CPU suite
– The score should not change for CPU INT, FP
and hence for our HEP SPEC 06
– Need to rerun on all HEPMARK machines
Milestone 2
• HEP SPEC 06 at 64 bit
• Experiments finally moved to full
64bit/64bit
• HEP SPEC 06 still on 32 bit
• HEPIX group addressed this issue in the
last meeting.
• We stay with 32 bit since the improvment
from 32 to 64 is similar in all processors
New AMD processor
• 2x8
Bulldozer
core
• Each
Bulldozer
core has 2
int
scheduler
• 32 x-86 core
Many integrated core
• In contact with G.Maron (LNL) to start
exploring the “manycore” processors
(MIC)
• Mainly in the CNAF area of interest:
Backup slides
5520 32 bit - HT ON/OFF
32 bit HT OFF vs ON
140
120
HEP-SPEC06
100
80
60
32 bit - HT OFF
40
HT ON:81.81
HT OFF: 95.96
HT OFF is better
up to
11concurrent
run
32 bit HT ON
20
0
1
2
3
4
5
6
7
8
9
10 11 12 13 14 15 16
core
michele michelotto - INFN Padova
18
5520(2266) vs 2427(2200)
32 bit 2427
140
120
100
HS06
80
60
40
32 bit 2427
32 bit 5520 HT ON
32 bit 5520 HT OFF
20
0
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
core
michele michelotto - INFN Padova
19
Speed vs Rate
Gcc (gridka) vs SPEC site