Transcript HEPiX summary GridPP13 meeting, Durham, 6 July 2005 David Kelsey CCLRC/RAL, UK [email protected] 6-Jul-05 D.P.Kelsey, HEPiX summary, GridPP13

HEPiX summary
GridPP13 meeting,
Durham, 6 July 2005
David Kelsey
CCLRC/RAL, UK
[email protected]
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
1
Overview
• HEPiX meeting at FZK, Karlsruhe
– 9 – 13 May 2005
• Not a full summary!
– A brief overview and some pointers for GridPP
• Tony Cass will cover the
Batch Systems Workshop
• Future HEPiX meetings
– 10-14 October 2005 (SLAC)
– 3-7 April 2006 (Rome) (to be confirmed)
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
2
What is HEPiX?
• A global organisation (started in 1991)
– service managers and support staff providing
computing facilities for HEP (and friends)
– Some HEP User/Experiment community
• All operating systems used by HEP covered,
including UNIX, Windows and Grid computing
• For several years was called HEPiX-HEPNT
• Important for LCG Deployment coordination
– HEPiX is the technical coordination body for LCG
– Too date there is little participation by Tier 2’s
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
3
What is HEPiX (2)?
• Two meetings per year
– Europe and North America
• Meetings allow participants to present recent
work and future plans and to share experiences
with other attendees
• Encourages collaboration on topics of common
concern
– Scientific Linux collaboration one of the successes
• Open e-mail list
– [email protected]
– Join via usual Listserv request
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
4
General
Comments
• Spring 2005 HEPiX meeting
– Hosted at FZK (an LCG Tier 1)
– ~100 people attended
http://iwrwww1.fzk.de/hepix/Attendees.html
• Agenda:
– all talks on web
– http://iwrwww1.fzk.de/hepix/Agenda.html
– Video streaming archive? – was shown live
• Format
– 3 full days of HEPiX presentations and discussions
– 1.5 days of Batch Systems Workshop (Chair Tony Cass)
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
5
Agenda (1)
• Topics covered
• Day 1
– Introduction to FZK & 11 Site reports
– Fabric Monitoring (3 talks)
• Day 2
– Security Update (1)
– Storage/Data Management (5)
– IHEPCCC presentation (Guy Wormser)
• Proposal that HEPiX gives technical input (replaces HTASC)
– Scientific Linux (2)
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
6
Agenda (2)
• Day 3
–
–
–
–
–
–
Opteron evaluation (1)
Mail and Spam (2)
Collaborative tools (2)
User Management/Single sign-on (2)
Management of PBS (1)
LCG & Service Challenges (7)
• Days 4 and 5 (Batch systems workshop)
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
7
• Now show a few slides from a few talks
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
8
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
9
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
10
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
11
6-Jul-05
D.P.Kelsey, HEPiX summary, GridPP13
12
Results of the Fermilab 64-bit
Linux Hardware and Software
Evaluation
Spring 2005 HEPiX meeting
Karlsruhe, Germany
Ken Schumacher, Steven Timm
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
13
Benchmarks
• All major Fermilab computing users contributed
benchmarks and people to run them.
– CDF: reconstruction
– D0: reconstruction
– CMS: OSCAR and ORCA simulation and digitization,
Root stress test, Pythia
– SDSS: Supernova search program
– LQCD: QCDStreams, MILC lattice code
– General: seti@home, CERN unit benchmark, tiny
• Many more details in our paper
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
14
CMS Root Benchmark
64-bit mode gives gains on Opterons of about 40%
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
15
Power Draw
In general Opterons draw
10-27% less current at full
load than comparable Xeon
chips.
Vendor
Processor
Idle
Loaded
HP
Opt244
1.54
1.74
Rackable
Opt246HE
1.44
1.61
IBM
Opt246
1.55
1.80
Penguin
Opt248
1.70
1.98
ASA
Opt248
1.91
2.20
CSI
Opt248
1.95
2.30
Sun
Opt248
2.00
2.35
Low voltage Opteron246HE
saves 10-15% over highvoltage Opteron 246.
Koi
Opt250
2.07
2.44
Dell
Xeon3.6
1.66
2.75
Koi
Xeon3.6
1.70
3.10
We need to average 10 kVA
per rack in our facility. Have
many racks now that are
12kVA.
Koi
Xeon3.4
1.60
2.90
Koi
Xeon3.0
1.20
2.70
Koi
Xeon 3.06
1.10
2.30
Koi
Xeon 2.66
1.00
1.90
Four Opteron 248’s vary in
current draw, explained by
increasing numbers of fans
and higher-performance
disk drives.
10kVA/rack = 2.1A/node
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
16
Referances
• Fermilab Evaluation Results:
– http://wwwoss.fnal.gov/scs/public/qualify2005/opteron_e
xternal.ps
• AMD Developer Symposium 2002
– “Optimizing for the AMD Opteron™
Processor” by Tim Wilkens PH.D.
– http://www.amd.com/usen/assets/content_type/DownloadableAssets/
Optimization_-_Tim_Wilkens.pdf
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
17
Conclusions
• 64-bit Linux OS is a stable operating platform
• Opteron CPU and associated platforms have
sufficient reliability for Fermilab production
Farms
• Opteron CPU gives us slightly better
performance for significantly less power draw
and about the same price as Xeon.
• Using 64-bit compilation and optimization can
lead to significant performance gains on AMD
and Intel.
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
18
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
19
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
20
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
21
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
22
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
23
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
24
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
25
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
26
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
27
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
28
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
29
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
30
6-Jul-05
D.P.Kelsey, HEPiX summary,
GridPP13
31