Transcript Preparation of KIPT (Kharkov) computing facilities for CMS

Preparation of KIPT (Kharkov) computing
facilities for CMS data analysis
L. Levchuk
Kharkov Institute of Physics and Technology (KIPT), Kharkov, Ukraine
• WLCG infrastructure of the CMS
experiment (CMS computing model)
• KIPT T2 center (T2_UA_KIPT): status
and prospects
• Summary
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
2
CERN: acquisition, first-pass reconstruction,
storage & distribution
L.Levchuk, NEC'09, Varna, Bulgaria
[email protected]
1.25 GB/sec
(heavy
ions)09
11 September
3
3
CMS Physics Goals
CMS is expected to shed light on
• origin of particle masses (search for Higgs boson for all
possible MH: does it really exist?)
• origin of “dark matter” in the Universe (search for SUSY
signals)
• origin of asymmetry matter/antimatter in the Universe
(study of CP violation in B decays)
• whether new states of hadronic matter exist (study of heavy
ion collisions)
• if any “exotica” can emerge at the TeV (1012 eV)) scale
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
4
CMS Computing Model
T1_CH_CERN
T2_ * _ *
T1_DE_FZK
T2_UA_KIPT
T2_ * _ *
T2_RU_JINR
T1_ES_PIC
T1_FR_CCIN2P3
T2_ * _ *
50 sites
T1_IT_CNAF
CMS trigger
T0_CH_CERN
T1_TW_ASGC
 T1_UK_RAL
RAW
T1_US_FNAL
~1-3 MB/evt
~100 evt/s
8 sites
T3_ * _*
currently
50 sites
of RECO
Storage
and AOD data
event
reconstruction;
storage of data of
all types (RAW,
RECO, AOD, skim)
L.Levchuk, NEC'09, Varna, Bulgaria
(~0.1-0.3 MB/evt)
Data analysis &
MC production
Connectivity:
~1 Gbit/s;
SE:
~200 TB
WN:
~4 kHSP06
(LHC startup)
WLCG User
Interface (UI);
no special
requirements
for resources
but reasonable
connectivity
with T2
11 September 09
5
CMS Dashboard
KIPT CMS Computing Facility
Storage Element (SE, SRM):
12 nodes (24 CPU’s Intel Xeon EM64T:
203.2 + 42.8 GHz)
11 SATA RAID5 (400 GB disks)
+1 SATA RAID6 (1.0 TB disks)
SRM space:
~ 50 TB (currently), upgrade to
~120 TB by LHC startup (end of 2009)
Type: DPM (SLC4)
Worker Nodes (WN):
HEPSPEC06 Benchmark Results:
system
Dual Intel Xeon EM64T 3.4 GHz
Dual CPU, Quad Core,
Intel Xeon E5420 2.5GHz
68 x86-64 CPU cores
(Intel Xeon EM64T 3.4 GHz &
E5420 2.5GHz), 0.5 kHEPSPEC06
OS
kernel
32/64 mem gcc
benchmark
total per core
SLC5 2.6.18-128.7.1.el5 64
4 GB 4.1.2 S2k6 all_cpp 64bit 13.8 6.9
SLC5 2.6.18-128.7.1.el5 64
16 GB 4.1.2 S2k6 all_cpp 64bit 63.8 8.0
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
7
KIPT CMS Computing Facility
Year
2001
– RH Linux cluster of a few dual PIII nodes
from 2002 on – participation in CMS Monte Carlo production
2003
– Grid middleware (LCG2) deployed for the first time
from 2005 on
– the site registered in WLCG (Kharkov-KIPT-LCG2)
from 2007 on
– SLC cluster built on x86-64 CPU platform
2008
– CMS software (CMSSW & PhEDEx) deployment;
site registration in CMS SiteDB (T2_UA_KIPT)
2009 (June)
– successful commissioning of T2_UA_KIPT
2009 (July)
– T2_UA_KIPT is in “Production”
(“Ready” > 80% of time) !!!
Up to now, the KIPT computing facility remains to be
- the only active WLCG/EGEE site of Ukraine;
- the only CMS RDMS T2 site, which is non-”_RU_”
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
8
Conditions for site ‘Readiness’
The CMS site readiness takes into account several sources of information
to define whether a site is in a good status:
 site availability according to the CMS Site Availability
Monitor (SAM) tests
16 CMS-specific critical tests of CE, SRM (SE) and CMS software in addition to “routine”
WLCG SAM tests; daily SAM availability must be 80%
 fraction of successful jobs submitted by the Job Robot
automatic submission and management of “fake” CMS analysis jobs via WLCG (using
CRAB) (typically, 6×100 jobs/day); daily JR efficiency must be 80%
 number of operational links connecting the site with other
sites
number of commissioned links TO Tier-1 sites ≥ 2
(to commission one such link, site has to sustain ≥ 5 MB/s of LoadTest during 24 hours)
number of commissioned links FROM Tier-1 sites ≥ 4
(to commission one such link, site has to sustain ≥ 20 MB/s of LoadTest during 24 hours)
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
9
04 Sep 2009
12:41
http://dashb-ssb.cern.ch/dashboard/request.py/siteview?
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
10
Commissioning of first 6 T2_UA_KIPT uplinks
LoadTest from: CH_CERN
ES_PIC
L.Levchuk, NEC'09, Varna, Bulgaria
DE_FZK IT_CNAF US_FNAL FR_CCIN2P3
11 September 09
11
Commissioning of first 6 T2_UA_KIPT uplinks (II)
33.02 TB
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
12
Internet Connectivity
Network backbone for academic institutes of Ukraine
Project has been completed in 2007 – 2008 (UARNET)
Frankfurt
Moscow
DE
RU
10 Gbit/s
L’vov
10 Gbit/s
Kiev
Kharkov
KIPT
Connectivity of NSC KIPT
-- 2 Gbit/s
Connectivity of Kharkov-KIPT-LCG2 (T2_UA_KIPT) -- up to 1 Gbit/s
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
13
01 September 2009
T2_UA_KIPT
T2_RU_SINP
T2_RU_JINR
T2_RU_ITEP
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
http://lhcweb.pic.es/cms/SiteReadinessPlots
14
Activity of CMS RDMS T2 sites in August 09
ITEP
KIPT
INR
JINR
SINP
IHEP
RC KI
Units:
average number
of CMS jobs at
a given moment
of the day
Thanks
Peter
L.Levchuk, NEC'09,
Varna,to
Bulgaria
-- MC Production
-- Data Analysis
Kreuzer
11 September 09
15
Resources: available vs. needed
T2_UA_KIPT CMS Т2 site in 2010
pledge for 1st (CMS Comp. ТDR)
half of 2009
SRM Storage (TB)
50
200
WN (kHEPSPEC06)
0.5
4
Connectivity (Gbit/s)
0.4
1.0
For 2-nd half of 2009: storage upgrade up to 120 TB
Major upgrade of CPU capacity is planned for 2010
No problem to have connectivity of 1 Gbit/s right now
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
16
SUMMARY
 Preparation of KIPT WLCG infrastructure for CMS
data analysis is in good progress
 Site T2_UA_KIPT is commissioned (‘Ready’)
 Site T2_UA_KIPT is stable (‘Ready’ >80% of time)
 Upgrade of hardware to fit CMS Computing TDR
requirements is still needed
L.Levchuk, NEC'09, Varna, Bulgaria
11 September 09
17