Transcript Geoff Quigley, Stephen Childs and Brian Coghlan Trinity College Dublin  Grid-Ireland  Quattor  Use description of Quattor • Transactional deployment • Kickstart • Virtualisation.

Geoff Quigley, Stephen Childs
and Brian Coghlan
Trinity College Dublin
 Grid-Ireland
 Quattor
 Use
description
of Quattor
• Transactional deployment
• Kickstart
• Virtualisation
Ireland’s
National Grid Initiative
Grid-Ireland
 QWG
profiles for
gLite
 Pan language
• Compiles to XML
profiles
 Open-source and
extensible
• NCM components
 Use standard tools
• Ant, svn
 Central repository and web-interface
• Python and PHP scripting
 Deploy process
• Check out from SCDB and build with ant
• Sync XML profiles and RPMs to each site
• Any failure causes profiles to revert
• Nodes at each site poll local gridinstall
 Advantages
• Automation reduces mistakes
• Consistent configuration
Stephen Childs
Department of Computer Science
Trinity College Dublin
March 2009
Sites
17 external, ~5 internal
Active admins
7
Managed machines
465 (+29 since October)
Quattor servers
20
Configuration repository
SCDB
Average commits/day
7.09
Virtualization
Xen: 46 (+8) hosts, 164 (+35) guests
Compiler
panc 8.2.4
Monitoring
Nagios, Lemon, MonAMI, Ganglia,
pbswebmon

Monitoring expanded further
• Nagios: adding local probes, writing component for EGEE NCG
• LEMON: upgrade to lemon-web on SL5
• MonAMI fed into Ganglia (DPM, Torque)

Tools
•
•
•
•
•

checkdeps more or less working with new SL5 server
quatview actively used and extended (in SCDB repo)
panc 8.2.4 now in use: debugging and logging useful
SCDB: merged “hierarchical sites” model, tweaked VOMS roles
ncm-accounts: Fixed bug - massive speedup
Issues and future work
• Would still like equivalent to WN speedup integrated in compiler
• Get network, filesystems fully under quattor control
• Consistent scheme for monitoring in QWG
Gathering stats

•

•
Current count of machine profiles:
svn ls –R $GI_REP_URL|sed -n \
'/profiles\/.*\.tpl$/p'
Historic number of machine profiles:
svn ls -r {2008-03-17} -R $GI_REP_URL |sed -n \
'/profiles\/.*\.tpl$/p‘

Number of Xen hosts:
•
find build/xml/ -name '*.xml.dep'|xargs grep -l 'xen/host'|wc –l

Number of Xen guests:
•
find build/xml/ -name '*.xml.dep'|xargs grep -l 'xen/guest'|wc –l

SVN checkin stats:
•
http://mpy-svn-stats.berlios.de/

high-level overview of quattor:
• http://quattor.org/wiki/Overview

overview of grid-ireland setup:
• http://quattor.org/wiki/Grid_Ireland_Details

collection of links for quattor users (including
tutorials):
• http://quattor.org/wiki/For_Users

pan language manual:
• http://sourceforge.net/project/downloading.php?group_i
d=221766&filename=pan-language-manual-8.2.8.pdf

wiki for the core templates we use:
• http://quattor.org/qwg