Transcript Document 7406080

The Resource Selection Service: Direction and Plan
The Resource Selection Service:
Direction and Plan
• The ReSS Project
• FY08 Plan and Milestones
• Concerns
Grid Coordination Meeting on Workload Management
Gabriele Garzoglio
Computing Division, Fermilab
06 Nov 2007
Nov 06, 2007
Gabriele Garzoglio
1/5
The Resource Selection Service: Direction and Plan
The ReSS Project
• Goal: Provide a Cluster-level Resource
Selection Service Integrating Off-the-shelf
Technologies
• Stakeholders:
– DZero, DES, OSG Engagement
– Fermigrid
– OSG
• Budgeted FTE
– 0.3 FTE for FY08
– Gabriele and Tanya
Nov 06, 2007
Gabriele Garzoglio
2/5
The Resource Selection Service: Direction and Plan
• Users express cluster requirements in the JDL
• Jobs sit in the site batch system queue until execution
• ReSS can be queried and info passed to VO matchmaker
VO / Grid
Interface
ReSS: Pushing Jobs to Sites
ReSS
job
Grid
Info
Gatherer
classads
Condor
Match Maker
Gate 3
VO
What Gate?
Condor
Scheduler
job
classads
classads
classads
Site
Grid / Site Interface
Gate1
CEMon
jobs
Gate2
info
CE job-managers GIP
job-managers
job-managers
CLUSTER
Nov 06, 2007
CEMon
jobs
Gate3
info
CE job-managers GIP
job-managers
job-managers
CLUSTER
Gabriele
Garzoglio
CEMon
jobs
info
CE job-managers GIP
job-managers
job-managers
CLUSTER
3/5
The Resource Selection Service: Direction and Plan
Plan and Milestones
Project
Task
ReSS
Support usage of ReSS
in OSG and FermiGrid
Stakeholders
All
Effort
Milestones
Status
0.1 FTE Mo
Support from
sites decreased
to “noise” level
Ongoing
ReSS
FermiGrid
OSG Users
Define methods to
advertise custominformation
Engage /
FermiGrid /
OSG
ReSS
Add “Storage” and
“Software” to classad
FermiGrid /
OSG
ReSS
Upgrade to CEMon
v1.7.13
ReSS
WMS
Integrate ReSS w/
Glidein WMS
CMS / CDF
0.2 FTE Mo
ReSS
Support deployment of
new CEMon on OSG
v1.0.0
All
0.1 FTE Mo
Nov 06, 2007
All
0.2 FTE Mo
0.25 FTE Mo
0.25 FTE Mo
Gabriele Garzoglio
Nov 07
- MPI
- SubClusterselection
Jan 07
- Dev. Ready
for ITB tests
Jan 07
- Dev. Ready
for ITB tests
Jan 07
- Demo
Integration
Support from
sites decreased
to “noise” level
Working
on GIP
config
Planned
for Nov 15
Planned
for Nov 15
Envisioned
For 4st Q
2007
Ongoing
after Feb
08
4/5
The Resource Selection Service: Direction and Plan
Concerns
• Deployment of CEMon in OSG v1.0.0:
how many months will we have to cope
with 2 info schemas from sites?
• GIP problems show up as CEMon
problems. Understanding how to allow
sites to self-detect the difference.
• Better integration of ReSS with Glidein
WMS
Nov 06, 2007
Gabriele Garzoglio
5/5