Transcript EGI - IVOA

Enabling Grids for E-sciencE
IVOA Interoperability May 2009
A&A Transition to EGI
C. Vuerli (1,2) and F. Pasian (1,2)
(1) INAF – Astronomical Observatory of Trieste
(2) INAF – Information System Unit
Slides on EGI Model contributed by
Diana Cresti – INFN Padova
Strasbourg, Monday 25 May 2009
www.eu-egee.org
EGEE-III INFSO-RI-222667
EGEE and gLite are registered trademarks
Enabling Grids for E-sciencE
Part I
The Proposed EGI Model
Diana Cresti, INFN Padova
[email protected]
www.eu-egee.org
EGEE-III INFSO-RI-222667
EGEE and gLite are registered trademarks
The EGI Management Structure
Enabling Grids for E-sciencE
Non-voting Representatives
Chair of UFSC, extra-EU NGIs, …
Members
NGI1, NGI2, NGI3, … NGIn
User Forum
Steering
Committee
(UFSC)
Associate Members
CERN, EBI, ESA, …
EGI Council
EGI.org
Legend
EGI Director
Advisory
Committees
e.g.
Middleware
Coordination
Board
(MCB)
EGEE-III INFSO-RI-222667
UCO
CTO
CAO
COO
User Coord
Development
Administration
Operations
User Comm
Services
Development
Group
Administration
Group
Operations
Group
UCO : User Coordination
Officer
CTO : Central Technical
Officer
CAO : Central
Administration Officer
COO : Central
Operational Officer
Monday 25 May 2009 - A&A Transition to EGI
3
EGI User Community Services (UCS)
Enabling Grids for E-sciencE
Examples:
• Gathering requirements from the user communities and providing efficient
channels for their representation with the middleware and software.
E.g.: http://knowledge.eu-egi.eu/index.php/User_Requirements
• Carrying out a review process to integrate useful “external” software – an
extension of the EGEE RESPECT program
• Establishing Science Gateways that expose common tools and services (e.g.
workflow engines, web services, semantic annotation)
• Establishing technical collaborations with the large European Infrastructure projects
(e.g. ESFRI)
• Providing “umbrella” services for collaborating projects
• Maintaining a European Grid Application Database – e.g.
http://grid.ct.infn.it/egee_applications
• Organising User Forum meetings and topical meetings for specific user
communities.
• Providing services for new communities – e.g. “Front desk” services, VO creation
counseling, etc.
• Ensuring that the user communities and grid administrators are provided with
high quality documentation and training services.
For details: http://knowledge.eu-egi.eu/index.php/UCS_Tasks
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
4
Research Teams, Resource Centres, NGIs
Enabling Grids for E-sciencE
Research Teams
Research Institutes
NGI2
NGI1
European Grid Initiative
EGI
NGIn
…
National Grid Initiatives (NGIs)
Resource Centres
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
5
Research Teams, VOs, User Communities
Enabling Grids for E-sciencE
VOB2
VOA
VOB1
User Community A
Researchers / ResTeams
EGEE-III INFSO-RI-222667
VOZ
VOB3
…
User Community B
User Community Z
Research Institutes
Monday 25 May 2009 - A&A Transition to EGI
6
Specialised Support Centres
Enabling Grids for E-sciencE
•
“SSC” is currently an ambiguous term:
1. An SSC is a (physical) centre where grid-related activities are carried
out, and which includes a set of UCS (User Community Services)
activities
2. An SSC is a cluster of UCS activities
•
Either way, an SSC is envisioned to have a european-level
commitment, and will be represented in EGI on several levels
•
An SSC should have a delegate to participate in what we call
the User Forum Steering Committee (see below)
•
SSCs should interact closely with the central EGI.org UCS
team (described in the EGI Blueprint)
•
Two examples – a “large” and a “small” SSC – are sketched
below; these are ideas to inspire some specific proposals by
the user communities
See also
http://knowledge.eu-egi.eu/index.php/Specialised_Support_Centres
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
7
Example of a Large SSC
Enabling Grids for E-sciencE
EGI general
SSC X
SSC Chair (UF delegate)
Other UC Svces:
Grid Planning
Board
“RESPECT”
App DB
EGI User Forum
Steering Committee
GP Rep
Wikis,
repositories
EGI.org MCB
(Grid Planning)
UCS
OPS
Portals,
gateways
MW
User Tech Support
Ops
EGI User Tech Support
Group (e.g. USAG)
Dir Usr Sup
SSC Front Desk
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
8
Example of a small SSC (1/2)
Enabling Grids for E-sciencE
• Purpose: provide “umbrella” services for a
particular user community: for instance Civil
Protection (CP)
• Three projects have been working (in part) on
relevant services:
– Project A: collecting and analyzing CP requirements
– Project B: Data interoperability in the Earth Sciences
– Project C: development of remote instrumentation tools
• These projects have signed MoUs to establish
services for the CP community
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
9
Example of a small SSC (2/2)
Enabling Grids for E-sciencE
•
Project A has ended; it has generated useful info tools
– wikis, repositories, a CP portal
• A dedicated OGF working group has produced a set of
standards, the Open Geospatial Consortium Web
Services – OWS
• Two OWS implementations have been produced and
two more are in the pipeline
• Project C is currently working on a related
implementation: Sensor Observation Service
 A small SSC – perhaps 2 FTEs – could be established
to





provide continuity to Project A tools,
representation of CP community in EGI,
support the OGF working group,
integrate Project C tools via a RESPECT-type process,
help disseminate results to the international community
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
10
The EGI User Forum
Enabling Grids for E-sciencE
EGI User Forum
User Forum Steering Committee - UFSC
SSC1
SSC2
SSC3
SSCn
SSC
SSC
SSC
SSC
SSC
User Technical Support (e.g. USAG)
EGI Middleware Coordination Board - MCB
MW
EGEE-III INFSO-RI-222667
OPS
UCS
Monday 25 May 2009 - A&A Transition to EGI
11
Enabling Grids for E-sciencE
Part II
The Proposed SSC
for Astronomy & Astrophysics
Claudio Vuerli and Fabio Pasian,
INAF Trieste
[email protected]
[email protected]
www.eu-egee.org
EGEE-III INFSO-RI-222667
EGEE and gLite are registered trademarks
SSC Activities and Members
Enabling Grids for E-sciencE
• Scope
– Consolidate and make permanent the presence of the European
Astronomical Community within EGI, the European Grid Initiative
• Activities
– Consolidation and maintenance of A&A VOs already in place
and, if necessary, creation of new A&A VOs
– Interactions with other VOs in EGI
– Porting of new applications on the EGI Grid infrastructure
– Development of tools and services to make the Grid as “user
friendly” as possible
– Considerable effort spent in training/dissemination activities
• Members
– At a first stage member groups are those that currently
contribute to the A&A cluster but the expansion process is
already in progress
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
13
SSC Structure (TBC)
Enabling Grids for E-sciencE
NGI-1
NGI-2
…….
NGI-3
NGI-k
A&A SSC SC (Steering Committee)
EGI UFSC
SSC SC Chair
UTS (User Technical Support)
GPB (Grid Planning Board)
MW Development/Maintenance
User Community Tools/Serv.
GPB
Coordinator
EGI MCB
EGEE-III INFSO-RI-222667
SSC Front Desk
EGI
Users
Community
Operations
Direct User Support
Training/Dissemination
UTS
Coordinator
EGI UTSG
Monday 25 May 2009 - A&A Transition to EGI
14
SSC Structure / II
Enabling Grids for E-sciencE
• SC (Steering Committee)
– Governs the whole SSC
– Members are nominated by supporting NGIs (one for each NGI)
– SC members interact with their respective NGIs
• A&A SSC SC Chair
– Chosen within the SSC SC itself
– Should be member of the EGI UFSC (User Forum SC)
• GPB (Grid Planning Board)
– Mainly deals with development/evolution of the Grid MW
– Groups active in GPB:
 MW development/maintenance
 UCS (User Community Tools/Services)
– GBP driven by a coordinator
– The GPB coordinator should be member of the EGI MCB
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
15
SSC Structure / III
Enabling Grids for E-sciencE
• UTS (User Technical Support)
– Mainly deals with “Operations”, “Direct User Support” and
“Training/Dissemination” being it extremely important for the
evolution of the SSC
– UTS driven by a coordinator
– The UTS coordinator interacts with EGI UTSC (User Technical
Support Group)
• SSC Front Desk
– Gives support to:




members of the EGI main bodies
members of other SSCs
users who ask information about the A&A SSC
others…
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
16
SSC Participation
Enabling Grids for E-sciencE
• NGIs expected to support A&A SSC (“support” in the sense that they
will commit to provide manpower and/or other resources)
– At a first stage all NGIs that include A&A groups currently active in
EGEE-III A&A cluster: Italy, Spain, France, Germany, Netherlands,
UK, Austria, Czech Republic, Slovakia
• Current collaborating projects
– Planck, Magic, LOFAR, AUGER
• ESFRI Projects A&A SSC is expected to be working with
– It is expected to work at least with ELT (Extremely Large Telescope)
and SKA (Square Kilometer Array) A&A projects, but also with
PRACE (Partnership for Advanced Computing in Europe)
– “Collaborating projects” are already actively involved in the EGEE-III
A&A cluster
– Contacts have to be initialized with ESFRI projects instead
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
17
SSC Governance
Enabling Grids for E-sciencE
• It is foreseen to have a SC (Steering Committee)
composed by one representative for each NGI that
supports the SSC. A SC Chair will be nominated within
the SC. Other technical SSC bodies (GPB, UTS and Front
Desk) have to be confirmed
• One of the main goals of the SSC is to consolidate the
presence of the astronomical community in EGI, but also
to expand it by progressively involving astronomical
institutes/groups of all NGIs. As the SSC expands it is
expected that all NGIs will support it and consequently
will have a member in the SC
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
18
SSC Technical Organization
Enabling Grids for E-sciencE
• Will the SSC have its own Grid Planning Board (i.e. local MCB), and if
so, would you be interested in having “specialized” representatives from
the middleware consortia and operations (e.g. a development
coordinator specifically assigned to your thematic area)?
– At present the structure proposed for the SSC includes a GPB; the
SSC structure however has to be further discussed and approved
by partners of the A&A cluster. If the GPB will be created within our
SSC, it is expected that “specialized representatives” coming from
the middleware consortia and from operations will be part of it .
• If you are planning a scientific gateway/portal, do you expect to sustain
it entirely within the SSC, or do you expect some dedicated assistance
from EGI (e.g. within the Operations budget)?
– Some dedicated assistance from EGI is expected in this case
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
19
Relations with other SSCs
Enabling Grids for E-sciencE
• Which other SSCs can you envision having contact with?
– We plan to closely keep in touch with all SSCs of disciplinary
clusters currently in EGEE-III, namely: HEP, Life Sciences, Earth
Sciences, Grid Observatory, Computational Chemistry, Fusion
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
20
SSC Evolution
Enabling Grids for E-sciencE
• Do you have a timetable for the evolution of the SSC?
– Yes, until April 2010 (end of EGEE-III). The related timetable is
shown in the next slide
• How do you expect the SSC to function in 2 - 4 years?
– Starting from May 2010 the main goal of the SSC is to expand and
consolidate at the same time the presence of the astronomical
community in EGI. This implies a growing number of astronomical
research groups from all NGIs that routinely use the grid to run their
applications and requires:
 An intense training/dissemination activity
 The consolidation of the A&A-related VOs currently in place (in terms of
contributed resources, registered users, etc.) and, when necessary, the
creation of new ones
 Close contacts and collaborations with other disciplinary SSCs, with
horizontal SSCs to exploit their tools/services and in general with
EGI.org bodies and contributing NGIs
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
21
SSC Timing
Enabling Grids for E-sciencE
Month
Step
Mar 2009
Apr 2009
Identification of the targeted community (partners of the SSC)
Identification of possible stakeholders
Update of the preliminary draft of the SSC document
Update of the subtask AA2 (Migration to EGI) of the A&A cluster work plan
May 2009
June 2009
EGEE NA4 SSC Workshop in Athens
Survey of the status of all currently active A&A-related VOs
Identification of the individual who will lead the preparation of the SSC proposal (Chair of the
Editorial Committee)
Selection of people who will form the Editorial Committee (in charge of the Chair)
Jul 2009
Dec 2009
The Editorial Committee will provide to:
Finalize the A&A SSC structure
Prepare the A&A SSC proposal
Jan 2010
Feb 2010
Agreed structure of the A&A SSC in place
Mar 2010
Apr 2010
Fixing of possible issues highlighted during the first general meeting
May 2010
SSC is in place and fully operative
Organization of the first SSC general meeting
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
22
EGEE/EGI and the VObs
Enabling Grids for E-sciencE
• The WP5 of EuroVO-DCA ended in
December 2008
• The WP produced a document with
recommendations for standards and best
practices to adopt for what concerns the
relationship between Grid and VObs
• The work done in WP5 must go on. A
subtask AA5 is now part the A&A cluster
work plan
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
23
References
Enabling Grids for E-sciencE
• EGEE-III Home
– http://www.eu-egee.org/
• EGI Home
– http://web.eu-egi.eu/
• EGEE-III Astronomy and Astrophysics Cluster
(Have a look in particular to QRs where significant activity within A&A is reported)
– https://twiki.cern.ch/twiki/bin/view/EGEE/AstronomyAndAstrophysics
• A&A Transition to EGI
– https://twiki.cern.ch/twiki/bin/view/EGEE/AATransitionToEGI
• A&A session at last EGEE User Forum IV (March 2009)
– http://indico.cern.ch/sessionDisplay.py?sessionId=22&slotId=0&confId=4
0435#2009-03-05
– http://indico.cern.ch/sessionDisplay.py?sessionId=26&slotId=0&confId=4
0435#2009-03-05
• List of A&A Cluster Members
– [email protected]
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
24
End
Enabling Grids for E-sciencE
End of Presentation
EGEE-III INFSO-RI-222667
Monday 25 May 2009 - A&A Transition to EGI
25