Transcript OGSA OVERVIEW - LNL-INFN

CMS
LNL
OGSA INFRASTRUCTURE
EVALUATION
Specification & Applications
Giuliano Rorato
INFN – Laboratori Nazionali di Legnaro
CMS
Why OGSA
LNL
 Our interest in OGSA (Open Grid Services Architecture) technology is about a
possible application in the online software of CMS. In particular for RCMS.

OGSA: defines mechanisms for managing distribuited entities.

RCMS: distribuited services system for the run control of CMS.
OGSA framework
RCMS Services
Giuliano Rorato - INFN - LNL
19/11/2002
2
CMS
Open Grid Services Architecture

OGSA: Grid system architecture based on an integration of GRID and Web
Services concepts and technologies.

Initial proposed technical specification: Globus project and IBM
•

LNL
Put forward at the Globus Grid Forum: for discussion, refinement, and
eventual standardization
2002-2003: Globus Toolkit  OGSA-compliant Globus Toolkit 3.0

Now there is the Preview Release 5
•
www.globus.org/ogsa/releases/TechPreview/
Giuliano Rorato - INFN - LNL
19/11/2002
3
CMS
Web Services vs Grid Services
LNL
 WEB SERVICE: interface that describes a collection of operations that are
network accessible through standardized XML messaging

WSDL (Web Services Description Language): language XML-based that
describe the web service (accessible operations and location)
 GRID SERVICE: web service that conforms to a set of conventions (interfaces and
behaviors) that define how a client interacts with a Grid Service
Giuliano Rorato - INFN - LNL
19/11/2002
4
CMS
OGSA - Definition

LNL
The Open Grid Services Architecture (OGSA) defines mechanisms for creating,
managing, and exchange information among entities called Grid Services
 Grid Service instance: (persistent or transient) service that conforms to a set of
conventions (expressed as WSDL interfaces, extensions, and behaviors) for such
purposes as lifetime management, discovery of characteristics, notification, and so
forth, described from a WSDL PortType

PortType: a WSDL element that describes a collection of message signatures
(operation elements) that define the abstract interface of the Web Service

Grid Service instances are made accessible to client applications through the
use of a GSH and a GSR
•
GSH (Grid Service Handle): URI (uniform resource idetifier) that
identifies in univocal way a instance, directs to a GSR
•
GSR (Grid Service Reference): WSDL document that contains
informations about the location of the instance
Giuliano Rorato - INFN - LNL
19/11/2002
5
CMS
GSH e GSR
GSH1
GSR1
URI
WSDL
Document
1
www.pc2.it/gsr1
LNL
Grid Service
Instance
1
Client
GSH2
GSR2
URI
WSDL
Document
2
www.pc3.it/gsr2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid Service
Instance
2
6
CMS
Grid Service PortTypes (1)
LNL
 A Grid Service can implement following PortType:

GridService: encapsulates the root behavior of the component model

HandleResolver: mapping form a GSH to a GSR

NotificationSource: allows clients to subscribe to notification messages

NotificationSubscription: defines the relationship between a single
NotificationSource and NotificationSink pair

NotificationSink: defines a single operation for delivering a notification
message to the service instance that implements the operation

Factory: standard operation for creation of Grid Service instances

Registration: allows clients to register and unregister registry contents
Giuliano Rorato - INFN - LNL
19/11/2002
7
CMS
Grid Service PortTypes (2)
Service data access
Grid Service
…other interfaces…
(required)
(opzional)
LNL
Standard:
Explicit destruction
-Notification
Soft-state lifetime
-Authorization
-Service creation
-Service registry
Implementation
-Manageability
-Concurrency
Hosting environment/runtime
(“C”, J2EE, .NET, …)
Giuliano Rorato - INFN - LNL
19/11/2002
+ applicationspecific interfaces
8
CMS
WSDL Extensions
LNL
 OGSA architecture introduced WSDL extensions to allow Grid Service
implementation

New WSDL elements:
•
serviceData: represents properties of the service’s state that may be
externally queried
•
serviceDataDescription: formal description of serviceData elements
•
Convention on portType name: naming conventions and immutability of
portType names
•
Grid Service Reference
•
Grid Service Handle
Giuliano Rorato - INFN - LNL
19/11/2002
9
CMS
ServiceData Concept (1)
LNL
 Service data: to support discovery, introspection, and monitoring of Grid Service
instanceò it refers to descriptive information about Grid Service instance, including

Meta-Data: information about the service instance

State Data: runtime properties of the service instance
 Each Grid Service instance has an associated set of SDEs (each one is represented
in XML by a serviceData element)
Giuliano Rorato - INFN - LNL
19/11/2002
10
CMS
ServiceData Concept (2)
LNL
 serviceData elements samples:
Instance’s data which value
can change at runtime
Giuliano Rorato - INFN - LNL
19/11/2002
11
CMS
ServiceData Concept (3)
LNL
 Each Grid Service instance is associated with a set of SDEs. This set is modelled as
a serviceDataSet:
serviceData cpuSpeed
with relative description:
type, value
serviceData
configuration with
relative description
Giuliano Rorato - INFN - LNL
19/11/2002
12
CMS
Grid Service =
LNL
Interfaces + Service Data
cpuLoad
Counter value
Giuliano Rorato - INFN - LNL
19/11/2002
13
CMS
Example of Grid Service : DB Service
LNL
 A DBaccess Grid Service has at least two portType

GridService

DBaccess
 Each has any serviceData

GridService: base informations, lifetime informations,…

DBaccess: kind of database, query languages supported, current load,…
Giuliano Rorato - INFN - LNL
19/11/2002
14
CMS
Example of Grid Service : DB Service
LNL
 The UK e-Science Institute collaborate in the OGSA Project, and it implemented a
Grid Data Service, a Grid Service with portType to work with many database
(relational, XML-DB, …)

http://umbriel.dcs.gla.ac.uk/NeSC/general/
Grid
Service
XML-DB
portType
Relational-DB
portType
…
Grid Data Service
Giuliano Rorato - INFN - LNL
19/11/2002
15
CMS
GridService portType: operations
LNL
 FindServiceData: query the service data
 RequestTerminationAfter: request that the termination time of this service be
changed
 RequestTerminationBefore: request that the termination time of the service be
changed
 Destroy: explicity request destruction of this service
Client
Giuliano Rorato - INFN - LNL
19/11/2002
16
CMS
Factory portType
LNL
 It is used by a client to create an instance of a Grid Service
 It is a Grid Service that must implement the Factory portType, which provides a
standard WSDL operation for creation of Grid Service instances

The used operation is: CreateService
Grid
Service
Counter
Factory
User
Application
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
17
CMS
Factory portType
LNL
 It is used by a client to create an instance of a Grid Service
 It is a Grid Service that must implement the Factory portType, which provides a
standard WSDL operation for creation of Grid Service instances

The used operation is: CreateService
Grid
Service
Counter
Factory
CreateService
User
Application
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
18
CMS
Factory portType
LNL
 It is used by a client to create an instance of a Grid Service
 It is a Grid Service that must implement the Factory portType, which provides a
standard WSDL operation for creation of Grid Service instances

The used operation is: CreateService
Grid
Service
Counter
Factory
CreateService
User
Application
Counter
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
19
CMS
Registration
LNL
 A registry is a Grid Service that maintains a collection of GSH, with policies
associated with that collection. Clients may query the registry to discover what
services are available
 The registration portType allows clients to register and unregister registry content
 The registry makes available a WS-Inspection document (defined with the Web
Services Inspection Language – WSIL) to aid in discovery of the services in that
registry
Giuliano Rorato - INFN - LNL
19/11/2002
20
CMS
Registration
Grid
Service
LNL
Registry
portType
User
Application
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
21
CMS
Registration
Grid
Service
User
Application
LNL
Registry
portType
RegisterService(locator 1)
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
22
CMS
Registration
Grid
Service
User
Application
LNL
Registry
portType
RegisterService(locator 1)
GSH 1
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
23
CMS
Registration
Grid
Service
LNL
Registry
portType
User
Application
GSH 1
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
24
CMS
Registration
Grid
Service
User
Application
LNL
Registry
portType
UnregisterService(GSH 1)
GSH 1
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
25
CMS
Registration
Grid
Service
LNL
Registry
portType
User
Application
Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
26
CMS
Transients Database Services
Giuliano Rorato - INFN - LNL
19/11/2002
LNL
27
CMS
Notification
LNL
 The purpose of the notification is to deliver interesting messages from a
notification source to a notification sink

Notification source: sender of the notification messages

Notification sink: Grid Service instance that receives notification messages
from any number of sources

Notification message: XML element sent from a notification source to a
notification sink

Subscription expression: XML element that describes what messages should
be sent from the notification source to the notification sink
Giuliano Rorato - INFN - LNL
19/11/2002
28
CMS
Notification portTypes
LNL
 NotificationSource portType

Subscribe
 NotificationSubscription portType: used from Clients to manage the subscription
(lifetime and others properties)
 NotificationSink portType

deliverNotification
Giuliano Rorato - INFN - LNL
19/11/2002
29
CMS
USE CASE OF NOTIFICATION
Grid
Service
LNL
Notification
portType
User
Application
X=0
Service Provider
serviceData
Giuliano Rorato - INFN - LNL
19/11/2002
30
CMS
USE CASE OF NOTIFICATION
Grid
Service
User
Application
LNL
Notification
portType
Subscribe(x=1, sink, exp time)
X=0
Service Provider
serviceData
Giuliano Rorato - INFN - LNL
19/11/2002
31
CMS
USE CASE OF NOTIFICATION
Grid
Service
LNL
Notification
portType
User
Application
X=0
Service Provider
serviceData
Giuliano Rorato - INFN - LNL
19/11/2002
32
CMS
USE CASE OF NOTIFICATION
Grid
Service
LNL
Notification
portType
User
Application
X=1
Service Provider
serviceData
Giuliano Rorato - INFN - LNL
19/11/2002
33
CMS
USE CASE OF NOTIFICATION
Grid
Service
User
Application
LNL
Notification
portType
DeliverNotification(x=1)
X=1
Service Provider
serviceData
Giuliano Rorato - INFN - LNL
19/11/2002
34
CMS
HandleResolver portType
LNL
 A Handle Resolver is a Grid Service instance that implements the HandleResolver
portType

FindByHandle: returns a serviceLocator, which contains one or more GSR
(Grid Service Reference) for a GSH (Grid Service Handle)
Giuliano Rorato - INFN - LNL
19/11/2002
35
CMS
Example: Data Mining for
Bioinformatics
Community
Registry
Mining
Factory
LNL
Database
Service
DB 1
Compute Service Provider
User
Application
“I want to create a
personal database
containing data on
e.coli metabolism”
Database
Factory
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
36
CMS
Example: Data Mining for
Bioinformatics
“Find me a data
mining service, and
somewhere to store
data”
Community
Registry
Mining
Factory
LNL
Database
Service
DB 1
Compute Service Provider
User
Application
Database
Factory
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
37
CMS
Example: Data Mining for
Bioinformatics
Community
Registry
GSHs for Mining
and Database
factories
User
Application
Mining
Factory
LNL
Database
Service
DB 1
Compute Service Provider
Database
Factory
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
38
CMS
Example: Data Mining for
Bioinformatics
Mining
Factory
Community
Registry
Database
Service
DB 1
“Create a data mining
service with initial
lifetime 10”
User
Application
LNL
Compute Service Provider
“Create a database with
initial lifetime 1000”
Database
Factory
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
39
CMS
Example: Data Mining for
Bioinformatics
Mining
Factory
Community
Registry
“Create a data mining
service with initial
lifetime 10”
User
Application
Miner
LNL
Database
Service
DB 1
Compute Service Provider
“Create a database with
initial lifetime 1000”
Database
Factory
Database
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
40
CMS
Example: Data Mining for
Bioinformatics
Community
Registry
Mining
Factory
LNL
Query
DB 1
Miner
Keepalive
Database
Service
Compute Service Provider
Query
User
Application
Keepalive
Database
Factory
Database
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
41
CMS
Example: Data Mining for
Bioinformatics
Community
Registry
LNL
Mining
Factory
Database
Service
DB 1
Miner
Keepalive
Compute Service Provider
Results
User
Application
Keepalive
Database
Factory
Database
Database
Service
Results
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
42
CMS
Example: Data Mining for
Bioinformatics
Community
Registry
Mining
Factory
Miner
LNL
Database
Service
DB 1
Compute Service Provider
User
Application
Keepalive
Database
Factory
Database
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
43
CMS
Example: Data Mining for
Bioinformatics
Community
Registry
Mining
Factory
LNL
Database
Service
DB 1
Compute Service Provider
User
Application
Keepalive
Database
Factory
Database
Database
Service
DB n
Storage Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
44
CMS
Code Preview
LNL
 Grid Service Container Frameworks:

Java

.NET

“C”
 In this moment there are many java hosting environment:
1.
Servlet: OGSA container is put into a standard Java Servlet Engine
2.
EJB: OGSA container is put into a EJB Application Server
Giuliano Rorato - INFN - LNL
19/11/2002
45
CMS
Java Container Framework
LNL
 OGSA Core endorsed Java Specifications:
 Apache Axis (Web Services Container)
 JAXP (XML Parsing)
 JAX-RPC
 J2EE
• EJB
• JMS
• JNLP (Java Network Launch Protocol, used for the mobile Java code)
 Documentation: still poor and with not much examples
Giuliano Rorato - INFN - LNL
19/11/2002
46
CMS
Counter Example
Grid
Service
LNL
Counter
Factory
Counter
Client
“I want to create a
Counter Grid
Service”
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
47
CMS
Counter Example
Grid
Service
LNL
Counter
Factory
CreateService
Counter
Client
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
48
CMS
Counter Example
Grid
Service
LNL
Counter
Factory
CreateService
Counter
Client
Counter
X=0
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
49
CMS
Counter Example
Grid
Service
Counter
Client
LNL
Counter
Factory
Subscribe(X)
Counter
X=0
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
50
CMS
Counter Example
Grid
Service
LNL
Counter
Factory
Counter
Client
Counter
I want to Add “10”
and then Subtract
“5”
X=0
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
51
CMS
Counter Example
Grid
Service
Counter
Client
LNL
Counter
Factory
Add (10)
Counter
X=0
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
52
CMS
Counter Example
Grid
Service
LNL
Counter
Factory
Counter
Client
Counter
X=10
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
53
CMS
Counter Example
Grid
Service
Counter
Client
LNL
Counter
Factory
Notify (10)
Counter
Counter State = 10
X=10
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
54
CMS
Counter Example
Grid
Service
Counter
Client
LNL
Counter
Factory
Subtract (4)
Counter
X=10
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
55
CMS
Counter Example
Grid
Service
LNL
Counter
Factory
Counter
Client
Counter
X=6
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
56
CMS
Counter Example
Grid
Service
Counter
Client
LNL
Counter
Factory
Notify (6)
Counter
Counter State = 6
X=6
Compute Service Provider
Giuliano Rorato - INFN - LNL
19/11/2002
57
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
CreateService
Client
Giuliano Rorato - INFN - LNL
19/11/2002
58
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
CreateService
Client
Giuliano Rorato - INFN - LNL
19/11/2002
59
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
CreateService
Client
LOG
Giuliano Rorato - INFN - LNL
19/11/2002
60
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
CreateService
Client
LOG
Giuliano Rorato - INFN - LNL
19/11/2002
61
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
GSH1
CreateService
Client
LOG
Giuliano Rorato - INFN - LNL
19/11/2002
62
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
GSH1
CreateService
Client
LOG
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
63
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
GSH1
CreateService
Client
LOG
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
64
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
GSH1
CreateService
Client
LOG
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
65
CMS
Log Grid Service Example
Grid
Service
LNL
Log
Factory
Registry
GSH1
CreateService
Client
LOG
Message
Producer
GSH1
Giuliano Rorato - INFN - LNL
19/11/2002
66
CMS
Log Grid Service Example
Grid
Service
Log
Factory
LNL
Message
Subscriber
Registry
GSH1
CreateService
Client
LOG
Message
Producer
GSH1
Giuliano Rorato - INFN - LNL
19/11/2002
67
CMS
Log Grid Service Example
Grid
Service
Log
Factory
LNL
Message
Subscriber
Registry
GSH1
CreateService
Client
LOG
Message
Producer
GSH1
Giuliano Rorato - INFN - LNL
19/11/2002
68
CMS
Log Grid Service Example
Grid
Service
Log
Factory
LNL
Message
Subscriber
Registry
Sink
GSH1
Source
CreateService
Client
LOG
Message
Producer
GSH1
Giuliano Rorato - INFN - LNL
19/11/2002
69
CMS
Log Grid Service Example
Grid
Service
Log
Factory
LNL
Message
Subscriber
Registry
Sink
GSH1
Source
CreateService
Client
LOG
Message
Producer
GSH1
Giuliano Rorato - INFN - LNL
19/11/2002
70
CMS
Log Grid Service Example
Grid
Service
Log
Factory
LNL
Message
Subscriber
Registry
Sink
GSH1
Source
CreateService
Client
LOG
Message
Producer
GSH1
Giuliano Rorato - INFN - LNL
19/11/2002
71
CMS
Log Grid Service Example
Grid
Service
Log
Factory
Registry
Ciao
LNL
Message
Subscriber
Sink
GSH1
Source
CreateService
Client
LOG
Message
Producer
GSH1
Giuliano Rorato - INFN - LNL
19/11/2002
72
CMS
“Balanced” Log Grid Service
Grid
Service
(in progress)
LNL
Log
Factory
Registry
GSH1
GSHn
CreateService
Client
LOG 1
…
LOG n
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
73
CMS
“Balanced” Log Grid Service
Grid
Service
(in progress)
LNL
Log
Factory
Registry
GSH1
GSHn
CreateService
Client
LOG 1
…
LOG n
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
74
CMS
“Balanced” Log Grid Service
Grid
Service
(in progress)
LNL
Log
Factory
Registry
GSH1
GSHn
CreateService
Client
LOG 1
…
LOG n
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
75
CMS
“Balanced” Log Grid Service
Grid
Service
(in progress)
LNL
Log
Factory
Registry
GSH1
GSHn
CreateService
Client
LOG 1
…
LOG n
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
76
CMS
“Balanced” Log Grid Service
Grid
Service
(in progress)
LNL
Log
Factory
Registry
GSH1
GSHn
CreateService
Client
LOG 1
…
LOG n
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
77
CMS
“Balanced” Log Grid Service
Grid
Service
(in progress)
LNL
Log
Factory
Registry
GSH1
GSHn
CreateService
Client
LOG 1
…
LOG n
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
78
CMS
“Balanced” Log Grid Service
Grid
Service
(in progress)
LNL
Log
Factory
Registry
GSH1
GSHn
CreateService
Client
LOG 1
…
LOG n
Message
Producer
Giuliano Rorato - INFN - LNL
19/11/2002
79
CMS
Resources Discovery
Grid
Service
Resource
Factory
Grid
Service
Registration
portType
LNL
REGISTRY
GSH
STATE
CreateXDaq
Client
Giuliano Rorato - INFN - LNL
19/11/2002
80
CMS
Resources Discovery
Grid
Service
Resource
Factory
Grid
Service
Registration
portType
LNL
REGISTRY
GSH
STATE
CreateXDaq
Client
Giuliano Rorato - INFN - LNL
19/11/2002
81
CMS
Resources Discovery
Grid
Service
Grid
Service
Resource
Factory
Registration
portType
LNL
REGISTRY
GSH
STATE
GSH 1
CreateXDaq
Client
Grid
Service
Resource
1
Giuliano Rorato - INFN - LNL
19/11/2002
82
CMS
Resources Discovery
Grid
Service
Grid
Service
Resource
Factory
Registration
portType
LNL
REGISTRY
GSH
CreateXDaq
Client
Grid
Service
STATE
Resource
1
Giuliano Rorato - INFN - LNL
19/11/2002
83
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Resource
Factory
Grid
Service
Registration
portType
LNL
REGISTRY
GSH
STATE
GSH 1
ON
Resource
1
Giuliano Rorato - INFN - LNL
19/11/2002
84
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
Resource
1
Grid
Service
LNL
REGISTRY
GSH
STATE
GSH 1
ON
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
85
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
Resource
1
Grid
Service
LNL
REGISTRY
GSH
STATE
GSH 1
ON
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
86
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
Resource
1
Grid
Service
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
87
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
Resource
1
Grid
Service
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
88
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Keepalive
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
89
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
Resource
1
Grid
Service
LNL
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Grid
Service
Resource
3
90
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
Resource
1
Grid
Service
LNL
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Grid
Service
Resource
3
91
CMS
Resources Discovery
Grid
Service
CreateXDaq
Client
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
Resource
1
Grid
Service
LNL
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Grid
Service
Resource
3
92
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
93
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
94
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
95
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
96
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
97
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
98
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
OFF
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
99
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
100
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
101
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
102
CMS
Resources Discovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Client
CreateXDaq
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
Grid
Service
Resource
3
103
CMS
Resources AutoDiscovery
Grid
Service
Grid
Service
Resource
Factory
Registration
portType
LNL
REGISTRY
GSH
STATE
GSH 1
ON
Client
Grid
Service
Resource
1
Giuliano Rorato - INFN - LNL
19/11/2002
104
CMS
Resources AutoDiscovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
105
CMS
Resources AutoDiscovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
106
CMS
Resources AutoDiscovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
107
CMS
Resources AutoDiscovery
Grid
Service
Registration
portType
Grid
Service
Resource
Factory
LNL
REGISTRY
GSH
STATE
GSH 1
ON
GSH 2
ON
Client
Grid
Service
Resource
1
Grid
Service
Resource
2
Giuliano Rorato - INFN - LNL
19/11/2002
108
CMS
Problems
LNL
 The problems to use this architecture are in the lack of documentation and in the
presence of little bug, although they are correct in slightly time
 FORUM
• [email protected]
Giuliano Rorato - INFN - LNL
19/11/2002
109
CMS
OGSA for RCMS?
LNL
 All the RCMS Services can be developed (or re-implemented) under
the OGSA framework
 Some OGSA features can be exploited to design the services (e.g.
publish/subscribe in the IMS)
 Benefits for the overall RCMS infrastructure
 Services instantiation / Job Control (Factory)
 Services location (Registry)
 Uniform development platform
 Built-in security mechanism (at the service level)
 Common mechanism to access the services (api for clients):
• SOAP
• Wsdl
• portTypes
• Software State (e.g. to monitor the service itself)
 Cons
 Dependence from the Globus/IBM OGSA implementation
Giuliano Rorato - INFN - LNL
19/11/2002
110
CMS
OGSA enabled DAQ resources?
LNL
RCMS
RS
RCMS
IMS
RCMS
JC
GRID DAQ
Service
Resource
Discovery
System Info/Alarm
(CPU, Mem,etc.)
Generic
DAQ Node
• built-in resource
discovery
XDAQ Control
(start / kill / inspection)
• Notify mechanism
in case of hardware
errors (e.g. disk full)
XDAQ
Exec
RCMS
FM
XDAQ
Appl 1
XDAQ
Appl 2
Benefits:
• homogenous
control
infrastructure
• Node Services
(e.g. node monitor)
XDAQ
Appl n
• Application Job
Control (e.g. XDAQ)
XDAQ OGSA Compliant?
• very usefull a XDAQ service description in WSDL
Giuliano
Rorato - INFN - LNL
• very usefull a notify mechanism OGSA
compliant
• Registry/factory/discovery mechanisms can19/11/2002
be done by the GRID DAQ Service
111
CMS
OGSA BASED RCMS INFRASTRUCTURE
LNL
RCMS SERVICES
REGISTRIES, FACTORIES
DATABASE SERVICES
PortTypes
SQL
XML:DB
DAQ SERVICES
Giuliano Rorato - INFN - LNL
19/11/2002
112
CMS
Conclusions
LNL
 OGSA evaluation in progress based on a preview code
 First feedback positive based on the working examples
implemented
 Performance tests needed, wait for alfa version implementation
(January 2003)
 Discussion started on the use of OGSA in the RCMS context
Giuliano Rorato - INFN - LNL
19/11/2002
113
CMS
Future Development
LNL
 Gennaio 2003  OGSA ALPHA-Version

More documentation and examples

Correction of Bugs

New hosting environments (“C”)

...
Giuliano Rorato - INFN - LNL
19/11/2002
114
CMS
BIBLIOGRAPHY
LNL
[1] – www.globus.org/ogsa
[2] – www.globus.org/ogsa/releases/TechPreview/ - OGSA Release Preview 4
[3] – Open Grid Services Architecture: An Introduction – Ian Foster
[4] – Grid Service Specification (Draft 4, October 4, 2002)
[5] – Ogsa Physiology Paper
[6] – Building Web Services with Java – Steve Graham
Giuliano Rorato - INFN - LNL
19/11/2002
115