Transcript Institut National de Recherche en Informatique et en

ProActive and GCM:
Architecture and Overview of new features
Denis Caromel, et al.
OASIS Team
1.
2.
3.
4.
1
Denis Caromel
ProActive Parallel Suite: Active Objects
Components and Standardization: GCM
Optimizing
Scheduling
History
&
Backgroung
2
Denis Caromel
2
OASIS Team & INRIA
A joint team between: INRIA, Nice Univ. CNRS
•Now about 40 persons
•1997: Started the ProActive Parallel Suite
•2004: First ProActive User Group
•2008: 5th one, many User Presentations
•ProActive 4.0.1: Distributed and Parallel:
From Multi-cores to Enterprise GRIDs
Computer Science and Control
• 8 Centers all over France
• Workforce: 3 800
• 186 Million Euro annual budget
• Strong in standardization committees:
– IETF, W3C, ETSI, …
• Strong Industrial Partnerships
• Foster company foundation:
90 startups so far
- Ilog (Nasdaq, Euronext)
-…
- ActiveEon
3
Denis Caromel
Professional support
Now Available:
Startup Company Born of INRIA
• Co-developing
• Providing support
for Open Source ProActive Parallel Suite
4
Denis Caromel
1.
ProActive Parallel Suite
and
Active Objects
5
Denis Caromel
5
• Written in Java
• Featuring:
Java Parallel
Programming
Multi-Language
Scheduling
6
Denis Caromel
7
Denis Caromel
8
Denis Caromel
ProActive Parallel Suite
9
Denis Caromel
ProActive Parallel Suite
10
Denis Caromel
Distributed and Parallel
Active Objects
11
Denis Caromel
11
ProActive : Active objects
JVM
A ag = newActive (“A”, […], VirtualNode)
V v1 = ag.foo (param);
V v2 = ag.bar (param);
...
v1.bar(); //Wait-By-Necessity
JVM
A
v2 v1 ag
A
WBN!
V
12
Java Object
Active Object
Future Object
Proxy
Denis Caromel
Req. Queue
Request
Thread
Wait-By-Necessity
is a
Dataflow
Synchronization
12
Standard system at Runtime:
No Sharing
NoC: Network On Chip
Proofs of Determinism
13
Denis Caromel
13
TYPED
ASYNCHRONOUS
GROUPS
14
Denis Caromel
14
Creating AO and Groups
JVM
A ag = newActiveGroup (“A”, […], VirtualNode)
V v = ag.foo(param);
...
v.bar(); //Wait-by-necessity
A
V
Typed Group
15
Denis Caromel
Java or Active Object
Group, Type, and Asynchrony
are crucial for Cpt. and GRID
15
Broadcast and Scatter
Broadcast is the default behavior
Use a group as parameter, Scattered depends on rankings
cg ag
JVM
s
c1
c2
c1
c1
c2
c2
c3
c3
c3
JVM
JVM
ag.bar(cg);
// broadcast cg
ProActive.setScatterGroup(cg);
ag.bar(cg);
// scatter cg
JVM
16
Denis Caromel
16
2. Components
and
Standardization (GCM)
17
Denis Caromel
17
Objects to Distributed Components (1)
IoC:
Inversion
Of Control
(set in XML)
A
Example of
component
instance
V
Truly
Distributed
Components
Typed Group
18
Denis Caromel
Java or Active Object
JVM
18
GridCOMP Partners
19
Denis Caromel
GCM
Scopes and Objectives:
Grid Codes that Compose and Deploy
No programming, No Scripting, … No Pain
Innovation:
Abstract Deployment
MultiCast
Composite Components
Multicast and GatherCast
GatherCast
GCM Standardization
Overall, the standardization is supported by industrials:
BT, FT-Orange, Nokia-Siemens, Telefonica,
NEC, Alcatel-Lucent, Huawei …
21
Denis Caromel
ETSI GCM TC Grid Standard
Official Standard No 1
GCM Interoperability Deployment
Official Standard No 2
GCM Application Description
Work Item No 3
GCM Fractal ADL
(Architecture Description Language)
Work Item No 4
GCM Management (Java, C, WSDL API)
22
Denis Caromel
Deploy on Various Kinds of Infrastructures
Internet
Internet
Servlets
Internet
EJBs
Databases
Large
Equipment
Internet
Parallel
Clusters
Machine
Job management for
embarrassingly parallel
application (e.g. SETI)
23
Denis Caromel
Protocols and Scheduler in
GCM Deployment Standard
Protocols:
rsh
ssh
Oarsh
Gsissh
Scheduler, and Grids:
GroupSSH, GroupRSH, GroupOARSH
ARC (NorduGrid), CGSP China Grid, EEGE gLITE,
Fura/InnerGrid (GridSystem Inc.)
GLOBUS
GridBus
IBM Load Leveler, LSF, Microsoft CCS (WHPC 2008)
Sun Grid Engine, OAR, PBS / Torque, PRUN
24
Denis Caromel
3.
Optimizing
25
Denis Caromel
25
26
Denis Caromel
27
Denis Caromel
IC2D
28
Denis Caromel
ChartIt
29
Denis Caromel
Video 1: IC2D
Monitoring, Debugging, Optimizing
30
Denis Caromel
4. Scheduling
31
Denis Caromel
31
32
Denis Caromel
Scheduler and Resource Manager:
User Interface
33
Denis Caromel
Scheduler: User Interface
34
Denis Caromel
Video 2:
Scheduler, Resource Manager
35
Denis Caromel
Summary
36
Denis Caromel
Conclusion:
An Acceleration Toolkit :
Concurrency+Parallelism
Multi-Core+Distributed
37
Denis Caromel
Important New
Developments:
Grid & SOA