Transcript Slide 1

IT’10
Grid servisi prilagođeni korisnicima i
digitalni identitet istraživača
Services oriented towards grid users
and researchers' digital identity
Branko Marović
Belgrade University Computing Center, Serbia
[email protected]
Žabljak
25.2.2010
IT’10
Žabljak
25.2.2010
Grid market
IT’10
The reality for the user


Many application domains start using
Grid infrastructures
But…

Grid technology is complex

Different systems are used




Different programming paradigms




Žabljak
25.2.2010
Middleware (Unicore, gLite, Globus)
Installation (rpm, tar, Quattor, …)
Monitoring
Batch type systems vs. service oriented
systems
Many programming languages
The threshold is to high for the
“standard” user!
IT’10
Grid application lifecycle

In most cases, scientists have their
application(s)


They want to collaborate




Žabljak
25.2.2010
Join Virtual Organisations
Use infrastructure
Start a Grid project
Interact with the Grid without
knowing all details


Legacy code (FORTRAN, C, C++, …)
Development, deployment, testing,
management, …
Tooling is necessary!
IT’10

Application Users

Application Developers
(Scientists)
(eScience)

Service/Resource Providers
(e-Infrastructure)
Žabljak
25.2.2010
Grid project
Resource Broker
Computing
Replica Manager
Storage
Applications
Infrastructure
Grid project
Infrastructure
Providers
Virtual
Organisations
Members
Programming
languages
Policies
Service
Providers
Roles
Domain
services
Batch apps
Interactive apps
Workflows
Web services
A. Gap.
User Applications using Grid
User Applications
Grid Applications
Application
Users
Application
Developers
(Grid) Middleware
Resources
Resource
Providers
IT’10
Grid angst






“Grid needs to be easier to use for all of us (users and
tool developers)”
“the Grid is hard for users because it is complicated and
the complication is not hidden (yet?)”
“Don’t show me your grid – I don’t care. It should Just
Work”
“Horrible to install and horrible to configure.”
“None are nicely integrated with existing non-grid
systems-management practice.”
“The interfaces are so unstable.”
User
Applications
Žabljak
25.2.2010
Moderate
Specialist
High end Biologists General
Physicists
Many apps
One-off
Projects
Grid Middleware
IT’10
Barriers to adoption




Gap between the resource providers and
the application developers
Infrastructure perspective - not a user
perspective
Grid applications instead of User
applications that use a Grid
Tooling is necessary!







Žabljak
25.2.2010
Wizards, Editors, …
Hide the complexity
Agile and Rapid development
Rapid assembly of content and functionality
Stable, Open 3rd party
Familiar and reliable abstraction
Grid Web portals fulfill some, bur not all
above requirements
IT’10
Standards - Global Grid Forum





Žabljak
25.2.2010
Community-driven set of working groups
that are developing standards and best
practices for distributed computing efforts
Three primary functions: community,
standards, and operations
Standards Areas: Infrastructure, Data,
Compute, Architecture, Applications,
Management, Security, and Liaison
Community Areas: Research Applications,
Industry Applications, Grid Operations,
Technology Innovations, and Major Grid
Projects
Community Advisory Board represents the
different communities and provides input
and feedback to GGF
IT’10
OGSA - Open Grid Services Architecture
OGSA
Grid Technologies



Žabljak
25.2.2010
Web Services
Integrates grid technologies with Web
Services
WS-Resource Framework - interact with
stateful resources
“OGSA enables the integration of services
and resources across distributed,
heterogeneous, dynamic, virtual
organizations – whether within a single
enterprise or extending to external
resource-sharing and service-provider
relationships.”
IT’10
The g-Eclipse project
EC STREP, 24 months, 2 M€, 6 Partners
http://www.geclipse.eu

Eclipse based framework for other EC Grid
projects and

Using EGEE infrastructure

Middlewares






Žabljak
25.2.2010
gLite
GRIA
Amazon cloud Webservices (AWS): Elastic Compute
Cloud (EC2), the Simple, Storage Service (S3),
SimpleDB and the Simple QueueService (SQS)
UNICORE, Globus Toolkit?
Open for contributions - integration support for
third party developments
Fostering an open source project within the
Eclipse community
Screenshots I
Grid project view
Cheat Sheets
Editor
Auth Token View
Glue Info view
VOMS Web view
IT’10
DGI D-Grid Middleware Infrastructure

Generic Grid infrastructure for German
research communities
User
Application
Development
and
User Access
GAT API
GridSphere
Nutzer
Scheduling
Workflow Management
High-level
Grid
Services
Monitoring
Data management
Basic Grid
Services
Plug-In
UNICORE
LCG/gLite
Accounting
Billing
User/VO-Mngt
Globus 4.0.1
Security
Žabljak
25.2.2010
Resources
in D-Grid
Distributed
Data Archive
Data/
Software
Network
Infrastructur
Distributed
Compute
Resources
IT’10
Steps in using the Grid









Žabljak
25.2.2010
Get a Grid certificate
Join VO
Start using the Grid by creating simple
jobs
Consult with local and regional experts
(SEE-GRID community)
Exchange information with users sharing
your interests
Built upon available tools and services
Gridify your applications
Use available Grid resources
Consider providing your resources as a
grid site
SEEGRID-SCI JRA1
4
0
0
10
4
0
0
30
0
0
10
4
4
0
0
66
4
0
0
4
4
4
4
0
4
4
4
10
0
4
0
46
4
0
0
10
10
0
4
0
0
0
0
0
4
0
4
36
4
0
0
4
4
0
4
0
4
0
0
4
0
4
0
28
10
0
0
4
4
0
4
0
0
30
4
4
0
10
4
74
10
0
0
0
0
0
4
0
0
0
4
4
0
0
10
32
4
0
0
4
10
30
4
30
30
0
4
10
0
0
10
136
4
0
0
4
30
0
4
0
0
0
4
4
0
0
10
60
Total
0
30
30
4
0
0
30
0
0
0
0
0
30
30
0
154
Work
Binder
Event
Logger
ESIP
10
0
0
30
4
0
0
0
0
0
0
0
0
0
0
44
UPM
25.2.2010
4
10
4
4
4
0
10
0
0
0
0
4
0
4
4
48
SDSAS
Žabljak
CHERS
ELF
FPS
GreenView
Lizza-PAKP
MCSAES
MDSSP-WA
MSACM
MSERRHSA
NMMC3D
REFS
RESEWA
SDS
SRA
WRF-ARW
Total
DM-Web
Application
AWT
AS
RAS

P-GRADE
Portal

Capture commonalities across scientific fields in terms of application
requirements on Grid middleware
Define development areas for middleware plug-ins and application-level
services to cater to application demands and provide improvements to
current infrastructure services
Implement application-specific services and middleware extensions
MEWS

FM-J-API
IT’10
58
40
34
78
74
34
68
60
38
34
30
44
38
52
42
IT’10
Grid - Vehicle for Scientific
Collaboration



Researchers collaborate through grid
virtual organizations
Partnerships are built though sharing of
resources, data, and work
Grid certificates become researchers’
digital IDs




Žabljak
25.2.2010
EUGridPMA
SEE-GRID CA
MREN CA
TERENA Certificate Service (TCS)
provides eScience Personal Certificates accredited by the EUGridPMA