Portlets and Portals for Grid Computing Johnson Space Center Houston February 19 2004 Geoffrey Fox Community Grids Lab Indiana University OGCE Consortium.

Download Report

Transcript Portlets and Portals for Grid Computing Johnson Space Center Houston February 19 2004 Geoffrey Fox Community Grids Lab Indiana University OGCE Consortium.

Portlets and Portals for Grid
Computing
Johnson Space Center
Houston
February 19 2004
Geoffrey Fox
Community Grids Lab
Indiana University
OGCE
Consortium
NSF NMI Project for Making Portal
Components Robust
• University of Chicago
– Gregor von Laszewski
• Indiana University
– Marlon Pierce, Dennis Gannon, Geoffrey Fox, and Beth
Plale
• University of Michigan
– Charles Severance, Joseph Hardin
• NCSA/UIUC
– Jay Alameda, Joe Futrelle
• Texas Advanced Computing Center
– Mary Thomas
OGCE
Consortium
What Is a Computing Portal?
• Browser based user interface for accessing grid and
other services
–
–
–
–
–
–
“Live” dynamic pages for accessing grid services
Use(d) Java/Perl/Python COGs
Manage credentials, launch jobs, manage files, etc.
Hide Grid complexities
Can run from anywhere
Unlike user desktop clients, connections go through portal server,
so could overcome firewall/NAT issues
• Combine “Science Grid” with traditional web
capabilities
– Get web pages for news feeds
– Post and share documents
– And other more traditional web page features
• Customizable interfaces.
OGCE
Consortium
Clients
Portlet Class:
WebForm
Aggregation and Rendering
Clients (Pure HTML, Java Applet ..)
Portal Architecture
Portlet Class:
IFramePortlet
Portlet Class:
JspPortlet
Portlet Class:
VelocityPortlet
Jetspeed
Internal
Services
Portal
Portlets
(Jetspeed)
Gateway
(IU)
Remote
or Proxy
Portlets
Web/Grid
service
Computing
Web/Grid
service
Data Stores
Web/Grid
service
Instruments
GridPort
etc.
(Java)
COG Kit
Local
Portlets
Libraries
Hierarchical
arrangement
Services
Resources
The Grid Portal
• Provides Portlets for
– Management of user proxy
certificates
– Remote file Management via
Grid FTP
– News/Message systems
• for collaborations
–
–
–
–
Grid Event/Logging service
Access to OGSA services
Access to directory services
Specialized Application Factory
access
• Distributed applications
• Workflow
– Access to Metadata Index tools
• User searchable index
– Collaboration
OGCE
Consortium
Portlet Component and Container
Technologies
• Jakarta Jetspeed
– Open source Java portlet project
– Jetspeed is both a framework and reference
implementation
– Defines portlets, portal service APIs (login,
authorization, customization, etc.)
• CHEF from University of Michigan
– Uses Jetspeed as a framework
• Reimplements many of the core classes
– Basis for UM CourseTools
– NEESGrid portal
– CMCS Portal
OGCE
Consortium
User Portlets
Portal Capabilities
Description
Grid Proxy Certificate Manager
Get MyProxy certs after logging in.
Schedule
Interactive individual and group calendars
Discussion
Persistent topic-based discussion for groups
Chat
Live chat services and interfaces
Document managers
WEBDav documentsfor group file sharing
MDS/LDAP Browsers
Basic Globus MDS browsing and navigating
GridContext Portlets
Access context services for managing metadata
GRAM Job Submission
Run simple executables on remote hosts
GridFTP
Upload, download, crossload remote files.
GPIR Portlets
View, interact with HPC status, job, etc
information.
Anabas
Access to Anabas shared display applets
Audio/Video Conferencing
Access Grid and GlobalMMCS (unicast)
Newsgroups and citation portlets
Post topics to newsgroup, manage group
references and citations with access controls
Example Capability: Portals for Users
User “Beth”
• The MyProxy Manager
– The user contacts the portal
server and asks it to do “grid”
things on behalf of the user.
– To make this possible the
server needs a “Proxy
Certificate”
• The user has previously stored
a proxy cert in a secure
MyProxy Server stored with a
temporary password.
• User give the portal server the
password and the portal server
contacts the proxy server and
loads the proxy.
• The portal server will hold the
proxy for the user for a “short
amount of time” in the user’s
session state.
1. Load my
Proxy
Certificate!
Portal Server
2. Give me
Beth’s proxy
certificate
MyProxy
Portlet
COG
I am
Beth’s
Proxy
3.
MyProxy
Server
OGCE
Consortium
Example Capability: File Management
• Grid FTP portlet– Allow User
to manage remote file spaces
– Uses stored proxy for
authentication
– Upload and download files
– Third party file transfer
User “Beth”
Portal Server
• Request that GridFTP server A send a
file to GridFTP server B
• Does not involve traffic through portal
GridFTP
server
Server A
GridFTP
portlet
Java
COG
GridFTP
Server B
OGCE
Consortium
OGCE
Consortium
Grid Portal Information Repository
(GPIR 1.1)
OGCE
Consortium
Access Grid and Related Portlets
QuakeSim Portal Shots
iSERVO Example: Finley
• Finley is a finite element code being developed by
the QUAKES group at the University of
Queensland.
• Compatible with GeoFEST-style geometry models
and mesh generation tools.
– So we can reuse the services we wrapped for GeoFEST.
• The Finley application itself is a separate service
and also has a separate (simple) visualization
service.
Setting Up Finley Simulation of
Northridge
Selected Fault
Components
Select Fault from
USC database
Run Finley, Retrieve Generate Movie
Example Applications: Earthquake
Fault Simulation
New Starts: TeraGrid Portal
• Access to TeraGrid Services
– Version 0: Collecting Initial
Services
• Public Information about
Resources
• Private Information for the
developers.
– Version 1: A User centered
portal (Q2 2004)
• Hotpage/Gridport style access to
user accounts, credentials, job
submission & management.
– Version 2: Portals for Science
Collaborations (Q3 2004)
• Shared spaces, whiteboards, AG
access, group authorization,
shared application services
OGCE
Consortium
LEAD Portal
OGCE
Consortium
Additional Information
• OGCE Web site: www.ogce.org
– Download the portal
– Join news lists, get announcements
• OGCE Demo Portal: www.collabogce.org
– See our demo Thursday night
• Contact us
– [email protected]
OGCE
Consortium