Transcript RPC design - Mississippi State University

Cyberinfrastructure for
Rapid Prototyping Capability
Tomasz Haupt, Anand Kalyanasundaram, Igor Zhuk, Vamsi Goli
Mississippi State University
GeoResouces Institute
Rapid Prototyping Capabilities*
•
•
The overall goal of the NASA
Rapid Prototyping Capability is to
speed the evaluation of potential
uses of NASA research products
and technologies to improve future
operational systems by reducing
the time to access, configure, and
assess the effectiveness of NASA
products and technologies.
The infrastructure to support the
RPC is thus expected to provide
the capability to rapidly evaluate
innovative methods of linking
science observations.
Computational infrastructure + collaborative environment
*
Robert Moorhead (MSU/GRI) – principal investigator
RPC in an example of e-Science
•
•
•
•
Many, many more, in particular in biology & medicine
System-Level Science is the broad
understanding of how complex,
multiphenomena physical system
behave and how their constituent
components interact and interrelate.
System-level Science integrates
not only different disciplines but also,
typically, software systems, data,
computing resources, and people.
System-level science is usually
a team pursuit. Data comes from
different sources, different groups
develop component models, team
members provide specialized
expertise, and the often substantial
computing and data resources
required for success are themselves
diverse and distributed.
Grid Computing
Virtual Organizations
Ian Foster
ANL and University of Chicago
“father of Grid Computing”
New Web Revolution
Grid
Computing
e-Science
e-Science
2.0
The Web
0.5
The Web
1.0
The Web
2.0
Server hopping
Document exchange
Dynamic Content, Publishing
E-Commerce E-banking,…
Database
Access,
Search
Community Content, Collaboration
Social Networking, Rich Interfaces
SOA
Digital
Enterprise
Architecture of participation
Collective intelligence
User-created content
Convergent, emergent
Unplanned innovation
Freeform simplicity
Cloud
Computing,
Enterprise
AJAX,
2.0
mashups
RPC Experiments
(Two ways of describing them)
Prototyping
The delivery mechanisms for
the evaluation of the use
of the NASA-provided resources
Experiment
Description
Experimental
Procedure
Description
of Results
Rapid
The capability to integrate tools and data
to perform such evaluations
Data Access
Data providers (DAAC, NOAA, etc)
Derived data product (model outputs)
Simulated data
Data Storage
Data (Geo)processing
Re-sampling, re-projecting,
time series, maps & features, etc.
input deck generation
…
Analysis Procedure
Computational
Models
Conclusions from
Evaluation
Data Publishing
(Recommendation for ISS)
Data Analysis
Semantic
metadata
Processing
Abstraction
Model Data
Abstraction
Model Run
Abstraction
Interactive Web Site
Tools for Data Processing
Private Space for Collaboration
Performance Metrics Workbench
TDS-based Data Explorer
Provenance
DEMONSTRATION
What’s under the hood?
REST
AJAX
Apache/Tomcat server (J2EE)
Web access
GridSphere portlet container
Content aggregation
THREDDS
Wiki
GUI
(Unidata)
(MediaWiki)
(JSP)
Portlets
Service Bus (ServiceMix)
Local Storage
Globus
SOA
HEG ART
TSPT
HPC2 clusters
HPC2 Storage
gridFTP GRAM
Grid Computing
Current Work
Support for NASA LIS RPC experiment
Standalone TDS
clients
Web Browser
REST/AJAX
Service Bus
Create
input
deck
LIS
LIS
input deck
generator
postprocessor
Request
execution
Initialized by user
Job
Submission
Service
Create
execution
environment
Stage
files in
Job
Monitoring
Service
Listen
to job
status
changes
File
Transfer
Service
Postprocess
outputs
TDS
Service
Create
metadata
and
provenance
Orchestrated services: workflow
* Valentine Anantharaj (MSU/GRI) - PI
Post
results
on TDS
Support for LIS experiments
Set LIS parameters
Create LIS input deck
Run LIS
Monitor the status
The post-processed file is automatically transferred to the TREDDS server
This concludes my presentation on
Cyberinfrastructure for
of the Rapid Prototyping Capability System
Tomasz Haupt
[email protected]

Cooperative Computing Group
Center for Advanced Vehicular Systems • Mississippi State University
Interactive Web Site
for describing RPC experiments
Private space for discussions
TDS-based data repository
(data explorer)
Tools for data processing
(currently HEG)
Performance Metrics Workbench
(currently multispectral viewer)
Provenance
Electronic Journals