Transcript Developing a CUAHSI HIS Data Node, as part of

Developing a CUAHSI HIS Data Node,
as part of Cyberinfrastructure for the
Hydrologic Sciences
David Valentine
Ilya Zaslavsky
David R. Maidment
SAN DIEGO SUPERCOMPUTER CENTER
Overview
•
•
•
•
•
•
Introduction
Technology
Present
Screenshots
Near Term
Future
SAN DIEGO SUPERCOMPUTER CENTER
Hydrologic Science
It is as important to represent hydrologic environments precisely with
data as it is to represent hydrologic processes with equations
Physical laws and principles
(Mass, momentum, energy, chemistry)
Hydrologic Process Science
(Equations, simulation models, prediction)
Hydrologic conditions
(Fluxes, flows, concentrations)
Hydrologic Information Science
(Observations, data models, visualization
Hydrologic environment
(Dynamic earth)
SAN DIEGO SUPERCOMPUTER CENTER
Consortium of Universities for the
Advancement of Hydrologic Science, Inc
(CUAHSI)
CUAHSI HydroView Components
• Supported by the National
Science Foundation
• Develops
cyberinfrastructure and
services for hydrologic
science in US universities
• Legally independent
organization based in
Washington DC
• SDSC is the
cyberinfrastructure partner
Hydrologic
Synthesis
Hydrologic
Observatories
Measurement
Technology
SAN DIEGO SUPERCOMPUTER CENTER
Hydrologic
Information
Systems
Operating Systems and Software Use
SAN DIEGO SUPERCOMPUTER CENTER
Water OneFlow Web Services
• Like Geospatial OneStop,
we need a “Water
OneStop” – a common
window for water data
and models
• Advancement of water
science is critically
dependent on integration
of water information
SAN DIEGO SUPERCOMPUTER CENTER
Technology
• Commercial of the shelf (COTS) software
• Leverage ongoing cyberinfrastructure projects
• Geosciences Network (GEON)
• Share data between Earth Science disciplines
• Grid computing capabilities
• Web Services
SAN DIEGO SUPERCOMPUTER CENTER
Operating Systems
• ESRI ArcGIS
• Microsoft SQL Server
• Custom Models
• ArcHydro
• Hydrologic Observations
Database
• ASP.NET
• Web services
• Web interfaces
• Provides
• a platform that scientists are
familiar with, and have
developed, and a presently using
to develop, software.
SAN DIEGO SUPERCOMPUTER CENTER
• GEON Stack
•
•
•
•
•
Java Portlets (Gridsphere)
Grid Authentication (GAMA)
Distributed Storage (SRB)
Grid Processing Capabilities
Workflow Capabilities
• Provides
•
•
•
•
data registration
searching
an archive
Shared architecture for
Geosciences
Multi-platform Design
GEON Data Node (Linux)
Central CUAHSI HIS Node (Windows)
HODM
Web
HDAS
Services
Web
Geon Software Stack
Service
Proxy
IIS Web Server
ASP . Net
ArcGIS
Technologies SQL Server
Apache Tomcat
Web
Service
proxies
Data
Data
Remote CUAHSI HIS Node (Windows)
Remote
CUAHSI
HIS Nodes
(Windows)
HDAS
Remote CUAHSI HIS Node (Windows)
HODM
Web
Web
Services
Service
HDAS
IIS Web Server
ASP
ArcGIS
Technologies
Data
.
SQL Server
Remote CUAHSI HIS Node (Windows)
HODM
Web
Web
Services
Service
HDAS
IIS Web Server
Net
ASP
Web
Service
proxies
ArcGIS
Technologies
Data
.
SQL Server
HODM
Web
Web
Services
Remote CUAHSI HIS Node (Windows)
HDAS
Service
ASP
Web
Service
proxies
ArcGIS
Technologies
Data
.
SQL Server
Web
Service
IIS Web Server
IIS Web Server
Net
HODM
Web
Services
ASP
.
Net
Net
Web
Service
proxies
ArcGIS
Technologies
Data
SQL Server
Web
Service
proxies
Present (1/2)
• Water OneFlow Web Services
• NWIS, AmeriFlux, DAYMET, MODIS
• Databases
• Hydrologic Observations Data Model
• HDAS - Hydrologic Data Access System
• A map-based access system to hydrologic data
• We provide production access to data sources
via webservices, and access via a map-based
interface
SAN DIEGO SUPERCOMPUTER CENTER
Present (2/2)
• Problems
• Occasionally, Geon Services do not work in proxy
• CUAHSI ArcGIS server interfaces (eg HDAS) have
problems being wrapped in a portlet, and were not
designed to be wrapped.
• Producing a node distribution with COTS
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
Demo-Data Registration
SAN DIEGO SUPERCOMPUTER CENTER
Near Future
• Water OneFlow web services
•
•
•
•
Standardize methods
Refactor present services
Provide codebase for community development
Dataset specific methods
• ESRI ArcHydro server extension
• Point of presence distribution
• Documentation
SAN DIEGO SUPERCOMPUTER CENTER
Future
• Make it easier
• URL-Based access methods
• Data
http://ws.cuahsi.org/station/ameriflux/stationID/Variable/xml
http://ws.cuahsi.org/station/ameriflux/stationID/Variable/excel
• Non-Map access methods
•
•
•
•
Ontology search
Site browse
Attribute browse (by HUC, State, County)
Others (tell us)
• Tools
• Documentation
SAN DIEGO SUPERCOMPUTER CENTER
Summary
• CUAHSI HIS is a community driven effort.
• COTS or open source best tool for the job.
• CUAHSI cyberinfrastructure will be a multiplatform infrastructure that leverages the GEON
Infrastructure, and commercial software.
• Web services will allow for flexible development
• Community-developed implementations can replace
commercial implementations.
• MapWindows group is developing an OpenHydro data model to
provide an open source implementation of the ArcHydro
datamodel.
SAN DIEGO SUPERCOMPUTER CENTER
Questions
• Sites
• http://www.cuahsi.org/his/
• Listing of web services
• http://river.sdsc.edu/HDAS/
• Map interface to National Water Information System
• HIS Contacts
• [email protected]
• [email protected]
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
SAN DIEGO SUPERCOMPUTER CENTER
Hydrologic Information System Service Oriented Architecture
Web portal Interface (HDAS)
Information input, display, query and output services
Web services
interface
HTML -XML
WaterOneFlow
Web Services
e.g. USGS,
NCDC
WSDL - SOAP
3rd party
servers
Uploads
Downloads
Preliminary data exploration and discovery. See
what is available and perform exploratory analyses
Data access
through web
services
Data storage
through web
services
GIS
Matlab
IDL
Observatory
servers
SDSC HIS
servers
SAN DIEGO SUPERCOMPUTER CENTER
Splus, R
D2K, I2K
Programming
(Fortran, C, VB)
Hydrologic Information System Service Oriented Architecture
Web portal Interface (HDAS)
Information input, display, query and output services
Web services
interface
HTML -XML
WaterOneFlow
Web Services
e.g. USGS,
NCDC
WSDL - SOAP
3rd party
servers
Uploads
Downloads
Preliminary data exploration and discovery. See
what is available and perform exploratory analyses
Data access
through web
services
Data storage
through web
services
GIS
Matlab
IDL
Observatory
servers
SDSC HIS
servers
SAN DIEGO SUPERCOMPUTER CENTER
Splus, R
D2K, I2K
Programming
(Fortran, C, VB)