Transcript CUAHSI OnLine: Bringing Data and Modeling Services to the

The HydroServer Platform
for Sharing Hydrologic
Data
David G Tarboton, Jeffery S Horsburgh, Kimberly A. T.
Schreuders, David R. Maidment, Ilya Zaslavsky, David
Valentine
CUAHSI
HIS
http://his.cuahsi.org/
Sharing hydrologic data
Support
EAR 0622374
CUAHSI Hydrologic Information System
Services-Oriented Architecture
HydroCatalog
Data Discovery and
Integration
WaterML,
Other OGC
Standards
HydroServer
Data Publication
ODM
Data
Services
HydroDesktop
Data Analysis and
Synthesis
Geo Data
Information Model and Community Support Infrastructure
HydroServer – Data Publication
Point Observations Data
Internet Applications
Ongoing Data Collection
Historical Data Files
ODM
Database
GIS Data
GetSites
GetSiteInfo
GetVariableInfo
GetValues
WaterML
WaterOneFlow
Web Service
OGC Spatial
Data Service
from ArcGIS
Server
Data presentation, visualization,
and analysis through Internet
enabled applications
HydroServer Architecture
Publish point data
Publish metadata
Publish spatial data
Manager
Interface
HydroServer
WaterOneFlow
WaterOneFl
ow
Web
Service
WaterOneFl
ow
Web
Service
Web Service
Load
and Edit
data
Service Interface
ODM Tools
and Data
Loaders
Capabilities
Web Service
Spatial Data
Services
Geo
Spatial
Database
Observation
Observation
Data
Model
Observation
Data
Model
Data Model
Browser
Interface
HydroServer
Website
View
server
portal
Map
Website
View
spatial
data
Spatial
Data File
Configure
server
Capabilities
Configuration
Tool
HydroServer
Capabilities
Database
Time Series
Analyst
Website
View
point
data
Observation Data Model for hydrologic and
environmental measurements
The way that data is organized can enhance or
inhibit the analysis that can be done
Streamflow
Precipitation
& Climate
Water Quality
Groundwater
levels
Soil
moisture
data
Flux tower
data
• A relational database at the single observation level
• Metadata for unambiguous interpretation
• Traceable heritage from raw measurements to usable
information
• Promote syntactic and semantic consistency
Horsburgh et al., 2008,
• Cross dimension retrieval and analysis
WRR 44: W05406
Stage and Streamflow Data in ODM
Loading data into ODM
OD Data Loader
• Interactive OD Data Loader (OD
Loader)
– Loads data from spreadsheets and
comma separated tables in simple
format
SDL
• Scheduled Data Loader (SDL)
– Loads data from datalogger files on
a prescribed schedule.
– Interactive configuration
• SQL Server Integration Services
(SSIS)
– Microsoft application accompanying
SQL Server useful for programming
complex loading or data
management functions
SSIS
Managing Data Within ODM
ODM Tools
• Query and export
– export data series
and metadata
• Visualize – plot and
summarize data
series
• Edit – delete,
modify, adjust,
interpolate,
average, etc.
WaterML and WaterOneFlow
WaterML is an XML language for communicating water data
WaterOneFlow is a set of web services based on WaterML
• Set of query functions
• Returns data in WaterML
Publication of Spatial
(GIS) Datasets
• Publishing spatial
datasets using ArcGIS
Server
– Using OGC standards that
can be consumed by a
number of GIS clients
– WMS, WFS, WCS
Data Presentation Via a Map Interface
• Internet Map Server
built using ArcGIS
• Web browser client
• Combine spatial data
and observational
data
• Launch data
visualization tools
• Based on a “Region”
http://maps.usu.edu/map/
Data Preview, Visualization, and Analysis
Time Series Analyst
• Web Browser Client
• Multiple ODM Database
Support
• Variety of plot types
• Descriptive statistics
• Linked to the map
application
• Data preview and
download
http://icewater.usu.edu/tsa/
HydroServer
Website
• HydroServer home
page
• Observational data
services
• GIS data services
• Online map
• Time Series Analyst
• Data Query and
Download
http://icewater.usu.edu
HydroServer Capabilities Web Service
• Publish capabilities of each
HydroServer
– Listing of published
observational data services
– Listing of published spatial
data services
• Supports automatic cataloging
of available services at HIS
Central
• Makes HydroServers self
describing
Catalog
Server
Data
Services
Desktop
Overcoming Semantic Heterogeneity
• ODM Controlled
Vocabulary System
– ODM CV central database
– Online submission and editing
of CV terms
– Web services for broadcasting
CVs
Variable Name
Investigator 1:
Investigator 2:
Investigator 3:
Investigator 4:
“Temperature, water”
“Water Temperature”
“Temperature”
“Temp.”
ODM VariableNameCV
Term
…
Sunshine duration
Temperature
Turbidity
…
From Jeff Horsburgh
Dynamic controlled vocabulary moderation system
ODM Data
Manager
ODM
Website
ODM
Tools
XML
Local ODM
Database
Local
Server
ODM Controlled
Vocabulary Moderator
ODM
Controlled
Vocabulary
Web Services
http://his.cuahsi.org/mastercvreg.html
Master ODM
Controlled
Vocabulary
From Jeff Horsburgh
A growing collection of HydroServers and
community of users
• University of Maryland,
Baltimore County
• Montana State University
• University of Texas at
Austin
• University of Iowa
• Utah State University
• University of Florida
• University of New Mexico
• University of Idaho
• Boise State University
• University of Texas at
Arlington
• University of California,
San Diego
• Idaho State University
Dry Creek Experimental Watershed (DCEW)
(28 km2 semi-arid steep topography, Boise Front)
68 Sites
24 Variables
4,700,000+ values
Published by Jim
McNamara, Boise
State University
Open Development Model
http://hydroserver.codeplex.com
•
•
•
•
•
•
user engagement
transparency
collaboration
agility
sustainability
tools
Conclusions
• HydroServer provides a self contained data
publication system
– Self describing (Complete description of data and
metadata)
• Local control of, and responsibility for data
Server
• Downloadable user (data publisher)
configurable software stack
– ODM and tools, Web service software, Time Series
Analyst, ArcGIS server based web map application
and map services, HydroServer Capabilities metadata
web services
• Sharing data in common format can
stimulate interdisciplinary collaboration
• Growing network of HydroServers will
facilitate cross site network scale syntheses
Catalog
Data
Services
Desktop
Thanks! HIS Project Team
and Sponsors
• University of Texas at Austin – David Maidment, Tim Whiteaker,
James Seppi, Fernando Salas, Jingqi Dong, Harish Sangireddy
• San Diego Supercomputer Center – Ilya Zaslavsky, David Valentine,
Tom Whitenack, Matt Rodriguez
• Utah State University – Jeff Horsburgh, Kim Schreuders, Stephanie
Reeder, Edward Wai Tsui, Ravichand Vegiraju, Ketan Patil
• University of South Carolina – Jon Goodall, Anthony Castronova
• Idaho State University – Dan Ames, Ted Dunsford, Jiří Kadlec, Yang
Cao, Dinesh Grover
• Drexel University/CUNY – Michael Piasecki
• WATERS Network – Testbed Data Managers
• CUAHSI Program Office – Rick Hooper, Yoori Choi, Conrad Matiuk
• ESRI – Dean Djokic, Zichuan Ye
CUAHSI
HIS
http://his.cuahsi.org/
Sharing hydrologic data
Support
EAR 0622374