A Services Oriented Architecture for Water Resources Data David R. Maidment and Timothy L.
Download ReportTranscript A Services Oriented Architecture for Water Resources Data David R. Maidment and Timothy L.
A Services Oriented Architecture for Water Resources Data
David R. Maidment and Timothy L. Whiteaker Center for Research in Water Resources University of Texas at Austin
Collaborators
• San Diego Supercomputer Center – Ilya Zaslavsky , David Valentine, Tom Whitenack • Utah State University – David Tarboton , Jeff Horsburgh, Kim Schreuders • Drexel University – Michael Piasecki , Bora Beran, Yoori Choi • University of South Carolina – Jon Goodall
A Services Oriented Architecture for Water Resources Data
• WATERS Network Information System • Observations data model • Data Services
A Services Oriented Architecture for Water Resources Data
•
WATERS Network Information System
• Hydrologic Information Server • Data Services
Waters Network Testbed Sites
Waters Observation Networks
• 16 observation networks (some testbeds have more than one network) • Provides data from 1246 sites • Of these, are operated by WATERS 167 sites investigators
Florida – Santa Fe Watershed
Nitrate Nitrogen (mg/L) Millpond Spring PI: Wendy Graham, ….; DM: Kathleen McKee, Mark Newman
North Carolina – Albemarle Pamlico Sound Salinity Mod Mon and Ferry Mon networks PI: Hans Paerl; DM: Rodney Guajardo
Chesapeake Information Management System (Johns Hopkins, Drexel, Penn State Universities) http://www.hydroseek.org
PI: Michael Piasecki, Bill Ball, Kevin Dressler, Chris Duffy, Pat Reed; DM: Bora Beran, Yoori Choi
Baltimore — Gwynns Falls Watershed 15-min Precipitation at Carroll Park PI: Claire Welty, …..; DM: Mike McGuire
Susquehanna – Upper Juniata Basin Net Radiation (W/m 2 ) Oct 05 May 06 PI: Chris Duffy, Pat Reed; DM: Bora Beran, Yoori Choi
Iowa – Clear Creek Watershed
Uses streaming data loader Precipitation PI: Craig Just, Marian Muste, Anton Kruger; DM: Marian Muste, Dong Su Kim, Nick Arnold
Minnesota – Minnehaha Creek
Nitrate Nitrogen (mg/L) PI: Miki Hondzo, Bill Arnold, …. DM: Jim Kang, Sung-Chul Kim
Montana – Crown of the Continent Snow Depth (m) Sperry glacier on ice weather station 4 0 2007: July August PI: Johnnie Moore, … DM: Toby Meirbachtol, Aaron Deskins
Utah – Little Bear River and Mud Lake Turbidity David Stevens, Jeff Horsburgh, David Tarboton, Nancy Mesner, Kim Schreuders
Sierra Nevada – San Joaquin River Transect of measurements across the river PI: Roger Bales, Tom Harmon DM: Xiande Meng
Corpus Christi Bay - Hypoxia
DO (mg/L) PI: Barbara Minsker, Paul Montagna, Jim Bonner, Ben Hodges; DM: Kevin Nelson
A Services Oriented Architecture for Water Resources Data
• • WATERS Network Information System
Observations data model
• Data Services
Hydrologic Information Server
DASH – data access system for hydrology WaterOneFlow services
GetSites GetSiteInfo GetVariables GetVariableInfo
GetValues
ArcGIS Server Geospatial Data Observations Data Microsoft SQLServer Relational Database
Hydrologic Information Server Deployment National Hydrologic Information Server San Diego Supercomputer Center metadata for national datasets: NWIS, Storet, Snotel WATERS testbed server
Point Observations Information Model http://www.cuahsi.org/his/webservices.html
Utah State Univ
Data Source
GetSites
Little Bear River
Network
GetSiteInfo
Little Bear River at Mendon Rd
Sites
GetVariables
Dissolved Oxygen
Variables
GetVariableInfo
GetValues
9.78 mg/L, 1 October 2007, 6PM
Values
{Value, Time, Qualifier, Offset} • A data source operates an observation network • A network • A site is a set of observation sites is a point location where one or more variables are measured • A variable • A value is a property describing the flow or quality of water is an observation of a variable at a particular time • A qualifier is a symbol that provides additional information about the value • An offset allows specification of measurements at various depths in water
CUAHSI Observations Data Model http://www.cuahsi.org/his/odm.html
Loading Data into ODM
MyDB ODDataLoader Database
New Methods for Data Loading
SQL/Server Integration Services Streaming Data Loader DataTurbine
A Services Oriented Architecture for Water Resources Data
• • Waters Network Information System • Observations Data Model
Data Services
Definition
The CUAHSI Hydrologic Information System (HIS) is a
geographically distributed network
of
data sources and functions
that are integrated using a
web services architecture
so that they operate as a connected whole.
Services Oriented Architecture
(from Wikipedia) • Service-oriented Architecture (SOA) between producers and consumers.
• A major focus of Web services (WSDL, pronounced 'wiz is an architectural design pattern that concerns itself with defining loosely-coupled relationships is to make functional building blocks accessible over standard Internet protocols that are independent from platforms and programming languages. • The Web Services Description Language dəl' or spelled out, 'W S-D-L') is an XML -based language that provides a model for describing Web services . Defined by the World Wide Web Consortium (W3C)
Web Pages and Web Services
http://his.safl.umn.edu/SAFLMC/cuahsi_1_0.asmx?
http://www.safl.umn.edu/ Uses Hypertext Markup Language ( HTML ) Uses WaterML (an eXtended Markup Language for water data)
WaterML and WaterOneFlow
Locations Variable Codes Date Ranges
Client LOAD
GetSiteInfo GetVariableInfo GetValues WaterML
WaterOneFlow Web Service TRANSFORM
Data NAM
Data Repositories EXTRACT
WaterML is an XML language for communicating water data WaterOneFlow is a set of web services based on WaterML
WaterOneFlow
• Set of query functions • Returns data in WaterML Ilya Zaslavsky and David Valentine, SDSC
Data Heterogeneity
• Syntactic mediation – Heterogeneity of format – Use WaterML to get data into the same format • Semantic mediation – Heterogeneity of meaning – Each water data source uses its own vocabulary – Match these up with a common controlled vocabulary – Make standard scientific data queries and have these automatically translated into specific queries on each data source
Objective • Search multiple heterogeneous data sources simultaneously regardless of semantic or structural differences between them What we are doing now …..
NWIS NAWQA NAM-12 NARR
Michael Piasecki Drexel University
Semantic Mediator
GetValues generic request
Michael Piasecki Drexel University
GetValues
GetValues
GetValues GetValues GetValues GetValues GetValues NARR
What we would like to do …..
NWIS NAWQA HODM
Bora Beran, Drexel Hydroseek http://www.hydroseek.org
Supports search by location and type of data across multiple observation networks including NWIS and Storet
HydroTagger
Ontology: A hierarchy of concepts Each Variable in your data is connected to a corresponding Concept
HIS to Google Earth
developed by Peter Fitch, CSIRO, Australia http://www.watersnet.org/wtbs/ODMKMLGatway.html
A web application housed in Canberra, Australia, that operates over the WATERS Network data services
Conclusion: Web services work!
The CUAHSI Hydrologic Information System (HIS) is a
geographically distributed network
sources and functions
of
hydrologic data
that are integrated using a
web services architecture
so that they function as a connected whole.
For more information: http://www.cuahsi.org/his.html
Conclusions
• Hydrologic Information Server is functioning at all testbed sites • Data are published in a consistent format (WaterML) and are thematically synthesized in Hydroseek with water agency data • Applications and analyses can operate seamlessly over the Waters Network data services • A lot more to be done – GIS, weather and climate, remote sensing, simulation modeling, interpretive analysis, ….. Digital Watershed development!