Transcript demo-dataturbine-eco-research-ebbe-strandell.ppt

Practical Uses of DataTurbine in
ECO-Research and Flood
Mitigation Initiatives
Ebbe Strandell
[email protected]
Project leader: Fang-Pang Lin
National Center for High-Performance Computing
Open Source DataTurbine
• Streaming Data Management System
– video, audio as well as numerical data.
• Bridge sensors users and storage pools in a
scalable and decentralized manner.
• Open source Java Development.
– Very active development team.
– Support for Matlab, C/C++ extensions.
• Supports secure data transport, data mirroring,
routing, shortcuts.
• Recently gained genuine interest from the
GLEON and CREON communities.
Source code, success stories, docs and more @ http://www.dataturbine.org
Source: Sameer Tilak, SDSC
Source: Creare Inc.
Kenting's Underwater
Observatory
• Only system of its kind in the world. Deployed in 2004.
• Currently features 4 underwater video cameras.
– Effective output: 320x240, 1-3 fps.
– Maximum output: 720x480px, 10 fps.
• Used by researchers in NMMBA (Kenting) for coral reef
studies and in Academia Sinica (Taipei) for fish behavioral
studies.
Kenting Architecture
Kenting
NCHC
Display
Room
Internet
(2 x ADSL 512kbps)
WLAN
Relay Server
Permanent
Data
Storage
DataTurbine
Analysis
Video Server
(On-shore)
Visualization
Video
Camera
Video
Camera
Seabird
Logger
RDV
Viewer
VLC
Web
Interfaces
TDW
Web-based: http://hddv.nchc.org.tw
Developed by Jazz Wang, NCHC
Real-time Data Viewer, NEES it
http://it.nees.org/software/rdv/
Live @ 4k TDW. NMNS, TaiChung.
Thanks to Lin Sun-In, Howard, James
(NCHC) and Raj Singh (SDSC) for excellent
help setting up this.
Live @ TDW in SDSC.
Rigged by: Sameer Tilak & Raj Singh.
Dinner Time in Kenting
Reported by Mr Bi, NMMBA.
DEMO
Flood Mitigation
• Every year 3-4 large typhoons hit Taiwan, sometimes
resulting in massive damage and loss of life.
• Taiwan's Water Resource Agency, WRA
– National entity that controls rivers, dams and other hydraulic
facilities.
– During typhoons the agency decides what resources to send
where in order to prevent damage.
• Flood mitigation project
– Use DataGrid to facilitate decision makings.
– DataTurbine allows us to make temporal and spatial comparisons
between data from previous typhoons.
Source: Taiwan’s Central Weather Bureau.
Source: http://www.fsl.noaa.gov/
Architecture
SensorNet DataGrid
New/future Extension
Data request
Data flow
Video
stream
Middleware
Video
stream
New Storage
Broadcasting
Video
stream
Client
New Data Service(s)
Archiving
Axis servers etc.
KING
storage
DataTurbine
Client
Client
Client
S
R
B
Archiving
Viewer
Viewer
KING
storage
New
storage
Event
DB
Web
Interface
RDV
Viewer
During “MITAG”
(Dec. 11-12 2007)
Thanks for listening!