Transcript MEDTERRANEAN AND BLACK SEA DATA MANAGEMENT

Recent experiences and future plans in
oceanographic data management
of the Mediterranean and Black Sea
MAMA Workshop
on Marine Data & Information Management
Malta, 28th January 2004
Several data management actions
have been made in a global
international context
1996-1999 MTPII-MATER
www.ifremer.fr/sismer/program/mater/
WOCE/JGOFS,
OMEX,
CANIGO
www.ifremer.fr/sismer/program/mater/
GODAR
1998-2001
MEDAR/MEDATLAS II
MFSPP-MFSTEP
1998-2001
2003-2006
ARGO
www.bo.ingv.it/mfstep/
+ meta-data: Sea-search, EDIOS
They have been made possible by the
development of common standards
and infrastructures
MTPII-MATER 1996-1999
MAss Transfer and Ecosystem Response
A reference good quality multidisciplinary database
> 200 parameters collected by:
58 research groups
from 10 EU Member States and
3 non-EU States
108 cruises (more than
1000 days of ship time)
130 long time series from
fixed mooring and
lagrangian drifters
254 main scientific
equipments
MATER Database
Data Management Structure
Three regional Data Centres
Western
Central
Eastern
Publication of the Database on CDRom
MEDAR/MEDATLAS II
EC-MAST Concerted Action
(MAS3-CT98-0174/ERBIC20-CT98-0103)
DATA BASE CONTENT
(PARAMETERS)
Parameter
Nb of Profiles
Parameter
Nb of Profiles
Temperature
284 371
Nitrite
10 508
Salinity
118 009
Ammonium
5 239
Oxygen
44 928
Chlorophyll
4 672
Phosphate
20 761
Alkalinity
2 548
Silicate
15 920
Total Phosphorus
2 381
PH
14 512
H2S
1 843
Nitrate
10 572
Total Nitrogen
153
SALINITY
CHLOROPHYLL
CLIMATOLOGY
Methodology
 Computation of Climatological Analysis by Variational
Inverse Model (VIM) algorithms
 Computation made on finite elements and then reinterpolated on a regular grid (0.2 degrees in Latitude
and Longitude), with smaller scales for local
computations
 T, S and bio-chemical climatology reviewed by regional
experts and modellers
http://modb.oce.ulg.ac.be/Medar
CLIMATOLOGY - Results
Selected numerical fields depending on data availability:
Annual , seasonal and monthly climatology
Temperature, Salinity
Annual and seasonal
Oxygen, Silicate, Phosphate
Hydrogen sulphide (H2S) in the Black Sea
Annual only
Nitrate, Nitrite, pH, Ammonium, Alkalinity, Chlorophyll
No climatology
Total Phosphorus, Total Nitrogen
+ 2500 horizontal maps, vertical sections and data location
SALINITY at 10m
Depth
DATA PRODUCT
(A set of 4 CD-ROMs)
CD-ROM 1: Documentation
on the project and its results
Cruise inventory
Software
QCmedar
ODV
CD-ROM 2: Database
Observed data
+ SELMED interface
for extraction (according to various criteria), interpolation and visualization - export
formats: MEDATLAS, CSV or ODV.
CD-ROM 3: Climatology
Global + W-Mediterranean
CD-ROM 4: climatology
Black Sea + E-Mediterranean
MFSPP Real time data management
VOS Voluntary Observing Ship
M3A Multisensor Moored Array
MEDARGO Subsurface Profiling System
GLIDERS Basin Wide Monitoring
Technology
Atmospheric forcing data
Satellite Data
MFSTEP RT Data Access XBt
MFSTEP RT Data Access – MEDARGO
Floats
Standardization
mandatory meta-data
ISO 19115
common exchange format(s) :
ASCII : MEDATLAS
NetCdf : ARGO/MFSTEP
quality controls
On data
On products
Requested for interoperability :Communication protocol
Marine XML
QUALITY CHECKS
QCO : Automatic check of the format
QC1 : Automatic and visual check of the
headers
QC2 : Automatic and visual check
of the data points
a quality flag to each numerical value
(GTSPP flag scale)
QC1: Location, date, duplicates
QC-2 : check of the data points
Automatic Checks Result
Pressure + one more observation (E)
Out of the regional scale
(min & max values)
Increasing pressure
Data below the bottom depth
Coherence with pre-existing
statistics
(LEVITUS, MODB, MEDATLAS)
No constant profiles
Spikes
Vertical stability
E= Elimination
Conclusion 1: Present available data
infrastructure and services for the
Mediterranean and Black Sea
The data management network of NODC/DNA
disseminate data from national and international
programs provides basic data services:
Implementation of internationally agreed protocols
(when available) and practices for data formatting
and checking,
Continuous compilation of national data, quality
checking with feedback to source scientists,
perennial archiving,
Data dissemination : routine regional or thematic
subsets, and answers to specific requests,
State of the art watch to develop standards and
make use of the communication technology.
Conclusion 2: What remain to be done
Direct internet access to the most complete and
integrated data sets : historical data + data released in
recent projects +real time data
more quality data and products such as estimates of the
mean, decadal, seasonal, monthly statistics at basin,
regional and shelf scales
Insure continuity and integration with other Pan-European
and international programs:
Avoid to stop the dynamics
Compatibility with other networks
Develop the standardization with ISO 19115 and Marine
XML, especially for meta-data and communication
Develop marketing to and feedback from the users
Avoid to create new non compatible systems
SEA-DATANET : New concerted
actions in preparation
to develop :
An internet integrated portal
A communication protocol (ISO19115, Marine XML)
between local systems
Quality Control procedures to be applied on data
and products according to the existing international
standards or standards developed in the project,
especially for non-physical data
Marketing of the user community, to get more
data and provide better services
Enhanced international cooperation & capacity
building activities
Sea Data network
a semi-distributed model that
incorporates, but enhances, the existing
infrastructures
professional archiving centres
scientific centres
SMEs
Elements of the Oceanographic Data
System
Data
Centres
Data &
Meta Data
Science
Centres
Standard
Products
User
Scientific
Products
Phases of Sea-Datanet
1. Design study : protoype of the system
 On line networking of a limited number of
centre to provide data
 Access to all via internet
 Test of feasibility and cost estimation for
any current parameter
2. Development of the system
 On extended network of data sources
 On a limited number of parameters
3. Implementation and evolution
Expected long term results of Sea
DataNet
Standardize, secure and disseminate the data
holding of the Pan-European community
Decrease or optimisation of the overall costs of the
data management of the projects
Training on standards and methodologies developed
in the project
Robust statistics and trends over the last decades
of the physical and bio-chemical parameters
A recognised Pan-European data infrastructure able
to contributes to international programmes related
to GOOS/MEDGOOS, CLIVAR,JGOFS..