Transcript WMO Information System (WIS) WMO Information System (WIS) Heinrich Knottenberg Deutscher Wetterdienst Kaiserleistraße 42 D-63067 Offenbach am Main E-Mail: [email protected] -1-

WMO Information System (WIS)
WMO Information System (WIS)
Heinrich Knottenberg
Deutscher Wetterdienst
Kaiserleistraße 42
D-63067 Offenbach am Main
E-Mail:
[email protected]
-1-
WMO Information System (WIS)
Contents
• Background
• Concept of WIS
• Impact on and benefit for WMO programmes
• Future actions
• Summary
WMO Metadata Workshop
-2-
27.September.2005
WMO Information System (WIS)
Current WMO Information System
Includes:
(A) The World
Weather Watch
(WWW)
Source: Dr Geoff Love, President of CBS, 2001
WMO Metadata Workshop
-3-
27.September.2005
WMO Information System (WIS)
Current WMO Information System
With its vitally important
systems:
A (i)
The Global
Observing
System (GOS)
Source: Dr Geoff Love, President of CBS, 2001
WMO Metadata Workshop
-4-
27.September.2005
WMO Information System (WIS)
Current WMO Information System
A (ii)
The Global
Data Processing
System (GDPS)
Source: Dr Geoff Love, President of CBS, 2001
WMO Metadata Workshop
-5-
27.September.2005
WMO Information System (WIS)
Current WMO Information System
Main Telecommunication Network (MTN)
A (iii)
The Global
Telecommunication
System
(GTS)
Region IV
Northern & Central
America
Region VI
Europe Moskau
Offenbach
Exeter
Region II
Asia
Prag
Toulouse
Washington
Peking
Sofia
Algier
Tokio
Kairo
Jeddah
Neu Delhi
Dakar Region I
Africa
Brasilia
Region III
Southern America
Nairobi
Region V
South-West Pacific Melbourne
Buenos
Aires
= World Meteorological Centre (WMC)
= Regional Telecommunication Hub (RTH)
DWD/TI15b/Ma
25.02.05
WMO Metadata Workshop
-6-
27.September.2005
WMO Information System (WIS)
Information types, formats and
transmission systems
• Real time
–
–
–
–
meteorological
hydrological
marine
aeronautical
• Non real time
– climatological
– chemical
composition
– agricultural
– ...
•ASCII
–SYNOP, TEMP,
CREX,...
–XML
–...
•Binary data formats
–GRIB
–BUFR
–netCDF
–...
•Graphical formats
–MPEG
–GIF
–...
•Dial-up links
•Leased circuits
•Managed data
networks
•Internet
•Satellite
•HF Radio, Telegraphy
•Post
•..
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
-7-
27.September.2005
WMO Information System (WIS)
Current WMO Information System
And also
includes:
(B) The
multiplicity of
Internet-based
systems to
meet WMO
related
requirements
not met by the
WWW
Source: Dr Geoff Love, President of CBS, 2001
WMO Metadata Workshop
-8-
27.September.2005
WMO Information System (WIS)
Types of WWW Centres
• NMC
National Meteorological Centre, e.g., Brasila (Brazil)
• RSMC
Regional Specialised Meteorological Centre, e.g., Beijing (China)
• WMC
World Meteorological Centre, i.e. Melbourne, Moscow, Washington
• RTH
Regional Telecommunication Hub, e.g., Vienna, Cairo, …
• RTH on MTN
RTH on Main Telecommunication Network, e.g., New Delhi, Tokyo,
Washington, …
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
-9-
27.September.2005
WMO Information System (WIS)
World Data Centres (WDC)
•
•
•
•
•
•
•
•
•
•
•
•
WDC for Meteorology, Asheville
WDC for Meteorology, Obninsk
WDC for Meteorology, Beijing
WDC for Climate, Hamburg
WMO WDC for Ozone and Ultraviolet Radiation
WMO WDC for Greenhouse Gases
WMO WDC for Aerosols
WMO World Radiation Centre
WMO WDC for Aerosol Optical Depth
WMO WDC for Precipitation Chemistry
WMO Global Runoff Data Centre
...
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 10 -
27.September.2005
WMO Information System (WIS)
TRENDS IN INFORMATION REQUIREMENTS
Increasing data volumes from
remote sensing systems
Source: Dr Geoff Love, President of CBS, 2001
WMO Metadata Workshop
- 11 -
27.September.2005
WMO Information System (WIS)
TRENDS IN INFORMATION REQUIREMENTS
Increasing data volumes
from numerical weather
prediction systems
Source: Dr Geoff Love, President of CBS, 2001
WMO Metadata Workshop
- 12 -
27.September.2005
WMO Information System (WIS)
TRENDS IN INFORMATION REQUIREMENTS
The need to integrate
different data sets (eg.
Data from the GAW
network with those
from the GOS)
Source: Dr Geoff Love, President of CBS, 2001
WMO Metadata Workshop
- 13 -
27.September.2005
WMO Information System (WIS)
TRENDS IN INFORMATION TECHNOLOGIES
Exponential growth of
the Internet - including
global penetration
Source: Internet Software Consortium (http://www.isc.org/) , 2003
WMO Metadata Workshop
- 14 -
27.September.2005
WMO Information System (WIS)
TRENDS IN INFORMATION TECHNOLOGY
The opportunity is to take these new technologies
and build a logically separate Future WMO
Information System (FWIS), using the Internet,
which meets the requirements of all WMO
programmes for the exchange of meteorological
and related data.
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 15 -
27.September.2005
WMO Information System (WIS)
WMO Congress XIV (2003)
“The multiplicity of systems of the different Programmes
causes incompatibilities, inefficiencies, duplication of
efforts and higher overall costs.”
Congress approved the concept of FWIS, which will
provide a single coordinated global infrastructure for
the collection and sharing of information in support of all
WMO and related international programmes.
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 16 -
27.September.2005
WMO Information System (WIS)
Inter-Programme Task Team on
FWIS
• Created in 1998 by CBS-Ext(98), Karlsruhe (Germany)
• Melbourne (Australia), 1-5 Nov. 1999
• Monterey, CA (USA), 28 Aug. - 1 Sep.2000
• Langen (Germany), 25-29 Jun. 2001
• Johannesburg (South Africa), 23-27 Sep. 2002
• Kuala Lumpur (Malaysia), 20-24 Oct. 2003
• Geneva (Switzerland), 22-24 Sep. 2004
Result: Concept, pilot projects
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 17 -
27.September.2005
WMO Information System (WIS)
Cross-programme requirements for
FWIS
• Widely available and electronic (on-line) metadata and data
catalogues of all relevant data required by the WMO
Programmes
• Harmonisation of data formats, transmission standards,
archiving and distribution mechanisms to better support interdisciplinary use of data and products.
• Standard practices for the collection, electronic archival and
exchange of metadata, both high-level and detailed, especially
for stations and instruments.
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 18 -
27.September.2005
WMO Information System (WIS)
Technical requirements
 Routine collection and automated dissemination of all
observed data and products (”push”) according to
requirements.
 Ad-hoc requests for data and products (”pull”)
 FWIS should be reliable, cost-effective, modular, scalable,
and flexible to support:
 Different user groups
 Various data policies, such as WMO Res. 40 and 25
 Data as well as network security
 Integration of diverse datasets
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 19 -
27.September.2005
WMO Information System (WIS)
Virtual structure of FWIS
•
•
•
•
National Centres (NC)
Global Information System Centres (GISC)
Data Collection and Production Centres (DCPC)
Data communication network
The names of these virtual centres describe their functionality, not the
actual organisational entities. There may be organisations, such as
NMHSs, which combine all three virtual centres within one facility.
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 20 -
27.September.2005
WMO Information System (WIS)
National Centre (NC)
• Collect national observations
• “Push” data intended for global dissemination to the associated GISC
• “Push” data intended for regional or specialised distribution to the
associated DCPC
• Collect, generate and disseminate products for national use.
• Participate in monitoring the performance of the system
• Authorize their national users to access FWIS, as appropriate
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 21 -
27.September.2005
WMO Information System (WIS)
Global Information System Centre
(GISC)
•
Receive observations intended for global exchange from NCs and DCPCs
within their area of responsibility
•
Exchange information intended for global exchange with other GISCs
•
Disseminate, within its area of responsibility, the data and products agreed
by WMO for global exchange
•
Hold the data and products agreed for global exchange for at least 24
hours and make it available via WMO request/reply (”Pull”) mechanisms
•
Maintain, in accordance to the WMO standards, a catalogue of all data and
products for global exchange and provide access to this catalogue
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 22 -
27.September.2005
WMO Information System (WIS)
Data Collection and Production Centre
(DCPC)
•
Receive information intended for dissemination to NCs within its area of
responsibility (i.e. regional collection)
•
Collect programme-specific data and products
•
Produce regional or specialized data and products
•
“Push” information intended for global exchange to their associated
GISC
•
Disseminate information intended for regional exchange
•
Support access to their products via request/reply (”Pull”) mechanism
•
Maintain data and product catalogues in a WMO-agreed standard format
and facilitate access to this catalogue
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 23 -
27.September.2005
WMO Information System (WIS)
Data communication network
The data communication network should:
•
be based on an agreed technology available to the participating
centres
•
be capable of handling the data volumes
•
include satellite communication channels, terrestrial links and
managed data network services
•
handle the agreed transmission protocols
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 24 -
27.September.2005
WMO Information System (WIS)
Information distribution
Various communication
networks
DCPC
NC
Na
tio
nal
us
ers
NC
NC
GISC
NC
NC
GISC
GISC
DCPC
DCPC
NC
Na
tio
nal
us
ers
GISC
DCPC
NC
NC
Routine
(Internet, private
dissemination
satellite,
network,
etc.)
WMO Metadata Workshop
National
dissemination
Request/reply
(Internet)
- 26 -
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005
WMO Information System (WIS)
New features
• Common to all WMO programmes
• Supporting real and non-real time data sets
• Supporting “pull” and “push” mechanisms for all data
• Supporting various communication protocols for data
transmission
• Using different types of communication links as available and
appropriate, including GTS, satellites and Internet
• Using off-the-shelf hardware and software systems
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 27 -
27.September.2005
WMO Information System (WIS)
FWIS design concepts
, NC
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 28 -
27.September.2005
WMO Information System (WIS)
Other relevant activities
• EUMETNET UNIDART project
•
development of a meteorological Web portal which will provide uniform access to
meteorological data and products through the Internet using Grid services
• CliWare
–
Russian information system that allows authorized users to access hydrometeorological data and products over the Internet
• Earth System Grid
–
US project that enables management, discovery, distributed access, processing, &
analysis of distributed terascale climate research data
• NCAR Community Data Portal
• DMAC of IOOS
–
US project to acquire and use ocean-related data
• NERC DataGrid
–
UK e-Science project for accessing environmental information
• RA-VI VGISC project
• WIS VPN Pilot Project in RAs II and V
Dieter R.Sanek, 2005
WMO Metadata Workshop
- 29 -
27.September.2005
WMO Information System (WIS)
Impact on and benefits for WMO
• FWIS concerns only telecommunication and data management
functions of the WMO and does not affect the data processing
components of any WMO Programme.
• Provision of data and products on the basis of request/reply
services would likely be the most significant addition.
• Programmes would benefit from the services offered by FWIS
for the implementation of their data exchange tasks.
• For individual users, either a person or an institution, FWIS
would provide a single entry point for any data request, be it on
a routine basis by dissemination of certain user defined
information sets or on an ad-hoc basis for a special data set.
• By making use of off the shelf technologies of a lower cost,
FWIS would allow least developed Members, for the first time, to
actively participate in the WMO Programmes, specifically the
WWW.
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 30 -
27.September.2005
WMO Information System (WIS)
How could FWIS be constructed?
• A GISC is a new development (metadata directories, etc.)
• The NC and DCPC basically already exist and add interfaces for
new services
• A pilot project for GISC development is the RA-VI VGISC project
• Development of more GISC’s projects, e.g. RA-II project
• Workshop in conjunction with CBS-Ext(06)
• Trials of inter-GISC communication after 2006
• Phased implementation of FWIS from 2008 onwards
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 31 -
27.September.2005
WMO Information System (WIS)
RA-VI VGISC Project
• In 2001, RA-VI decided to create a project for the
development of a prototype GISC.
• The NMSs of France, Germany and the UK have
volunteered to jointly design and implement a virtual
GISC (VGISC) shared by their Services and to
include the ECMWF and EUMETSAT as DCPCs into
the concept, funded partially as EU project SIMDAT.
• A proof-of-concept system was demonstrated during
CBS XIII.
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 32 -
27.September.2005
WMO Information System (WIS)
VGISC Project Overview
Steering Group
2001
(Geerd Hoffmann, DWD)
VGISC-Definition and -Prototype
2005 (beginning)
VGISC-SIMDAT
2006 (mid)
2008 (end)
VGISC-Operations
WMO Metadata Workshop
- 33 -
27.September.2005
WMO Information System (WIS)
VGISC Working Groups
•
•
•
•
Data Policy (Francois Duvernet, Meteo France)
Data Management (Steve Foreman, UK Met)
Data Acquisition and Dissemination (H. Knottenberg, DWD)
Communication (Hans Janßen, DWD)
WMO Metadata Workshop
- 34 -
27.September.2005
WMO Information System (WIS)
“Pull” request handling
GISC-node
WebBrowser
Tools and frontend-Server
(adminstration- and
coordination centre)
Production
(NC/DCPC)
Local data pool(s)
GISC
product instance
pool
local production
tools
definition demon or
-webservice
Client
product instance
catalogue
production control
translator
global instructions
(for data searching and production)
distribution tool (push)
product
catalogue
monitoring tool
distribution catalog.
WMO Metadata Workshop
data control
translator
atomic
catalogue
distribution demon or
-webservice (pull)
synchronisation tool
local
instruction
(searching for
atoms in
own database )
local
instruction
(for own
production
tools)
Metadata-pool
Internet Portal
(web frontend)
local data source
customer
orders
data flow
control flow
- 35 -
27.September.2005
WMO Information System (WIS)
“Push” distribution
GISC-node
Tools and frontend-Server
(adminstration- and
coordination centre)
Local data pool(s)
GISC
product instance
pool
Metadata-pool
Internet Portal
(web frontend)
definition demon or
-webservice
Client
product instance
catalogue
atomic
catalogue
distribution demon or
-webservice (pull)
product
catalogue
distribution tool (push)
monitoring tool
synchronisation tool
WMO Metadata Workshop
distribution catalog.
customer
orders
data flow
control flow
- 36 -
27.September.2005
WMO Information System (WIS)
CBS 2005 GISC Prototype
• DWD: Portal
• DWD: Push/Pull System
• DWD: Access to climate time-series data (UNIDART-Project)
• UK Met Office: XML Metadata / - Data Prototype (Description only)
• ECMWF: Model Analyses
• EUMETSAT: Access to EUMETCast Dissemination
• NCAR: Model Analyses
- 37 -
WMO Information System (WIS)
Installation at the CBS XIII in Saint Petersburg
Internet
Hotel wireless LAN
Interactive
Client
Client
VGISC
LAN
Dissemination
DVB
EUMETCast
MSG
Ninjo
Ninjo
Broadcast
Receiver
Server
Server
Client
Provided by EUMETSAT
(Exhibition Hall)
- 38 -
WMO Information System (WIS)
WMO Metadata Workshop
- 39 -
27.September.2005
WMO Information System (WIS)
General
SIMDAT
Data Grids for Process and Product Development
using Numerical Simulation and Knowledge Discovery
www.simdat.org
funded by the European Commission
WMO Metadata Workshop
- 40 -
27.September.2005
WMO Information System (WIS)
SIMDAT Application and Technology
Application Activities
Technology Activities
Four sectors of international
economic importance:
Seven Grid-technology
development areas:
Automotive
Pharmaceutical
Aerospace
Meteorology
Grid infrastructure
Distributed Data Access
VO Administration
Workflows
Ontologies
Analysis Services
Knowledge Services
WMO Metadata Workshop
- 41 -
27.September.2005
WMO Information System (WIS)
SIMDAT Conceptual View
WMO Metadata Workshop
- 42 -
27.September.2005
WMO Information System (WIS)
VGISC-SIMDAT Working Groups
• Project Manager: Matteo dell’ Aqua, ECWMF
•
•
•
•
Virtual Organisations (Lothar Wolf, EUMETSAT)
Ontology (Jeremy Tandy, UK Met Office)
Distributed Data (Jacques Roumilhac, Meteo France)
Grid Infrastructure (Hans Janßen, DWD)
WMO Metadata Workshop
- 43 -
27.September.2005
WMO Information System (WIS)
SIMDAT VGISC structure
Logo
VGISC
WMO Metadata Workshop
- 44 -
27.September.2005
WMO Information System (WIS)
SIMDAT Demonstrator
To be presented to EU-Commission in November 2005:
• VGISC-Nodes at the contributing sites
• DWD: Access to climate time-series data
• UK Met Office: XML Metadata / - Data Prototype
• Meteo France: Model Output
• ECMWF: Model Analyses
• ECMWF: Observational Data (One Sample Day)
- 45 -
WMO Information System (WIS)
WIS VPN Pilot Project in RAs II and V
„CBS XIII was also very pleased to note the success of the first
phase of the Virtual Private Network project in Regions II and V, and
that the pilot project would be significantly expanded with additional
components, including prototype applications, and more
participating NMHSs in the years 2005-2006."
Participants
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Australia
Brunei
China
Hong Kong, China
India
Iran
Japan
WMO Metadata Workshop
- 46 -
Macao, China
Oman
Republic of Korea
Malaysia
New Zealand
Saudi Arabia
Vietnam
27.September.2005
WMO Information System (WIS)
WIS VPN Pilot Project in RAs II and V
Australia
(Simulating GISC)
Permanent or routine VPN link
Hong Kong, China
(Simulating NC)
Beijing
(Simulating DCPC)
Vietnam
(Simulating NC)
Internet
Japan
(Simulating DCPC)
Korea
(Simulating NC)
India
(Simulating NC)
Saudi Arabia
(Simulating NC)
Brunei
(Simulating NC)
Malaysia
(Simulating NC)
New Zealand
(Simulating NC)
(Pattern A) Test for branch links among a GISC, DCPCs and NCs on routine basis
WMO Metadata Workshop
- 47 -
27.September.2005
WMO Information System (WIS)
WIS VPN Pilot Project in RAs II and V
WMO Metadata Workshop
- 48 -
27.September.2005
WMO Information System (WIS)
Inter-Commission Coordination Group on FWIS
(ICG-FWIS)
Created in 2004 by EC-LVI through Resolution 2.
Terms of reference:
• To coordinate the refinement and consolidation of the FWIS based on the
approved concept and then the implementation planning phases;
•
To assess in detail the data exchange and data management requirements
of WMO Programmes, at present and for the foreseeable future, which
should be met by the FWIS;
•
To advise the technical commissions on the development in datacommunications and management functions to be required in the FWIS as
regards their respective programmes;
•
To guide the orderly evolution of existing WMO information systems
towards FWIS;
•
To address the major issues that had been identified.
WMO Metadata Workshop
- 49 -
27.September.2005
WMO Information System (WIS)
Inter-Commission Coordination Group on FWIS
ICG-FWIS (First meeting in Geneva, 12-14 January 2005) recommended coordination
mechanisms for the FWIS development and future activities:
 Support of the proposed CBS Inter-Programme Expert Team on Metadata
Implementation, Expert Team on FWIS GISCs and DCPCs and Expert Team on
FWIS/GTS Communication Techniques and Structure.
 Strongly supported the establishment of TCs’ Expert Teams that are relevant
to FWIS (data-management, metadata, XML, data-exchange) and their mutual
cooperation and coordination for fostering consistent and rapid FWIS
development
 Metadata aspects are crucial for the FWIS development and should be quickly
consolidated, full endorsement of the WMO Core Profile of the ISO Metadata
Standard.
 Recommendation for organizing a inter-programme workshop on metadata,
jointly with CBS/IPET-Metadata, by September 2005 and a workshop on GISC
development, jointly with CBS/ET-GISC&DCPC (1 Q 2006)
 Importance of the development of new Programme’s pilot projects to promote
an early introduction of FWIS elements
 Recommendation to rename FWIS as WIS (WMO Information System)
WMO Metadata Workshop
- 50 -
27.September.2005
WMO Information System (WIS)
Summary
•
•
•
•
•
The WIS would be used for the collection and sharing of information for
all WMO and related international programmes.
The WIS vision provides a common roadmap to guide the orderly
evolution of the information system functions performed by current
WMO Programmes into an integrated system that meets efficiently all
of the requirements of Members for the relevant international
environmental information.
The support and involvement of regional associations and technical
commissions is needed, as early as possible, in all phases of the WIS
development in order to ensure a full and shared ownership of the
project, and its effective implementation.
There should be a workshop on WIS in conjunction with CBS-Ext(06)
The implementation of WIS needs to be done in a phased approach in
order to support the IPY (International Polar Year 2007/2008) and
THORPEX.
Dieter C. Schiessl, WMO, Feb 2004
WMO Metadata Workshop
- 51 -
27.September.2005
WMO Information System (WIS)
The Metadata are the “Core”
WMO Metadata Workshop
- 52 -
27.September.2005
WMO Information System (WIS)
Thank you for your attention !
WMO Metadata Workshop
- 53 -
27.September.2005
WMO Information System (WIS)
WMO Metadata Workshop
- 54 -
27.September.2005