Transcript WebWerdis

Web Weather Request and Distribution System (WebWerdis (2006/7))
Fechner, Siegfried
([email protected])
Contents:
–
WebWerdis – What is it?
–
WebWerdis – Design and components
–
WebWerdis – Relation to WIS
S. Fechner, DWD, [email protected]
2006, November
WebWerdis (2006/7) – What is it?
Web Weather Request and Distribution System, WebWerdis, is a new generation of internet
based distribution system. It is one part of redesigned Meteorological Portal of the DWD (start in
2007; preoperativ installation: “http://werdis-cbs.dwd.de/bvbw/bvbwDWD.portal”).
Aims:
–
Accommodation of special usergroups with meteorological data and products (delivery via
pull and push/subscription mode)
–
Harmonisation of the metadata (product, distribution and customer catalogues) of the
currently main distribution tools of the DWD (based on on the recommendation of the “CBS
INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“,
http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc)
–
Unification of the request/response interfaces between the distribution tool and the different
datasources as well as production tools of the Deutscher Wetterdienst
S. Fechner, DWD, [email protected]
2006, November
WebWerdis (2006/7) – What is it?
Technical standards:
Programming
– Java (jdk 1.4 or 1.5), jakarta struts 1.1, EJB 2.0
– Opensource components:
AFD
http://www.dwd.de/AFD
quartz
http://www.opensynphony.com/quartz
OGSA-DAI
http://ogsadai.org.uk
Metadata design
– Product and product instance catalogue (WMO-core metadata standard “formal draft
version 1.0”; 2005, St. Petersburg)
Server
– Webfrontend (Bea-Portal, Weblogic 8.1.5)
– Web-Business-components (each J2EE-container/server)
– OGSA-DAI-gridservice (servlet or J2EE-container/server, e.g. Tomcat or Oracle
Applicationserver)
– Database (Oracle 9i XML-DB)
S. Fechner, DWD, [email protected]
2006, November
WebWerdis (2006/7) – roots of WebWerdis
WebWerdis 2001/2
CBS-Prototype 2005
-
- http://vgisc-2.dwd.de/vgisc/
- WMO-metadata vers. 02
- customised product
(timeseries, only pull)
- pull and push for routine data
(GTS-bulletins and DWDSatproducts)
https://tiofas13.dwd.de/
without metadata catalogues
hardcoded navigation
GTS-global dataset
DWDSat-products
inflexible structure and
products
S. Fechner, DWD, [email protected]
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
DatapoolAdapter
Climate DB
Intranet met.no
GRID-Service
MSSAdapter
„GTS-Customer“
„GTS-Customer“
MSS
GTS
GRID-Service
Datapool(s)
Model DB
Climate DB
GRID-Service
DWD
MSS
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
- registered customers:
research centres and universities in
germany,
GRID-Service
Climate DB
- access to customised
range of products
Customer(s)
for pull and push (question of data policy),
Intranet KMA
- pull: view, download, email, ftp,
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
Intranet met.no
GRID-Service
MSSAdapter
„GTS-Customer“
„GTS-Customer“
MSS
GTS
- access to all product metadata,
- single-handed administration of own
carts, destination details and
subscriptions GRID-Service
(only push)
Climate DB
UnidartAdapter
DatapoolAdapter
- Push (subscription): ftp, email
attachment,
Datapool(s)
Model DB
Climate DB
GRID-Service
DWD
MSS
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
GRID-Service
DatapoolAdapter
Climate DB
Intranet met.no
GRID-Service
„GTS-Customer“:
- demonstration
MSS-of connection to the GTS via push-technology
„GTS-Customer“
(WebWerdis),
Adapter
- metadata publication of newDatapool(s)
defined bulletinsModel
in the DB
Metadata
DB DB
„GTS-Customer“
Climate
MSS
(product description)
GTS
legend:
data flow:
flow:
- routinely generation of bulletins and storing in the datapool,
DWD
- formulation
MSSof subscriptions to transfer these bulletins into the
GTS
Intranet DWD
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GRID-Service
Internet
Climate DB
Intranet fmi
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
- product, product instance catalogue based on
WMO-core standard version 0.2 (WMOWebfrontend
Web-Business
catalogue), volume C (GTS(DWD-Portal)
Logicvolume A (station
bulletins), DWD-internal metadata (DWDSatand model description)),
DatapoolAdapter
„GTS-Customer“
MSS
GTS
transfer logging informations)
MSSAdapter
„GTS-Customer“
- customer
catalogue (customer data for
UnidartGRID-Service
Climate DB
authorisation
Adapterand authentication),
- distribution catalogue (carts, destination details,
Intranet met.no
subscriptions),
GRID-Service
- logging
catalogue (custimised production and
Datapool(s)
Model DB
Climate DB
GRID-Service
DWD
MSS
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
- secondary version: runnable on each
J2EE-conform webcontainer,
GRID-Service
Climate DB
- customised webfrontend for registrated
customer(s) or „free user“
Intranet met.no
UnidartAdapter
DatapoolAdapter
GRID-Service
MSSAdapter
„GTS-Customer“
„GTS-Customer“
MSS
GTS
- part of the new DWD-portal (Beaportal-2006),
Datapool(s)
Model DB
Climate DB
GRID-Service
DWD
MSS
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Web-Business
Logic
Webfrontend
(DWD-Portal)
- implementation: sessionbeans (J2EE),
- controls the product discovery and selection,
- controls the definition and administration of
UnidartGRID-Service
Adapter
customised carts, destinations and
subscriptions (push-distribution),
DatapoolAdapter
MSSAdapter
„GTS-Customer“
„GTS-Customer“
MSS
GTS
- controls the requests to the MSS-, DatapoolGRID-Service
and Unidart-adapters for pull and interprets the
adapter responses (show, download or send
data via email)
Datapool(s)
Model DB
Climate DB
Intranet met.no
Climate DB
GRID-Service
DWD
MSS
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
MSSAdapter
„GTS-Customer“
- controls the responses from the MSS-, Datapool- and Unidartadapters
- sends the products to the customers (via ftp or email attachment)
Model DB Climate DB
Datapool(s)
„GTS-Customer“
MSS
GTS
Webfrontend
Web-Business
(DWD-Portal)
Logic
- implementation based on:
„job scheduling system – quartz “ : http:www.opensynphony.com,
„Automatic File Distributor“: http://www.dwd.de/AFD,
UnidartClimate DB
- generates an activity list,Adapter
based on incoming subscription list (for GRID-Service
the Metadata DB),
DatapoolIntranet met.no
- controls
the time triggered and the event triggered scheduler
Adapter
GRID-Service
(schedulers send requests
to the adapters),
GRID-Service
DWD
MSS
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – push or subscription-software
subscription list
as XML-document
(Metadata DB)
Distribution-Layer
Scheduler-Layer
UnidartAdapter
subscriptiondirectory
Activity List Generator
Distribution
via email ftp
…
Generation of an acitvity list, based on incoming
subscription list
AFD
(Automatic
File
Distributor
–
opensource
legend:
data flow:
metadata flow:
S. Fechner, DWD, [email protected]
Adapter-Layer
Controller
(time triggered)
Controller
(event triggered)
based on
quartz-software
(opensource:
http://www.opensynhony.com/
quartz)
based on
AFD-software
(opensource:
http://www.dwd.de/
AFD)
customised data
via OGSA-DAI-Gridservice
MSSAdapter
customised bulletins
via DWD-MSS
DatapoolAdapter
routine data
(GTS-bulletins, other data
from global data set and
dwd-specifical data
…
universal
Interface
(request and response)
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
DatapoolAdapter
MSSAdapter
„GTS-Customer“
„GTS-Customer“
MSS
GTS
Datapool(s)
GRID-Service
Climate DB
Intranet met.no
GRID-Service
- request
routing to the datapool(s),
- interpretation of adapter response
metadata,
- packaging of response data for
transfer
or pull)
Model
DB (push
Climate
DB
GRID-Service
DWD
MSS
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
DatapoolAdapter
„GTS-Customer“
MSS
Datapool(s)
Intranet met.no
GRID-Service
DWD
MSS
metadata
internet:
S. Fechner, DWD, [email protected]
Model DB
Climate DB
filebased datapool(s),
contents: routine products like:
Intranet DWD
legend:
data flow:
flow:
Climate DB
MSSAdapter
„GTS-Customer“
GTS
GRID-Service
- GTS-standard bulletins
Internet
- DWDSat -products (satellite images,
maps, ...)
intranet:
GRID-Service
Climate DB
Intranet fmi
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
DatapoolAdapter
„GTS-Customer“
MSS
legend:
data flow:
flow:
Climate DB
Intranet met.no
GRID-Service
MSSAdapter
„GTS-Customer“
GTS
GRID-Service
DWD
MSS
-
formulation of an validated MSS statement,
Model DB Climate DB
Datapool(s)
request routing to the DWD MSS,
interpretation of adapter response metadata,
transfer of response data into files (bulletin-,
ascii-text- or other formats),
- packaging of response files for transfer (push
Internet
Intranet
or pull) DWD
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GRID-Service
Climate DB
Intranet fmi
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
DatapoolAdapter
MSSAdapter
„GTS-Customer“
„GTS-Customer“
MSS
GTS
DWD
MSS
GRID-Service
Intranet met.no
GRID-Service
- dispatch of incoming routine bulletins
(corresponding
volume
to theDB
Model
DB C)
Climate
Datapool(s) to WMO
datapool(s),
GRID-Service
- generation of customised bulletins
(request from MSS-adapter),
- dispatch of customised bulletins back to Internet
Intranet
DWD
the MSS-adapter
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
Climate DB
intranet:
Climate DB
Intranet fmi
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
DatapoolAdapter
MSSAdapter
„GTS-Customer“
„GTS-Customer“
MSS
GTS
Datapool(s)
DWD
MSS
GRID-Service
Climate DB
- formulation of an validated UNIDART
request statement,
Intranet met.no
- request routing to the GRID-Services,
GRID-Service - interpretation of adapter response
metadata,
- transfer the response data into file(s)
(xml-format),
packaging of response files for transfer
Model DB Climate-DB
(push or pull)
GRID-Service
Climate DB
Internet
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
GRID-Service
Climate DB
Customer(s)
Intranet KMA
Metadata DB
Pushsoftware
Webfrontend
(DWD-Portal)
Web-Business
Logic
UnidartAdapter
DatapoolAdapter
„GTS-Customer“
MSS
GTS
Climate DB
Intranet met.no
GRID-Service
- OGSA-DAI-gridservice UNIDARTproject (DWD, Germany),
MSSAdapter
„GTS-Customer“
GRID-Service
Datapool(s)
Model DB
DWD
MSS
- part of DWD-Intranet,
Climate DB
- connector to climate database and
NWP (numerical weatherGRID-Service
predication)
model(s) database (planned),
- customised database request
Internet
Climate DB
Intranet fmi
Intranet DWD
legend:
data flow:
flow:
metadata
internet:
S. Fechner, DWD, [email protected]
intranet:
GTS:
2006, November
WebWerdis (2006/7) – Design and components
- OGSA-DAI-gridservice
UNIDART-project (KMI,
Customer(s)
Republic of Korea),
Metadata DB
GRID-Service
Climate DB
Intranet KMA
- VPN, certified gridservice,
Pushsoftware
Web-Business
Logic
- connector to climate database,
Webfrontend
- customised
database request
(DWD-Portal)
- OGSA-DAI-gridservice
UNIDART-project (met.no,
UnidartAdapter
Norway),
- certified gridservice,
DatapoolAdapter
„GTS-Customer“
MSS
Intranet met.no
- connector to climate database,
GRID-Service
- customised database request
Datapool(s)
- OGSA-DAI-gridservice
Model DB
Climate DB (fmi,
UNIDART-project
Finland).
DWD
MSS
metadata
internet:
S. Fechner, DWD, [email protected]
GRID-Service
- certified gridservice,
- connector to climate database,
Internet
- customised database request
Intranet DWD
legend:
data flow:
flow:
Climate DB
MSSAdapter
„GTS-Customer“
GTS
GRID-Service
intranet:
Climate DB
Intranet fmi
GTS:
2006, November
WebWerdis (2006/7) – Relation to WIS
WebWerdis is not a prototype of an GISC or VGISC. The primary aim was the development of a
modern internet based request and distribution system as part of the redesigned DWD
Meteorological portal.
but:
–
WebWerdis design is geared to the design principles for the WIS data communication
structure of the “INTER-COMMISSION COORDINATION GROUP ON THE WMO
INFORMATION SYSTEM, THIRD Session” (http://www.wmo.int/web/www/ISS/ICG-WISIII/Doc3-1(3)WIS-ComStructure.doc)
–
Metadata structures are be based on the recommendation of the “CBS INTERPROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“,
http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc)
–
Structure and implementation would be incorporate into future WIS distribution tools (e.g.
VGISC/SIMDAT- or UNIDART-project:
http://www.ecmwf.int/services/grid/simdat/wiki/do/get/simdat or
http://www.dwd.de/UNIDART/)
S. Fechner, DWD, [email protected]
2006, November
WebWerdis (2006/7) – Relation to WIS
Next planned adjustments:
–
Extension of the range of data and products (currently range: climatological information from
selected stations across Germany, Norway, Finland and the Republic of Korea; Weather
messages in accordance with the international exchange of data and a selection of satellite
images, of weather forecast charts and of analytic-data)
–
Redesign of all metadata catalogues to bring them into agreement with the recommendation
of the “CBS INTER-PROGRAMME EXPERT TEAM ON METADATA IMPLEMENTATION“,
http://www.wmo.int/web/www/WDM/IPET-MI-II/IPET-MI-II_Final_report.doc). Important
requirements are:
1.
the appropriation of the main catalogues (e.g. WMO Meteorological Bulletins
Volume C1 and Volume A) and
2.
the redesign of the DWD-internal product and station catalogues
as ISO-19100 documents.
–
Incorporation of the main components of WebWerdis into the VGISC/SIMDAT project
S. Fechner, DWD, [email protected]
2006, November
WebWerdis (2006/7) – Relation to WIS
S. Fechner, DWD, [email protected]
2006, November