Transcript GRAS SAF System, Products, and Archive Frans Rubek & Martin Bjært Sørensen

GRAS SAF System, Products,
and Archive
Frans Rubek & Martin Bjært Sørensen
GRAS SAF Team
Danmarks Meteorologiske Institut
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 1
EPS/Metop Radio Occultation from
GPS
EPS/Metop
Vertical profile of
refractivity
GPS
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 2
Typical 24-hour EPS/Metop
Radio Occultation Distribution
1 LEO with two
occultation antennas
2nd GRAS SAF User Workshop
24 GPS satellites
June 11 - 13 2003 Helsingør
Slide 3
Data Levels and Processing
EPS/Metop
Measurement
GRAS SAF
Level 1b -> Level 2
Processing,
Dissemination,
Archiving, ...
Raw Data
Downlink
High-latitude
Downlink Site
Demultiplexing,
Quality check
Level 2 Data:
Refractivity, pressure,
temperature, and humidity
profiles, Validation Data ...
Level 1b Data:
Bending Angles, Impact
Parameters, Auxiliary Data, ...
Level 0 Data:
Phase and Amplitude Data,
Tracking and Ancillary Data,
Ground Site Data, ...
2nd GRAS SAF User Workshop
End Users
Level 1a Data:
Phase Delays, Doppler Shifts,
SNR, Earth Location Data, ...
EPS Core Ground Segment
Level 0 -> Level 1a Processing
Level 1a -> Level 1b Processing
June 11 - 13 2003 Helsingør
Slide 4
GRAS SAF Data Flow Model
Occultation
measurements
GPS
Ground Station
Networks
EPS/Metop
EUMETSAT
Level 0
EPS / CGS
EPS data
downlink
GPS POD
data
Level 0
Level 1b
GRAS
Ground Processor
Level 1b
EPS Primary
NRT User
Terminal
Operational GRAS SAF
Level 1b
NWP
users
Development
NWP
centers
Ancillary
data
Processing Center
Archiving
Center
NRT products
(Level 2)
Offline
Archive
(Level 2)
RMDCN,
GTS
HTTP,
FTP
Software products
Education / Help desk
Public outreach
DVD/CD- ROM
per mail
UMARF
Client
Server
UMARF
HTTP
End users
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 5
Initial Joint Polar System (IJPS)
(EPS + NPOESS Program)
NOAA N, N’ (p.m.),
NPOESS
METOP (a.m.)
Global data
dump
Blind orbits
data dump
Global data
dump
SAF
NOAA global data
METOP blind orbits
EUMETSAT
CNES
IASI TEC
NOAA
SAF
METOP global data
NOAA blind orbits
EUMETSAT POLAR SYSTEM (EPS)
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 6
GRAS SAF Products Time
Requirements
Near-Real Time Products:
(NRT)
To be delivered less than 3 hours after
measurement, using RMDCN (Regional
Meteorological Data Communication
Network), GTS, a.o.
Mainly for NWP use.
Offline Products:
Improved products re-processed using
precise satellite orbits, additional NWP
input, etc.
To be delivered less than 30 days after
measurement, using FTP, DVD/CD-ROM,
WWW download, a.o.
Mainly for climate research use.
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 7
NRT Data Flow as a Function of Time
Recording
Orbit N
Recording
Orbit N+1
Recording
Orbit N+2
On board data
acquisition
Elementary unit
Satellite dump
to CDA
CDA to EPS/CGS
transmission
EPS/CGS Level 1b
processing
NRT Level 1b
transmission to SAF
GRAS SAF NRT
Level 2 processing
GRAS SAF NRT
Level 2 dissemination
Processing Orbit N
2nd GRAS SAF User Workshop
Processing Orbit N+1
June 11 - 13 2003 Helsingør
TIME
Slide 8
GRAS SAF Products Overview
Data Product
Characteristics
Bending Angle Profile
(Offline only) Bending angle as a function of impact
parameter
Refractivity Profile
Neutral Refractivity as a function of height and location
of the occultation
Observation
Characteristics
Error profile and covariance matrices of the observables.
Time information for the occultation data.
Latitude, longitude and radial position of the occultation
products in geodetic coordinates.
Temperature Profile
Temperature (dry/wet) and error estimate as a function of
height and location of the occultation
Specific Humidity Profile
Specific humidity (water vapor) and error estimate as a
function of height and location of the occultation
Pressure Profile
Dry pressure and error estimate as a function of height and
location of the occultation, including surface pressure
Surface Pressure
(NRT only) Pressure estimate at surface level
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 9
GRAS SAF Assimilation S/W Products
Statistically optimal 1D-Var refractivity retrieval code
Forward models for 4D-Var:
- Direct assimilation of refractivity profiles into an NWP model
- Plane-averaged refractivity forward model for assimilation
into an NWP model
- Direct assimilation of bending angle as a function of impact
parameter into an NWP model
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 10
User Requirements for NWP
Horizontal
Domain
Horizontal
Sampling
Vertical
Domain
Vertical
Sampling
LT
HT
LS
HS
Time
Window
RMS
Accuracy 4)
Timeliness
LT
HT
LS
HS
Temperature
Specific
Humidity
Global
Global
100–2000km
100 –
2000km
100–2000km
100–2000km
100–
2000km
Sfc–1 hPa
Sfc–100 hPa
Sfc (msl)
Sfc–1 hPa
Sfc–80 km
0.3–3km
1–3 km
1–3 km
1–3 km
0.4–2 km
1–3 km
–
–
–
–
–
–
0.3–3 km
1–3 km
1–3 km
1–3 km
1–12 hrs
1–12 hrs
1–12 hrs
1–12 hrs
1–12 hrs
0.5–3 K
0.5–3 K
0.5–3 K
0.5–5 K
1-3 hrs
0.25–1 g/kg 5)
0.05–0.2g/kg5)
–
–
1–3 hrs
0.5–2 hPa
–
–
–
1–3 hrs
0.1–0.5%
0.1–0.2%
0.1–0.2%
0.2–2%
1–3 hrs
¦ 1 rad
¦ or
¦ 0.4% 7)
¦
1–3 hrs
2nd GRAS SAF User Workshop
Surface
Pressure
Global
Refractivity
Global
June 11 - 13 2003 Helsingør
Bending
Angle
Global
¦
¦
¦ 2–5 Hz
¦
Slide 11
User Requirements for Climate
Research
Horizontal Domain
Horizontal Sampling
Vertical Domain
Vertical
Resolution 2)
LT
HT
LS
HS
Time Resolution 3)
RMS
Accuracy 4)
Timeliness
Time Domain
Long-term Stability
No. of profiles/
grid box/month
2nd GRAS SAF User Workshop
LT
HT
LS
HS
Temperature
Global
100–1000 km
Surface to 1 hPa
0.3–3 km
1–3 km
1–3 km
5–10 km
3–24 hrs
0.5–3 K
0.5–3 K
0.5–3 K
1–3K
30–60 days
> 10 years
< 0.1 K/decade
Specific Humidity
Global
100–1000 km
Surface to 1 hPa
0.5–2 km
0.5–2 km
0.5–2 km
1–3 km
3–24 hrs
0.25–1 g/kg 6)
0.05–0.2 g/kg 6)
–
–
30–60 days
> 10 years
< 2% RH/decade
> 10
> 10
June 11 - 13 2003 Helsingør
Slide 12
GRAS SAF Prototype Temperature
Profile from CHAMP Data
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 13
GRAS SAF Prototype Temperature
Statistics using CHAMP Data
1630 profiles
January 6 – 23 2002
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 14
NRT & Offline Processing Flowchart
1a
NOISE REDUCTION (LP FILTERING),
QUALITY CHECK,
COORDINATE TRANSFORMATION,
BACK PROPAGATION/CANONICAL
TRANSFORM ROUTINE (below 17 km),
BENDING ANGLE ROUTINE (above 17 km)
PHASE AND AMPLITUDE
MEASUREMENTS + ORBIT INFORMATION
(OFFLINE)
BENDING ANGLES
(NRT)
1b
BENDING ANGLE PROFILE
IONOSPHERE CORRECTION,
STATISTICAL OPTIMIZATION
(NRT ONLY)
ABEL TRANSFORM ROUTINE
BACKGROUND TEMPERATURE,
HUMIDITY, and
SURFACE PRESSURE
REFRACTIVITY PROFILE
1D-VAR RETRIEVAL
(NRT ONLY),
ITERATIVE ALGORITHM
(OFFLINE ONLY)
WET TEMPERATURE,
SPECIFIC HUMIDITY,
SURFACE PRESSURE
(NRT ONLY)
2nd GRAS SAF User Workshop
1b
2
2
HYDROSTATIC EQUILIBRIUM,
IDEAL GAS EQUATION
2
DRY PRESSURE,
DRY TEMPERATURE
June 11 - 13 2003 Helsingør
Slide 15
GRAS SAF Processing Chain
Near real time retrieval: from bending angle to level 2
Off-line retrieval: from observed phase to level 2
Processing steps:
• Excess phase (offline only)
• Bending angle (offline only)
• Refractivity
• “Dry” temperature, pressure and density
• “Wet” temperature, pressure and density
• Surface pressure (NRT only)
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 16
Software & Platforms
 Distributed scaleable system using CORBA
 Based on Sun workstations and Linux PC’s




Python
OmniORB
UNIX shell
FORTRAN 77/90
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 17
Interfaces
UMARF
Client
GRAS SAF
Request
Manager
E1
User requests
EPS NRT
Terminal
NRT
users
Data Retriever
E2
Task Manager
OFF-Line
users
E5
IGS
E3
Product
Generator
ECMWF
(& other NWP
centers)
Report
Generator
E4
Send Data
E6
UMARF
Client
E7
Send Meta
Data
at GRAS
Located
SAF Centre
2nd GRAS SAF User Workshop
data
Ancillary
sources
User
facilities
June 11 - 13 2003 Helsingør
Slide 18
GRAS SAF Processing System
Request
Manager
TaskManager
Monitor
Client
GTS
EndUser
ReportGe
System
nerator
SendD
ReportGen
FTP
ata
erator
store/retrieve
Archive
Manager
TaskMan
ager
UMARF
store/retrieve
store/retrieve
Archive
Proxy
TaskManager
Client
store/retrieve
Product
Generator
TaskManager
TaskManager
Archive
Client
Client
Proxy
do_job
process
Processor
store/retrieve
Data
Retriever
registrer
JobManager
EPS
NRT
2nd GRAS SAF User Workshop
EPS
FTP
IGS
ECMWF
June 11 - 13 2003 Helsingør
Slide 19
Hardware Components
Internet
Router
RMDCN
Router
Firewall
Firewall
GTS Interface
FTP Server
Data switch
Firewall
Level 1B downlink
NRT Terminal
UMARF Client
Data Reciever
Task Managment
NRT Processor
OFF-Line Processor
Archive
& User facilities
External lines
Deployment Site Ethernet
GRAS SAF Private Ethernet
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 20
Data Distribution
Near Real Time products:
• RMDCN ( BUFR only)
• GRAS SAF ftp server
Off-line enhanced products:
• User Requests at EUMETSAT’s UMARF V2 User
services
• - and delivery at the GRAS SAF ftp server
• - or via DVD/CD-ROM
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 21
NRT Dissemination
Reykavik
Helsinki
Oslo
Helsinki
Reykjavik
Nordköping
Reykjavik
Reykavik
Tallin
Copenhagen
Reykavik
Reykavik
Dublin
Riga
Copenhagen
Reykavi
Vienna
De Bit
Reykavik
Zurich
Brussels
Reykavik
T
oulouse
Vilnius
ECMWF
ECMWF
Reykavik
Offenbach
Ljubjana
Reykavik
Lisbon
Reykavik
Madrid
Zürich
Budapest
Reykavik
Rome
Zagreb
Reykavik
Athens
Ankara
Regional Meteorological Data Communication Network for ECMWF and WMO
Region VI
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 22
UMARF V2 – Area Selection
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 23
UMARF V2 – Satellite Search
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 24
UMARF V2 – Product Details
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 25
UMARF V2 – Order Follow-Up
2nd GRAS SAF User Workshop
June 11 - 13 2003 Helsingør
Slide 26