Nathalie Voisin 1 , Florian Pappenberger 2 , Dennis Lettenmaier 1 , Roberto Buizza 2 , and John Schaake 3 3 2 1 University of Washington ECMWF National Weather Service – NOAA CEE Department Seminar, University of Washington, June 3 2010

Existing Flood Alert Systems in mostly-ungauged basins Limpopo 2000

Early Flood Alert System for Southern Africa (Artan et al. 2001)

South Asia 2000

Mekong River Commission – basin wide approach for flood forecasting

Bangladesh 2004 Horn of Africa 2004

(Hopson and Webster 2010)* (Thiemig et al. 2010, EU - AFAS)*

Zambezi 2001,2007,2008

(EU-AFAS, in process)* * Ensemble flow forecasting 2



Basics

 What is meteorological ensemble forecasting?

   What is hydrological ensemble forecasting?

 Structure of a medium-range flood forecast system

A medium range flood forecast system for global application Ensemble hydrological forecast verification

3



Generation of the ensemble members

Set of perturbed initial conditions

… X members

Weather forecast Model (global or regional)

… Quasi 3D models Spatially distributed

X ensemble members Surface air temperature, 24h precipitation, surface wind

…

Processing of the probabilities

Calibration of forecast

4

www.probcast.washington.edu



Probabilistic forecast / ensemble forecast

5

www.probcast.washington.edu



Maps of probabilistic forecasts

6



EFAS – CHPS – other probabilistic flood forecast system

Ensemble weather forecast

… 51 members

Calibration of weather forecasts (OPTIONAL) In-situ observation: Precipitation, temperature, wind

…

(Semi-)distributed/lumped hydrological model

…

Ensemble flow forecast OBSERVED river flow Post-processor : calibration of the flow forecast 7

Develop a medium range probabilistic quantitative hydrologic forecast system applicable globally:  Using only (quasi-) globally available tools: ▪ Global Circulation Model ensemble weather forecasts ▪ High spatial resolution satellite-based remote sensing  Using a semi distributed hydrology model ▪ applicable for different basin sizes, not basin dependent ▪ flow forecasts at several locations within large ungauged basins  Daily time steps, up to 2 weeks lead time  Reliable and accurate for potential real time decision in areas with no flood warning system, sparse in situ observations (radars, gauge stations, etc) or no regional atmospheric model.

8

Initial State Voisin et al. (2010, in review) Today 9

1.

What is the forecast skill of the system?

2.

What are the resulting hydrologic forecast errors related to errors in the calibrated and downscaled weather forecasts?

3.

Is the forecast skill different for basins of different size?

10

Analog method vs interpolation:

- maintained resolution & discrimination - slightly lower predictability - BUT largely improved reliability - smaller mean error - more realistic precipitation patterns 11

Simulated Temp, Wind Satellite Precip Ensemble weather forecast

… 51 members

Calibration of weather forecasts (OPTIONAL)

…

(Semi-)distributed/lumped hydrological model

…

Ensemble flow forecast Experiment 1 : WITHOUT calibration of weather forecasts Experiment 2 : WITH calibration of weather forecasts Experiment 3 : 0 precip forecasts

→ Use “simulated observed flow” as reference (ECMWF Analysis and TMPA precipitation) → Focus on weather forecasts errors

- No flow observation uncertainties - No hydrology model and routing model ( structure, parameter estimation) uncertainties 13

-

Which forecasts?

Spatially distributed ensemble runoff forecasts Ensemble flow forecasts at 4 locations

Verification:

Deterministic Forecast Skill Measures:

Bias ( accuracy, mean errors) RMSE (accuracy) Correlation (accuracy, predictability) -

Probabilistic Forecasts Skill Measures:

Continuous Rank Probability Skill Score (accuracy, reliability, resolution, predictability) Rank Histograms ( ensemble spread i.e. probabilistic forecast reliability)

For forecast categories

: What can I expect when a forecast falls in a certain forecast category? ( oriented for real-time decision ) 14

Ohio River Basin 2003-2007 1826 15-day forecasts (10 day fcst, +5 days 0-precip) 848 0.25

o grid cells 15

16

Ensemble reliability at Metropolis and Elizabeth

17

A preliminary probabilistic quantitative hydrologic forecast system for global application was developed and evaluated: 1.

Skill for 10 days for spatially distributed runoff 2.

Skill for 1-12+ day forecasts depending on concentration times at the flow forecast locations

 For small basins : skills for 10 days, with good reliability for short lead times  For larger basins: for 10 days + concentration time

3.

Ensemble weather forecasts need to be calibrated:



for better hydrologic probabilistic forecasts ( reliability )



For better forecast accuracy in sub basins locations 4.

Will incorporate PUB and HEPEX results and ideas.

( PUB: Predictions in Ungauged Basins HEPEX: Hydrologic Ensemble Prediction Experiment)

18

19

→ Use “simulated observed flow” as reference → Focus on weather forecasts errors

-Differences between TMPA and observed precipitation -Daily flow fluctuations due to navigation, flood control, hydropower generation -Uncertainties in VIC and routing models physical processes, structure and parameters 20

Relative Operating characteristic (ROC) Plot Hit Rate vs. False Alarm Rate for a set of increasing probability threshold to make the yes/no decision. Diagonal = no skill Skill if above the 1:1 line Measure resolution A bias forecast may still have good discrimination. 21

Ensemble reliability:  Reliability plot: PROBABILISTIC fcsts  Choose an event = event specific  Each time the event was forecasted with a specific probability ( 20%, 40%, etc), how many times did it happen ( observation >= chosen event). It requires a sharpness diagram to give the confidence in each point. It should be on a 1:1 line.

  Talagrand diagram (rank): PROBABILISTIC QUANTITAVE fcsts  Give a rank to the observation with respect to the ensemble forecast ( 0 if obs below all ensemble members, Nmember + 1 if obs larger )  Is uniform if ensemble spread is reliable, (inverse) U-shaped if ensemble is too small (large), asymetric is systematic bias.

22

  Probabilistic quantitative forecast verification measures the difference between the predicted and observed cumulative distribution functions: 1 resolution, reliability, predictability d Nmember ∆P N 2 1  d 3 d 2 d 1 magnitude 23



Seasonal flow forecasting using ESP

Initial conditions: -Observed : SWE -Simulated : soil moisture ESP ( Extended Streamflow Prediction) Previous year meteorological info

… # of years members

Semi distributed Hydrology Model VIC One basin at the time

…

Ensemble of flow forecasts

…

Processing of the probabilities 24

University of Washington – West Wide Seasonal Flow Forecast System CEE , Land Surface Hydrology Group