Section 4: Extreme Value Analysis - An Introduction
Section 4: Extreme Value Analysis - An Introduction
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
Motivation
Society is risk-averse !
Storm Kyrill, Northern Europe Jan. 2007
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
Outline
Theoretical Background
Additional Remarks
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
Theoretical Background
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
The rainfall that occurred on August 21, 1954 (X=89.6 mm) has a return
period of T=15 years. <=> Such an event (or larger) is expected on average
every 15 years.
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
200
180
2004
2005
T=?
T=105
T=104
T=53
T=52
T=35
T=35
T=27
160
140
120
100
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
Purpose
Procedure
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
Distribution of Maxima
X k ~ F(x) iid
The Maximum
M n ~ F n (x)
Because:
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
10
Illustration
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
11
" x ! bn %
F $
**
( G ( x)
' *n()
a
# n &
n
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
12
Maurice Ren
Frchet
1878-1973
x < 0, ! > 0
x"0
Ernst Hjalmar
Waloddi Weibull
1887-1979
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
13
The mean of a large number of iid random variables is distributed like the
Normal Distribution independently of the parent distribution.
The maximum of a large number of iid random variables is distributed like the
Gumbel or Frchet or Weibull Distributions independently of the parent
distribution ( if there is convergence at all).
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
14
Convergence?
In theory
In practice
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
15
Sketch of Proof
Max - Stability
" x ! bk %
Gk ( x) = G $
', k = 1, 2, 3, ...
# ak &
X1,2 ! X1,n
#n!"
##
!
X 2,1
X1,2 ! X 2,n
#n!"
##
! M (n),2 $ G
"
X k,1
"
! X k,n
X k,2
M (n),1 $ G
!
#n!"
##
! M (n),k $ G
n!"
M (n!k ) " G
M (n!k ) " G k
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
16
Sketch of Proof
)
))
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
17
A combined parametrisation of
all three limit distributions
Three parameters:
Location (), Scale (),
Shape ()
=0; =1
= 0: Gumbel, unbounded
> 0: Frchet, lower bound
< 0: Weibull, upper bound
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
18
The GEV
Wind gusts,
Precipitation,
Stock market changes,
etc.
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
19
Boris V. Gnedenko
1912-1995
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
20
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
22
23
Procedure
Build Blocks
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
24
estimated CDF
F ( x ) = GEV ( x; , ! , " )
Y ( x ) = ! log ! log ( F ( x ))
Gumbel Variate
rank = 108
111
T!k =
= 37a
3
Block Maxima
xk
k = 1,.., N
T!k =
N +1
N +1! rank(xk )
plotting points of
block maxima xk
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
25
Return value:
10-year return
value: 82 mm
Return period:
Amounts fallen on
2005.08.22 have a
return period of 46
years.
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
26
Parameter Estimation
L-Moments Estimation
Set , , so that the first 3 sample L-Moments are equal to the
27
Max-Likelihood
= 53.5 mm
= 12.5 mm
= 0.038
x(T=200) = 127 mm
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
28
Assumptions
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
29
QQ-plot
30
Uncertainty?
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
31
T(Lothar) = 16 a
Yearly maximum
wind gusts in
Zurich 1981-1999
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
32
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
33
Parametric Resampling
Confidence Intervals
X100: 145 - 250 km/h
Large sampling
uncertainty.
Uncertainty of X(T)
increases with T.
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
34
Confidence Intervals
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
35
Confidence Intervals
90% ML confidence
symmetric
asymmetric
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
36
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
37
Confidence Intervals
Likelihood-Profile Confidence
Pros:
Cons:
Coles 2001
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
39
Vivian,
Feb 1990
Likelihood-Profile
ML (Delta Method)
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
40
A trade-off between biases (too small block size) and large sampling
errors (large blocks, small number of blocks).
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
41
GEV does not make sense for seasonal means (e.g. summer 2003).
Not a Maximum of a large block!
In a network with many stations you will find events with very large
local return periods every now and then. Citing those results only
is misleading. (Dont fall for sensation journalism!)
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
42
MeteoSwiss 2006
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
43
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
45
Note: Hydrologists tend to call this the method of Partial Duration Series
46
Distribution of Exceedances
X k ~ F(x) iid
Eu ( y ) =
F ( x = u + y ) ! F ( x = u)
1! F ( x = u)
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
47
Clarification
prob ( X > u + y X > u) = 1! Eu ( y)
prob ( X > u + y X > u) =
" Eu ( y ) =
1! F ( x = u + y)
1! F(x = u)
F ( x = u + y ) ! F ( x = u)
1! F ( x = u)
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
48
for n " #
for u " #
$1 "
%
y(
GPD ( y;!! , " ) = 1$ '1+ ! *
&
!! )
49
"
y%
GPD ( y;! , " ) = 1! $1+ ! '
#
"&
y ( 0, 1+ ! y " ( 0
=1
Two parameters:
Scale (), Shape ()
= 0: Exponential Distribution
< 0: upper bound at /
> 0: no upper bound
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
50
Procedure
Select a threshold u
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
51
Parameter Estimation
Confidence Intervals
Resampling
Asymptotic ML confidence intervals (Delta Method)
Likelihood profile
52
640 independent
exceedances
Threshold:
30 mm
Max-Likelihood
= 11.3 mm
= 0.07
x(T=200) = 133 mm
Axis in log(T):
Exponential Distribution
( = 0) is a straight line.
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
53
Assumptions
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
54
Threshold Selection
GPD(y, ! v , " v ) =
GPD((v ! u) + y, ! u , " u )
GPD((v ! u), ! u , " u )
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
55
Threshold Selection
Diagnostics for
threshold selection
approx. stable
within limits
approx. stable
within limits
Engelberg,
daily precipitation (mm)
1901-2010
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Be aware:
Stability within
confidence limits
does not warrant
true stability.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
56
Threshold Selection
Mean Residual Life Plot:
linear
within limits
E (Yu ) =
!u !" "u
1+ "
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
57
X(100)
152 mm
Peak-over-Threshold:
GPD, 640 peaks > 30 mm
X(100)
138 mm
127 mm
101 mm
120 mm
105 mm
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
58
Peak-over-Threshold Approach
Pros
Pros
Cons
Cons
Independence assumption is
critical in practice. Need
declustering techniques.
Needs diagnostics for threshold
selection. Choice somewhat
ambiguous in practice.
Less easy to apply in practice.
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
59
Additional Remarks
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
60
Additional Remarks
Precipitation Extremes
61
Additional Remarks
Hydrological Extremes
Liechti, 2008
Analysis of Climate and Weather Data | Extreme Value Analysis An Introduction | HS 2015 | christoph.frei [at] meteoswiss.ch
62
Additional Remarks
Spatial Extremes
63