Christopher Dougherty EC220 - Introduction to econometrics (chapter 11) Slideshow: limiting distribution of OLS estimator in univariate process Original citation: Dougherty, C.
Download ReportTranscript Christopher Dougherty EC220 - Introduction to econometrics (chapter 11) Slideshow: limiting distribution of OLS estimator in univariate process Original citation: Dougherty, C.
Christopher Dougherty
EC220 - Introduction to econometrics (chapter 11)
Slideshow: limiting distribution of OLS estimator in univariate process Original citation:
Dougherty, C. (2012) EC220 - Introduction to econometrics (chapter 11). [Teaching Resource] © 2012 The Author This version available at: http://learningresources.lse.ac.uk/137/ Available in LSE Learning Resources Online: May 2012 This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 License. This license allows the user to remix, tweak, and build upon the work even for commercial purposes, as long as the user credits the author and licenses their new creations under the identical terms. http://creativecommons.org/licenses/by-sa/3.0/
http://learningresources.lse.ac.uk/
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
In this slideshow we will explore the limiting distribution of the OLS estimator of the (slope) parameter of a univariate time series with one lag.
1
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
This time series is the simplest possible example of an ADL(1,0) model. We will study it because the asymptotic properties of the OLS estimator of the slope coefficient are easy to establish. The issues that we will encounter arise in all models with lagged dependent variables.
2
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
We shall assume throughout that │
2 │<1, which means that the process is stationary. The meaning of stationarity will be explained in Chapter 13, together with the consequences of the violation of this condition. We shall in practice assume
2 is positive and so 0 <
2 < 1.
3
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
In the previous slideshow we explored the properties of the estimator graphically with a simulation. Now we shall be more analytical.
4
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
We shall assume throughout that u
t
is iid with zero mean and finite variance. u
s
determinant of the explanatory variable Y
t
–1 is a in observations s+1 to T and so the second part of Assumption C.7 is violated.
5
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
We cannot obtain a closed-form expression for the expectation of b 2 and we have seen, through simulation, that in practice it will be biased for finite samples.
6
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
Despite the finite-sample bias, the simulation indicated that the estimator is consistent. We will now demonstrate this analytically.
7
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
t T
1
Y t
1
u t t T
1
Y t
2
1
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
In the third line, the plim of the error term is the plim of a ratio. The next step is to use the rule plim(A/B) = plim A / plim B, To use this rule, we must first show that both plim A and plim B exist, and that plim B is not zero.
8
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t Y t
1
2
Y t
2
u t
1 We will begin by demonstrating that, apart from transitory initial effects, E(Y
t
) = 0 and hence plim Y = 0. Since the model is true for time t, it is also true for time t –1.
9
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t Y t
1
2
Y t
2
u t
1
Y t
2 2
Y t
2
2
u t
1
u t
Substitute for Y
t
–1 in the first equation.
10
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t Y t
1
2
Y t
2
u t
1
Y t
2 2
Y t
2
2
u t
1
u t Y t
t
2
Y
0
t
2
1
u
1
...
2
u t
1
u t
Lagging and substituting in this way t times, we express Y
t
and the values of the disturbance term.
in terms of the initial value Y 0
11
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t Y t
1
2
Y t
2
u t
1
Y t
2 2
Y t
2
2
u t
1
u t Y t
t
2
Y
0
t
2
1
u
1
...
2
u t
1
u t E
t
t
2
Y
0
0 When we take expectations, the expectations of all of the values of the disturbance term are zero. The remaining term tends to zero in the limit because
2
t
tends to zero if │
2 │<1.
12
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t Y t
1
2
Y t
2
u t
1
Y t
2 2
Y t
2
2
u t
1
u t Y t
t
2
Y
0
t
2
1
u
1
...
2
u t
1
u t E
t
t
2
Y
0
0 plim
Y
E
0 Now we can invoke the Weak Law of Large Numbers to say that the plim of the sample mean of Y is equal to the population mean, which is zero in the limit.
13
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t Y t
1
2
Y t
2
u t
1
Y t
2 2
Y t
2
2
u t
1
u t Y t
t
2
Y
0
t
2
1
u
1
...
2
u t
1
u t E
t
t
2
Y
0
0 plim
Y
E
plim
u
E
0
0 We can invoke the same law to state immediately that the plim of the sample mean of u is zero.
14
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES plim
Y
E Y t
2
Y t
1
u t
0 plim
u
E
0 plim 1
T t T
1
Y t
1
Y
2
var We can invoke the same law one more time to state that the plim of the sample mean square deviation of Y
t
–1 is the variance of Y.
15
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES plim
Y
E Y t
2
Y t
1
u t
0 plim
u
E
0 plim 1
T t T
1
Y t
1
Y
2
var (Small completely unimportant technical point: Y here is understood to be the mean of Y
t
–1 . If Y 0 is known, the summation is as shown. If Y 0 is not known, the summation is from 2 to T. Since we are talking about the limit as T tends to infinity, this detail does not matter at all.)
16
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES plim
Y
E Y t
2
Y t
1
u t
0 plim
u
E
0 plim 1
T t T
1
Y t
1
Y
2
var plim 1
T t T
1
Y t
1
Y
u t
u
cov
Y t
1 ,
u t
Finally, we can establish the last line by means of a continuous mapping theorem. Of course, for each of these results various conditions have to be satisfied. For the present model there is no problem, given that we are assuming that u is iid and │
2 │<1.
17
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES plim
Y
E Y t
2
Y t
1
u t
0 plim
u
E
0 plim 1
T t T
1
Y t
1
Y
2
var 1
T t T
1
Y t
1
Y
2
1
T t T
1
Y t
2
1
Y
2 plim 1
T t T
1
Y t
2
1
plim 1
T t T
1
Y t
1
Y
2
plim
Y
2
var Now, making use of the identity shown and taking plims, we have one result that we need.
18
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES plim
Y
E Y t
2
Y t
1
u t
0 plim
u
E
0 plim 1
T t T
1
Y t
1
Y
u t
u
cov
Y
,
u
T
1
t T
1
Y t
1
Y
u t
u
1
T t T
1
Y t
1
u t
Y u
plim 1
T t T
1
Y t
1
u t
plim 1
T t T
1 cov
Y t
1 ,
u t
Y t
1
Y
u t
u
plim
Y
plim
u
Similarly, making use of another identity and taking plims, we obtain a second result.
19
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
2
cov
Y t
var
1
Y t
,
1
u t
2 With this preparatory work in place, we are able to omplete the proof of consistency. We have shown that both the numerator and the denominator of the error term have limits.
20
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t b
2
t T
1
Y t
1
Y t t T
1
Y t
2
1
2
t T
1
Y t
1
u t t T
1
Y t
2
1 plim
b
2
2
plim
1
T
1
T t T
1
Y t
1
u t t T
1
Y t
2
1
2
cov
Y t
var
1
Y t
,
1
u t
2 The variance of Y
t
–1 because Y
t
–1 will be positive since the variance of u is positive. cov(Y
t
–1 , u
t
) = 0 is independent of u
t
. Hence b 2 is a consistent estimator of
2 .
21
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t
Standard theory tells us that b 2 is asymptotically normally distributed. What does this mean? We have just shown that, as the sample size increases, the distribution degenerates to a spike at
2 , so how can we say that b 2 has an asymptotically normal distribution?
22
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t
We encountered this problem when determining the asymptotic properties of IV estimators in Chapter 8. To deal with it, we again use the technique involving the use of a central limit theorem discussed in Section R.15.
23
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t T
b
2
2
d N
0 , 1
2 2
As a first step, we multiply the estimator by √T. This is sufficient to prevent the variance from tending to zero as T increases. However, ( √T)b 2 either, because b 2 tends to
2 and (√T)b 2 does not have a limiting distribution, increases without limit with T.
24
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t T
b
2
2
d N
0 , 1
2 2
So, instead, we consider (√T)(b 2 provided that │
2 │< 1, –
2 ) . For the model under discussion, it can be shown that the conditions for the application of a central limit theorem are satisfied and that the limiting distribution is normal with zero mean and variance (1 –
2 2 ).
,
25
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t T
b
2
2
d N
0 , 1
2 2
This asymptotic result is all that we have in analytical terms. We are not entitled to say anything analytically for finite samples. However, given the limiting distribution, we can start working back tentatively to finite samples and make some plausible assertions.
26
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t T
b
2
2
d N
0 , 1
2 2
b
2
2
~
N
0 , 1
2 2
T
We can say, that for large T, the relationship may hold approximately. If this is the case, dividing the statistic by √T, we obtain the result shown, as an approximation, for sufficiently large samples.
27
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t T
b
2
2
d N
0 , 1
2 2
b
2
2
~
N
0 , 1
2 2
T
b
2 ~
N
2 , 1
2 2
T
Hence, adding
2 to the statistic, we can say, that b 2 approximation, for sufficiently large samples. is distributed as shown, as an
28
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
Y t
2
Y t
1
u t T
b
2
2
d N
0 , 1
2 2
b
2
2
~
N
0 , 1
2 2
T
b
2 ~
N
2 , 1
2 2
T
Of course, there remains the question of what might be considered to be a ‘sufficiently large’ sample. To answer this question, we turn to simulation.
29
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
6
d N
0 , 1
0 .
6 2
0.5
0.4
0.3
0.2
0.1
0 0 -4 -3 T = 25 T = 50 T = 100 T = 200 -2 -1 1 limiting normal distribution T = 200 T = 100 T = 50 T = 25 2 3 Simulation reveals that the answer depends on the value of
2 = 0.6. The figure shows the distributions of √T(b 2
2 itself. We will start by putting – 0.6) for T = 25, 50, 100, and 200.
30
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
6
d N
0 , 1
0 .
6 2
0.5
0.4
0.3
0.2
0.1
0 0 -4 -3 T = 25 T = 50 T = 100 T = 200 -2 -1 1 limiting normal distribution T = 200 T = 100 T = 50 T = 25 2 3 For the simulation, the disturbance term was drawn randomly from a normal distribution with zero mean and unit variance.
31
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
6
d N
0 , 1
0 .
6 2
0.5
0.4
0.3
0.2
0.1
0 0 -4 -3 T = 25 T = 50 T = 100 T = 200 -2 -1 1 limiting normal distribution T = 200 T = 100 T = 50 T = 25 2 3 According to the theory, the distribution of ought to converge to a normal distribution with mean zero and variance . This limiting normal distribution is shown as the red curve in the figure.
32
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
6
d N
0 , 1
0 .
6 2
0.5
0.4
0.3
0.2
0.1
0 0 -4 -3 T = 25 T = 50 T = 100 T = 200 -2 -1 1 limiting normal distribution T = 200 T = 100 T = 50 T = 25 2 3 Although the overall shape of √T(b 2 – 0.6) is not far from normal, even for T as small as 25, there are serious discrepancies in the tails, and it is the shape of the tails that matters for inference.
33
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
6
d N
0 , 1
0 .
6 2
0.5
0.4
0.3
0.2
0.1
0 0 -4 -3 T = 25 T = 50 T = 100 T = 200 -2 -1 1 limiting normal distribution T = 200 T = 100 T = 50 T = 25 2 3 Even for T = 200, the left tail is far too fat and the right tail far too thin. This implies that we should not expect the N(
2 , (1 –
2 2 ) / T ) to be an accurate guide to the actual distribution of
b
2 .
34
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES 5 4 3 2 1 actual distribution,T = 100 0 0.2
0.3
0.4
0.5
b
2 ~
N
0 .
6 , 1
0 .
6 2 100
distribution derived from asymptotic analysis 0.6
0.7
0.8
0.9
This is confirmed by the figure shown. It compares the actual distribution of b 2 obtained by simulation, with the theoretical distribution (still with
2 = 0.6). for T = 100,
35
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES 5 4 3 2 1 actual distribution,T = 100 0 0.2
0.3
0.4
0.5
b
2 ~
N
0 .
6 , 1
0 .
6 2 100
distribution derived from asymptotic analysis 0.6
0.7
0.8
0.9
(Since is just a linearly scaled function of b 2 , the relationship between the actual distribution of b 2 and its theoretical distribution is parallel to that between for T = 100 and its limiting normal distribution in the previous figure.)
36
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
9
d N
0 , 1
0 .
9 2
T = 25 0.5
T = 25 T = 50 T = 100 T = 200 T = 200 T = 100 T = 50 limiting normal distribution -4 -3 -2 -1 0 0 1 2 The finite-sample bias is the stronger, the closer that distribution of √T(b 2 –
2 ) when
2
2 is to 1. The figure shows the = 0.9. In this case, it is clear that, even for T = 200, the distribution is far from normal.
37
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
9
d N
0 , 1
0 .
9 2
T = 25 0.5
T = 25 T = 50 T = 100 T = 200 T = 200 T = 100 T = 50 limiting normal distribution -4 -3 -2 -1 0 0 1 2 The left tail contracts towards the limiting distribution as the sample size increases, as it did for
2 = 0.6, but more slowly.
38
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
9
d N
0 , 1
0 .
9 2
T = 25 0.5
T = 25 T = 50 T = 100 T = 200 T = 200 T = 100 T = 50 limiting normal distribution -4 -3 -2 -1 0 0 1 2 The right tail actually shifts in the wrong direction as the sample size increases from T = 25 to T = 50. However, it then starts moving back in the direction of the limiting distribution, but there is still a large discrepancy even for T = 200.
39
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
9
d N
0 , 1
0 .
9 2
T = 25 0.5
T = 25 T = 50 T = 100 T = 200 T = 200 T = 100 T = 50 limiting normal distribution -4 -3 -2 -1 0 0 1 2 We have seen that, for finite samples, the tails of the distributions of √T(b 2 –
2 ) and b 2 differ markedly from their approximate theoretical distributions, even for T = 200, and this can be expected to cause problems for inference. This is indeed the case.
40
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
9
d N
0 , 1
0 .
9 2
T = 25 0.5
T = 25 T = 50 T = 100 T = 200 T = 200 T = 100 T = 50 limiting normal distribution -4 -3 -2 -1 0 0 1 2 We know that inference is asymptotically valid in a model with a lagged dependent variable. However, as always, we have to ask how large the sample should be in practice.
41
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
T
b
2
0 .
9
d N
0 , 1
0 .
9 2
T = 25 0.5
T = 25 T = 50 T = 100 T = 200 T = 200 T = 100 T = 50 limiting normal distribution -4 -3 -2 -1 0 0 1 We need to consider the effect on Type I error when the null hypothesis is true, and the effect on Type II error when the null hypothesis is false.
2
42
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 We will start with the effect on Type I error and we again will illustrate the issue with the simple autoregressive model. The figure shows the distribution of the t statistic for H 0 :
2 0.9 when the null hypothesis is true, and T = 100.
=
43
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 The distribution is skewed, reflecting the fact that the distribution of b 2 is skewed. Further complexity is attributable to the fact that the standard error is also valid only asymptotically.
44
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
Nominal critical value of t, T = 100, is 1.98 at 5% level Actual 2.5% tails start at –2.14 and 1.72
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 According to the tables, for a 5 percent two-sided test, with T = 100, the critical values of t are 1.98. However, in reality the lower 2.5 percent tail of the distribution starts at –2.14 and the upper one at 1.72.
45
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
Nominal critical value of t, T = 100, is 1.98 at 5% level p( t < –1.98 ) = 0.036
p( t > 1.98 ) = 0.013
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 This means that, if one uses the critical values from the table, the risk of a Type I error when the null hypothesis is true is greater than 2.5 percent when b 2 is negative and less than 2.5 percent when it is positive. The figures are 3.6 percent and 1.3 percent.
46
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 The potential effect on Type II error is often of greater practical importance, for typically our null hypothesis is that
2 = 0 and if the process is truly autoregressive, the null hypothesis is false.
47
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 Fortunately, for this null hypothesis, the t test is unlikely to mislead us seriously. If the true value of
2 is low, the distorting effect of the failure of Assumption C.7 part (2) can be expected to be minor and our conclusions valid, even for finite samples.
48
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 If the true value of
2 is large, H 0 is likely to be rejected anyway, even though the t statistic does not have its conventional distribution and the nominal critical values of t are incorrect.
49
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
true t distribution -4 -3 -2 -1 0 0 1 2 3 These remarks apply to the pure autoregressive model Y
t
=
2
Y t
–1 + u
t
. In practice, the model will include other explanatory variables, with unpredictable consequences.
4
50
LIMITING DISTRIBUTION OF OLS ESTIMATOR FOR A UNIVARIATE TIME SERIES
H
0 :
2 = 0.9 is true distribution of the t statistic, T = 100 0.4
0.3
0.2
0.1
true t distribution -4 -3 -2 -1 0 0 1 2 3 4 The most that one can say is that, if there is a lagged dependent variable in the model, one should expect point estimates, standard errors, and t statistics to be subject to distortion and therefore one should treat them with caution, especially when the sample is small and when there is evidence that
2 is large.
51
Copyright Christopher Dougherty 2011.
These slideshows may be downloaded by anyone, anywhere for personal use.
Subject to respect for copyright and, where appropriate, attribution, they may be used as a resource for teaching an econometrics course. There is no need to refer to the author.
The content of this slideshow comes from Section 11.5 of C. Dougherty, Introduction to Econometrics, fourth edition 2011, Oxford University Press.
Additional (free) resources for both students and instructors may be downloaded from the OUP Online Resource Centre http://www.oup.com/uk/orc/bin/9780199567089/ .
Individuals studying econometrics on their own and who feel that they might benefit from participation in a formal course should consider the London School of Economics summer school course EC212 Introduction to Econometrics http://www2.lse.ac.uk/study/summerSchools/summerSchool/Home.aspx
or the University of London International Programmes distance learning course 20 Elements of Econometrics www.londoninternational.ac.uk/lse .
11.07.25