Date post: | 31-Mar-2015 |
Category: |
Documents |
Upload: | dante-dymond |
View: | 232 times |
Download: | 3 times |
Christopher Dougherty
EC220 - Introduction to econometrics (chapter 12)Slideshow: consequences of autocorrelation
Original citation:
Dougherty, C. (2012) EC220 - Introduction to econometrics (chapter 12). [Teaching Resource]
© 2012 The Author
This version available at: http://learningresources.lse.ac.uk/138/
Available in LSE Learning Resources Online: May 2012
This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 License. This license allows the user to remix, tweak, and build upon the work even for commercial purposes, as long as the user credits the author and licenses their new creations under the identical terms. http://creativecommons.org/licenses/by-sa/3.0/
http://learningresources.lse.ac.uk/
CONSEQUENCES OF AUTOCORRELATION
1
The consequences of autocorrelation for OLS are similar to those of heteroscedasticity. In general, the regression coefficients remain unbiased, but OLS is inefficient because one can find an alternative regression technique that yields estimators with smaller variances.
ttt uXY 21
T
tttuab
122
T
ss
tt
XX
XXa
1
2
CONSEQUENCES OF AUTOCORRELATION
2
The other main consequence is that autocorrelation causes the standard errors to be estimated wrongly, often being biased downwards. Finally, although in general OLS estimates are unbiased, there is an important special case where they are biased.
ttt uXY 21
T
tttuab
122
T
ss
tt
XX
XXa
1
2
CONSEQUENCES OF AUTOCORRELATION
3
Unbiasedness is easily demonstrated, provided that Assumption C.7 is satisfied. In the case of the simple regression model shown, we have seen that the OLS estimator of the slope coefficient can be decomposed as the second line where the at are as defined in the third line.
ttt uXY 21
T
tttuab
122
T
ss
tt
XX
XXa
1
2
CONSEQUENCES OF AUTOCORRELATION
4
Now, if Assumption C.7 is satisfied, at and ut are distributed independently and we can write the expectation of b2 as shown. At no point have we made any assumption concerning whether ut is, or is not, subject to autocorrelation.
ttt uXY 21
T
tttuab
122
T
ss
tt
XX
XXa
1
2
T
ttt
T
ttt
T
ttt uEaEuaEuaEbE
12
12
122
CONSEQUENCES OF AUTOCORRELATION
5
All that we now require is E(ut) = 0 and this is easily demonstrated.
ttt uXY 21
T
tttuab
122
T
ss
tt
XX
XXa
1
2
T
ttt
T
ttt
T
ttt uEaEuaEuaEbE
12
12
122
CONSEQUENCES OF AUTOCORRELATION
6
For example, in the case of AR(1) autocorrelation, lagging the process one time period, we have the second line. Substituting for ut–1 in the first equation, we obtain the third.
121 ttt uu
ttt uu 1
tttt uu 122
CONSEQUENCES OF AUTOCORRELATION
7
Continuing to lag and substitute, we can express ut in terms of current and lagged values of t with diminishing weights. Since, by definition, the expected value of each innovation is zero, the expected value of ut is zero.
121 ttt uu
tttt uu 122
...22
1 ttttu
0...22
1 tttt EEEuE
ttt uu 1
CONSEQUENCES OF AUTOCORRELATION
8
For higher order AR autocorrelation, the demonstration is essentially similar. For moving average autocorrelation, the result is immediate.
3322110 tttttu
03322110 ttttt EEEEuE
CONSEQUENCES OF AUTOCORRELATION
9
For multiple regression analysis, the demonstration is the same, except that at is replaced by at*,
where at* depends on all of the observations on all of the explanatory variables in the model.
ttt uXY 21
T
tttuab
122
T
ss
tt
XX
XXa
1
2
T
ttt
T
ttt
T
ttt uEaEuaEuaEbE
12
12
122
CONSEQUENCES OF AUTOCORRELATION
10
We will not pursue analytically the other consequences of autocorrelation. Suffice to mention that the proof of the Gauss–Markov theorem, which guarantees the efficiency of the OLS estimators, does require no autocorrelation, as do the expressions for the standard errors.
ttt uXY 21
T
tttuab
122
T
ss
tt
XX
XXa
1
2
T
ttt
T
ttt
T
ttt uEaEuaEuaEbE
12
12
122
CONSEQUENCES OF AUTOCORRELATION
11
Now we come to the special case where OLS yields inconsistent estimators if the disturbance term is subject to autocorrelation.
tttt uYXY 1321
ttt uu 1
CONSEQUENCES OF AUTOCORRELATION
12
If the model specification includes a lagged dependent variable, OLS estimators are biased and inconsistent if the disturbance term is subject to autocorrelation. This will be demonstrated for AR(1) autocorrelation and an ADL(1,0) model with one X variable.
tttt uYXY 1321
ttt uu 1
CONSEQUENCES OF AUTOCORRELATION
13
Lagging the ADL(1,0) model by one time period, we obtain the third line. Thus Yt–1 depends on ut–1. As a consequence of the AR(1) autocorrelation ut also depends on ut–1.
tttt uYXY 1321
ttt uu 1
1231211 tttt uYXY
CONSEQUENCES OF AUTOCORRELATION
14
Hence we have a violation of part (1) of Assumption C.7. The explanatory variables, Yt–1, is not distributed independently of the disturbance term. As a consequence, OLS will yield inconsistent estimates.
tttt uYXY 1321
ttt uu 1
1231211 tttt uYXY
CONSEQUENCES OF AUTOCORRELATION
15
This was described as a special case, but actually it is an important one. ADL models are frequently used in time series regressions and autocorrelation is a common problem.
tttt uYXY 1321
ttt uu 1
1231211 tttt uYXY
Copyright Christopher Dougherty 2011.
These slideshows may be downloaded by anyone, anywhere for personal use.
Subject to respect for copyright and, where appropriate, attribution, they may be
used as a resource for teaching an econometrics course. There is no need to
refer to the author.
The content of this slideshow comes from Section 12.1 of C. Dougherty,
Introduction to Econometrics, fourth edition 2011, Oxford University Press.
Additional (free) resources for both students and instructors may be
downloaded from the OUP Online Resource Centre
http://www.oup.com/uk/orc/bin/9780199567089/.
Individuals studying econometrics on their own and who feel that they might
benefit from participation in a formal course should consider the London School
of Economics summer school course
EC212 Introduction to Econometrics
http://www2.lse.ac.uk/study/summerSchools/summerSchool/Home.aspx
or the University of London International Programmes distance learning course
20 Elements of Econometrics
www.londoninternational.ac.uk/lse.
11.07.25