of 39
7/25/2019 Hypothesis Tests and Confident (1)
1/39
Hypothesis Tests andConfdence Intervals in
Multiple Regressors
1
7/25/2019 Hypothesis Tests and Confident (1)
2/39
Outline
Hypothesis Testing
Joint Hypotheses
Single Restriction Test
Test Score Data
2
7/25/2019 Hypothesis Tests and Confident (1)
3/39
Hypothesis Tests and ConfdenceIntervals or a Single Coe!icient
is appro"i#ately distri$uted %&'( 1)*&C+T)
Thus hypotheses on can $e tested using the
usual t,statistic( and confdence intervals areconstructed as
So too or
and are generally not independently
distri$uted , so neither are their t,statistics ore on this
later)*
-
7/25/2019 Hypothesis Tests and Confident (1)
4/39
."a#ple/ The Caliornia class si0edata
The coe!icient on STR in &2) is the e!ect on Test Scoreo a unit change in STR( holding constant thepercentage o .nglish +earners in the district*
Coe!icient on STR alls $y one,hal*
3 confdence interval or coe!icient on STR in &2) is451*1' 6 1*7 '*8-9 : &5 1*( 5 '*27)
The t,statistic or STR : 5 1*1';'*8- : 5 2*8( so
7/25/2019 Hypothesis Tests and Confident (1)
5/39
Tests o Joint Hypotheses
+et ."pn : e"penditures per pupil and consider thepopulation regression #odel
The null hypothesis that >school resources don?t#atter(@ and the alternative that they do(corresponds to
7/25/2019 Hypothesis Tests and Confident (1)
6/39
Ajoint hypothesis specifes a value or two ormore coe!icients( that is( it i#poses a restriction ontco##on sense@ test is to re=ect i either o theindividual t,statistics e"ceeds 1*7 in a$solute value*
But this >co##on sense@ approach doesn?t
7/25/2019 Hypothesis Tests and Confident (1)
7/39
Here?s co##on sense@ test$ased on the tco##on sense@ test is re=ect it1E1*7 and;or t2 E 1*7* Fhat is the pro$a$ility
that this >co##on sense@ test re=ects H'
7/25/2019 Hypothesis Tests and Confident (1)
8/39
ro$a$ility o incorrectly re=ecting the null
7/25/2019 Hypothesis Tests and Confident (1)
9/39
7/25/2019 Hypothesis Tests and Confident (1)
10/39
The sizeo a test is the actual re=ection rate under thenull hypothesis*
The si0e o the >co##on sense@ test isn?t 3*
Its si0e actually depends on the correlation $et
7/25/2019 Hypothesis Tests and Confident (1)
11/39
The N,statistic
The N,statistic tests all parts o a =oint hypothesis atonce*
Nor#ula or the special case o the =oint hypothesisand
in a regression
7/25/2019 Hypothesis Tests and Confident (1)
12/39
The N,statistic testing and
The N,statistic is large
7/25/2019 Hypothesis Tests and Confident (1)
13/39
+arge,sa#ple distri$ution o the N,statistic
Consider a special case that t1 and t2 are independent(so * In large sa#ples the or#ula $eco#es
Knder the null( t1 and t2 have standard nor#aldistri$utions that( in this special case( areindependent*
The large,sa#ple distri$ution o the N,statistic is thedistri$ution o the average o t
7/25/2019 Hypothesis Tests and Confident (1)
14/39
The chi,suared distri$ution
7/25/2019 Hypothesis Tests and Confident (1)
15/39
Co#pute p,value using the N,statistic/
p,value : tail pro$a$ility o the distri$ution$eyond the N,statistic actually co#puted*
Implementation in STATAKse the >test@ co##and ater the regression*
."a#ple/ Test the =oint hypothesis that thepopulation coe!icients on STR and e"penditures
per pupil &e"pnPstu) are $oth 0ero( against thealternative that at least one o the populationcoe!icients is non0ero*
1
7/25/2019 Hypothesis Tests and Confident (1)
16/39
17
7/25/2019 Hypothesis Tests and Confident (1)
17/39
The ho#osedasticity,only N,statistic
To co#pute the ho#osedasticity,only N,statistic
Kse the previous or#ulas( $ut usingho#osedasticity,only standard errors* Or
Run trestricted@ regression) and oneunder the alternative hypothesis &the>unrestricted@ regression)*
The second #ethod gives a si#ple or#ula*
1
7/25/2019 Hypothesis Tests and Confident (1)
18/39
The >restricted@ and >unrestricted@regressions
."a#ple/ are the coe!icients on STR and ."pn 0eroG
Restricted population regression &that is( under H')/
Knrestricted population regression &under H1)/
The nu#$er o restrictions under H': : 2* The ft
7/25/2019 Hypothesis Tests and Confident (1)
19/39
By ho< #uch #ust the R2increase or the coe!icients on."pn and ct .+ to $e =udged statistically signifcantG
Si#ple or#ula or the ho#osedasticity,only N,statistic
7/25/2019 Hypothesis Tests and Confident (1)
20/39
."a#ple/
Restricted regression/
Knrestricted regression/
2'
7/25/2019 Hypothesis Tests and Confident (1)
21/39
21
7/25/2019 Hypothesis Tests and Confident (1)
22/39
The ho#osedasticity,only N,statistic,su##ary
The ho#osedasticity,only N,statistic re=ects
7/25/2019 Hypothesis Tests and Confident (1)
23/39
23
Joint confdence sets ctd.
7/25/2019 Hypothesis Tests and Confident (1)
24/39
24
Confdence set based oninverting the F-statistic
7/25/2019 Hypothesis Tests and Confident (1)
25/39
Su##ary/ testing =oint hypotheses
The >co##on,sense@ approach o re=ecting i eithero the t,statistics e"ceeds 1*7 re=ects #ore than3 o the ti#e under the null &the si0e e"ceeds thedesired signifcance level)*
The heterosedasticity,ro$ust N,statistic is $uilt into STATA &>test@ co##and)* This tests all restrictions at once*
Nor large n( N is distri$uted as *
The ho#osedasticity,only N,statistic is i#portanthistorically &and thus in practice)( and is intuitivelyappealing( $ut invalid
7/25/2019 Hypothesis Tests and Confident (1)
26/39
Testing Single Restrictions on MultipleCoe!icients
Consider the null and alternative hypothesis(
This null i#poses a single restriction & : 1) on#ultiple coe!icients , it is not a =oint hypothesis
7/25/2019 Hypothesis Tests and Confident (1)
27/39
T
7/25/2019 Hypothesis Tests and Confident (1)
28/39
Method 1/ Rearrange &@transor#@) the regression*
Add and su$tract
7/25/2019 Hypothesis Tests and Confident (1)
29/39
&a) Original syste#/
&$) Rearranged &@transor#ed@) syste#/
so
The testing pro$le# is no< a si#ple one/ test
7/25/2019 Hypothesis Tests and Confident (1)
30/39
Method 2/ eror# the test directly
."a#ple/
To test( using STATA(
7/25/2019 Hypothesis Tests and Confident (1)
31/39
Analysis o the Test Score Data
A general approach to varia%le selection and!model specifcation"
Speciy a >$ase@ or >$ench#ar@ #odel*
Speciy a range o plausi$le alternative #odels(
7/25/2019 Hypothesis Tests and Confident (1)
32/39
Is a candidate varia$le statistically signifcantG
Kse =udg#ent( not a #echanical recipe*
And don&t just ma'imize R(.
-2
7/25/2019 Hypothesis Tests and Confident (1)
33/39
33
Digression about measures oft
7/25/2019 Hypothesis Tests and Confident (1)
34/39
aria$les
7/25/2019 Hypothesis Tests and Confident (1)
35/39
aria$les actually in the Caliorniaclass si0e
data set student,teacher ratio &STR) percent .nglish learners in the district &ct.+)
percent eligi$le or su$sidi0ed;ree lunch
percent on pu$lic inco#e assistance average district inco#e
-
7/25/2019 Hypothesis Tests and Confident (1)
36/39
A loo at #ore o the Caliornia data
-7
7/25/2019 Hypothesis Tests and Confident (1)
37/39
Digression/ presentation o regressionresults in a ta$le
+isting regressions in >euation@ or# can $e cu#$erso#e
7/25/2019 Hypothesis Tests and Confident (1)
38/39
-
7/25/2019 Hypothesis Tests and Confident (1)
39/39
Su##ary/ Multiple Regression
Multiple regression allo