APPLIED DATA ANALYSIS IN CRIMINAL JUSTICE

CJ 525 MONMOUTH UNIVERSITY

Juan P. Rodriguez

Perspective Research Techniques Accessing, Examining and Saving Data Univariate Analysis – Descriptive Statistics Constructing (Manipulating) Variables Association – Bivariate Analysis Association – Multivariate Analysis Comparing Group Means – Bivariate Multivariate Analysis - Regression

Lecture 7

Multivariate AnalysisWith Linear Regression

Lectures 5 and 6 examined methods for testing relationships between 2 variables: bivariate analysis

Many projects, however, require testing the association of multiple independent variables with a dependent variable: multivariate analysis

Multivariate analysis is performed after the researchers understand the characteristics of individual variables (univariate) and the relationships between any 2 variables (bivariate)

Reasons for Multivariate Analysis

Social behavior is usually associated with many factors and can not be explained by the association with just one variable. By including more than one variable in the statistical model, the researcher can create a more accurate model to predict or explain social behavior

Reasons for Multivariate Analysis

Multivariate analysis can account for the influence of spurious factors by introducing control variables

Linear Regression

Used when the increase in an independent variable is associated with a consistent and constant change in the dependent variable.

The dependent variable should be numeric and conform to a normal distribution

LR: Bivariate Example Using the States data, we will study the

relationship between poverty and teen births.

LR: A Bivariate example

The graph indicates that teenage births seem to increase with poverty rate.

Using Linear Regression, we will create an equation that can be used to illustrate this tendency Load the States dataset

LR: A Bivariate example

LR: A Bivariate example

LR: A Bivariate example

LR: A Bivariate example

The R2 measures the usefulness of the model: A value of 1 indicates that 100% of the variation in the

dependent variable is explained by variations in the independent variable

A value of 0.455 indicates that 45.5% of the variation in the teenage birth rate from state to state can be explained by variations in poverty rates. The remaining 54.5% can be explained by other factors not included in the model

LR: A Bivariate example

The ANOVA measured if the model fitted the data:

The results indicated that the variation explained by the regression model was about 41 times larger than that explained by other factors.

The P value lower than 0.001 indicated that the chances of this being due to random chance were very small, i.e. the model used fitted the data

LR: A Bivariate example

B, (slope) is the size of the difference in the dependent variable corresponding to a change of one unit in the independent variable

The value of 2.735 in this model indicates that for every 1% change in poverty rate there is a predicted increase in the teen birth rate of nearly 3 births (2.735)

The significance score of 0.000 indicates that there is a significant association between teen birth rate and poverty

LR: A Bivariate example

The constant (intercept) is the predicted value of the dependent variable when the independent variable is zero.

In this case, the constant indicates that there would be 15 teen births per 1000 teenage women even if there were no poor people in a state

Making Predictions

The linear regression equation is:Y’ = a + bX

Y’ is the predicted value of the dependent variable

a is the constant b is the slope X is the value of the independent

variable

Making Predictions In our case, the regression equation is:

Y’ = 15.16 + 2.735X If we wanted to predict the teenage birth

rate for a poverty rate of 20%: Y’ = 15.16 + 2.735 x 20 = 69.86

Predictions should be limited to the available range of values of the independent variable (in our case between 1% and 22%)

Graphing Bivariate Regression lines

Graphing Bivariate Regression lines

Graphing Bivariate Regression lines

Graphing Bivariate Regression lines

Graphing Bivariate Regression lines

Graphing Bivariate Regression lines

Multiple Linear Regression Regression model includes more

than one independent variable We’ll look at some factors affecting

teenage birth rate: Poverty (PVS500) Expenditures per pupil (SCS141) Unemployment rate (EMS171) Amount of welfare a family gets

(PVS526)

Multiple Linear Regression

Multiple Linear Regression

Multiple Linear Regression

MLR: Coefficients Looking at the significance tests

for the coefficients, only 2 are significant: States with higher poverty rates

have higher teenage birth rates (1.506 per 10000 women) for every 1% raise in poverty rates.

States that give more welfare aid had lower teen birth rates (-0.0379) for every $1 given as welfare aid.

MLR: R - Squared

MLR uses the Adjusted R2 instead of the R2 to account for only those variables that contribute significantly to the model

The AR2 in this case, 0.594, indicates that the model accounts for 59.4% of the variation in the teenage birth rate

MLR: R - Squared

The ANOVA indicates that the variables considered account for about 19 times of the variation due to other causes. The P<0.001 indicates that the model is a good fit to the data.

Multiple Regression Equation

The equation is:Y’ = 41.874 + 1.506X1 - 0.0009X2 + 2.515X3 -

0.037X4

X1 : Poverty Rate in 1998 – PVS500 X2 : Expenditures per pupil – SCS141 X3 : Unemployment rate – EMS171 X4 : Amount of welfare received – PVS526

Graphing the Multiple Regression

The multiple regression equation is:

Y’ = a + b1X1 + b2X2 + b3X3 + b4X4

Y’ is the predicted value of the dependent variable

a is the constant bi is the slope for variable i Xi is the value of the independent variable

i

Graphing the Multiple Regression Dependent variable is plotted against

one independent variable at a time The other variables are held constant, at

any value, but usually at their mean value We will graph the association between

welfare benefits and teenage birth rates holding poverty rates, school expenditures and unemployment rates at their mean values This requires computing TEENPRE, the

predicted value of teen birth rate according to the equation

Graphing the Multiple Regression

Transform Compute

Target Variable: TEENPRE Numeric Expression: 41.874 +

(1.506*12.73) + (-0.0009*6341.98) + (2.515*4.16) + (-0.037*PVS526)

Type and Label Label: Predicted Teenage Birth Rate Continue

OK

Graphing the Multiple Regression

Graphing the Multiple Regression

Graphing the Multiple Regression

Graphing the Multiple Regression

Graphing the Multiple Regression

Linear Regression Concerns

Linear Relationships A numerical dependent variable Normality of residuals

The residuals should follow a normal distribution with a mean of 0

Check is this is the case by saving and plotting the residuals when doing the MLR

Normality of Residuals

Normality of Residuals

Normality of Residuals

Normality of Residuals

Normality of Residuals

Normality of Residuals

Normality of Residuals

Normality of Residuals