The Basics of Regression - d37djvu3ytnwxt.cloudfront.net · • Highlight the usefulness of...

Post on 29-Apr-2018

215 views 1 download

transcript

Regression AnalysisThe Basics of Regression

Professor Raghu Iyengar

Regression Analysis• Several Examples

• Highlight the usefulness of regression for key managerial decisions

• Issues one must be careful about

Marketing Analytics

Regression Analysis• Several Examples

• Highlight the usefulness of regression for key managerial decisions

• Issues one must be careful about

• Managerial Relevance• Demand Analysis• Optimal Pricing and Price Elasticity• Dynamics of promotions

Marketing Analytics

What is the Purpose of Regression• Quantify the relationship among two or more variables

• Explain a dependent variable, from a set of predictor variable, called the independent variables

• Uses a linear additive relation between the dependent and independent variable.

Marketing Analytics

Example 1: Simple Demand Analysis

Marketing Analytics

Demand Analysis - Plot

Marketing Analytics

Regression• Demand Analysis

Salest = a + b1 Pricet + et

• Simple Regression

Marketing Analytics

Demand Analysis - Regression

Marketing Analytics

Demand Analysis - Regression

Marketing Analytics

Demand Analysis - Regression

Marketing Analytics

Demand Analysis - Regression

Marketing Analytics

Demand Curve

The regression line can be used to make demand predictions

Marketing Analytics

Demand Prediction

Regression

Marketing Analytics

Demand Prediction

Regression

Marketing Analytics

Demand Prediction

Regression

Future Prices

Marketing Analytics

Demand Prediction

Regression

Future Prices

Regression

Marketing Analytics

Regression AnalysisOptimal Pricing (Price Sensitivity) and Price Elasticity

Professor Raghu Iyengar

Optimal PricingPredicted Profit = (Price-MC) *(Predicted Demand)

If MC = 0 then

Predicted Revenue- (Price) *(Predicted Demand)

Marketing Analytics

Optimal PricingPredicted Profit = (Price-MC) *(Predicted Demand)

If MC = 0 then

Predicted Revenue- (Price) *(Predicted Demand)

Marketing Analytics

Price Elasticity• The percentage change in sales with 1% change in price.

Marketing Analytics

Price Elasticity• The percentage change in sales with 1% change in price.

• Sales = 0.90 *Price + 10.13

Marketing Analytics

Price Elasticity• The percentage change in sales with 1% change in price.

• Sales = 0.90 *Price + 10.13

• Price Elasticity at Price = $3.0?• Sales at Price = $3 : -0.90 *3 + 10.13 = 7.43

Marketing Analytics

Price Elasticity• The percentage change in sales with 1% change in price.

• Sales = 0.90 *Price + 10.13

• Price Elasticity at Price = $3.0?• Sales at Price = $3 : -0.90 *3 + 10.13 = 7.43• Sales at Price = $3.03: -0.90*3.03 + 10.13 = 7.40

Marketing Analytics

Price Elasticity• The percentage change in sales with 1% change in price.

• Sales = 0.90 *Price + 10.13

• Price Elasticity at Price = $3.0?• Sales at Price = $3 : -0.90 *3 + 10.13 = 7.43• Sales at Price = $3.03: -0.90*3.03 + 10.13 = 7.40• Elasticity = (7.40 – 7.43)/7.43*100 = -0.40

Marketing Analytics

Regression AnalysisMultiple Regression

Professor Raghu Iyengar

Multiple Regression

Multiple independent variables

ExampleSalest = a + b1 Pricet + b2* Advt + et

Marketing Analytics

Example 2: Multiple Regression and New Product Sales• Imagine many new product development (NPD) project

proposals (> 100) but resources are only sufficient for launching of 20 new products.

Marketing Analytics

Example 2: Multiple Regression and New Product Sales• Imagine many new product development (NPD) project

proposals (> 100) but resources are only sufficient for launching of 20 new products.

• Attractiveness of a NPD project proposal changes over time

Marketing Analytics

Example 2: Multiple Regression and New Product Sales• Imagine many new product development (NPD) project

proposals (> 100) but resources are only sufficient for launching of 20 new products.

• Attractiveness of a NPD project proposal changes over time

• Which projects to pick and which projects to kill during the NPD Process?

Marketing Analytics

New Product Development

Development• Concept

Marketing Analytics

New Product Development

Development ?Review• Concept

Marketing Analytics

New Product Development

Development ?Review

PrototypeDevelopment

• Concept

Marketing Analytics

New Product Development

Development ?Review

PrototypeDevelopment

?Review

• Concept

Marketing Analytics

New Product Development

Development ?Review

PrototypeDevelopment

?Review

AdvertisingDevelopment

• Concept

Marketing Analytics

New Product Development

Development ?Review

PrototypeDevelopment

?Review

AdvertisingDevelopment

?Review

• Concept

Marketing Analytics

New Product Development

Development ?Review

PrototypeDevelopment

?Review

AdvertisingDevelopment

?Review

• Actual vs. Projected

Post-LaunchAnalysis

Return

• Concept

Marketing Analytics

History of Product Launches – New Soup

Marketing Analytics

Regression Using Data From the Concept Stage

Marketing Analytics

History of Product Launches – New Soup

Marketing Analytics

Regression Using Data From the Both Stages

Useful to combine the additional data from the Prototype stage?

Marketing Analytics

How to Decide When to Stop Adding Variable?• R2

• It cannot decrease as more independent variables are added

• Adjusted R2

• Corrects for number of independent variables.

Marketing Analytics

Regression Using Data From Both Stages

Marketing Analytics

Regression Using Data From Both Stages

Higher than 0.55

Marketing Analytics

Regression Using Data From Both Stages

Higher than 0.55

Useful to combine the additional data from the Prototype stage?

Marketing Analytics

Regression Using Data From Both Stages

Higher than 0.55

Useful to combine the additional data from the Prototype stage?

YES!

Marketing Analytics

Empirical Lessons• One can determine whether adding more variables is helpful or

not

Marketing Analytics

Empirical Lessons• One can determine whether adding more variables is helpful or

not

• Think about adjusted R-squared as a metric for determining when to stop adding variables

Marketing Analytics

Regression AnalysisConsumer Packaged Goods Example (Multicollinearity)

Professor Raghu Iyengar

Example 3: CPG Context• Are more variables always better?

Marketing Analytics

Example 3: CPG Context• Are more variables always better?

• Dependent Variable – Sales

Marketing Analytics

Example 3: CPG Context• Are more variables always better?

• Dependent Variable – Sales

• Independent Variables• Ad Spend• Price

Marketing Analytics

Scatter Plots

Marketing Analytics

Scatter Plots

Both AdSpend and Prices are highly correlated with Sales

Marketing Analytics

Regression Results

Marketing Analytics

Regression Results

What’s going on here?

Marketing Analytics

Scatter Plot (AdSpend vs Price)

Marketing Analytics

Scatter Plot (AdSpend vs Price)

Almost perfect correlation!

Marketing Analytics

Multicollinearity• Multicollinearity - Xs are collinear with each other

• Look at correlation matrix of Xs• Solution: Do not include all of the Xs

• More variables are not always be better!

Marketing Analytics

Separate Regressions

Marketing Analytics

Separate Regressions

No problem at all

Marketing Analytics

Separate Regressions

Marketing Analytics

VIF – Variance Inflation Factor

VIF > 5 is a typical cut off

Marketing Analytics

Overall Empirical Lessons• Always look out for multicollinearity when you see regression

results.

Marketing Analytics

Overall Empirical Lessons• Always look out for multicollinearity when you see regression

results.

• It is particularly important if there are several variables you are putting into a model.

Marketing Analytics

Regression AnalysisRegression and Time Trends

Professor Raghu Iyengar

Example 4: Regression and Time Trends

Marketing Analytics

Example 4: Regression and Time Trends

Salsa demand in a retail store over time

Marketing Analytics

Example 4: Regression and Time Trends

Salsa demand in a retail store over time

Question:What is the price sensitivity?

Marketing Analytics

Regression

Marketing Analytics

Regression

Positive Impact of Price?!

Marketing Analytics

Salsa Data – Monthly Category Demand

Marketing Analytics

Salsa Data – Monthly Category Demand

Overall demand is increasing over time

Marketing Analytics

Regression

Marketing Analytics

Regression

Reasonable impact of price after accounting for overall increase in demand

Marketing Analytics

Overall Empirical Lessons• Be mindful of market size and economic conditions

Marketing Analytics

Overall Empirical Lessons• Be mindful of market size and economic conditions

• Be mindful of seasonality and other time trends

Marketing Analytics

Regression AnalysisAdvertising and Promotions

Professor Raghu Iyengar

Data and Questions• Data

• Quarterly Sales Data of Cereal (thousands of dollars)• Promotion and Advertising Spending (thousands of dollars)

Marketing Analytics

Data and Questions• Data

• Quarterly Sales Data of Cereal (thousands of dollars)• Promotion and Advertising Spending (thousands of dollars)

• Question• What is the impact of promotions and advertising

Marketing Analytics

What is the $ impact of promotion / adv?

Should we put all our money in promotions?

Marketing Analytics

What is the $ impact of promotion / adv

Coefficients Standard Error t Stat P-valueIntercept 757.3168569 274.9484797 2.754395506 0.013542618prom 5.915436041 0.874022866 6.768056391 3.28474E-06

adv 2.29581158 0.746485388 3.075494332 0.006855015lagadv 2.622828289 0.776793776 3.376479538 0.003585691

lagprom -3.191780961 0.855723945 -3.72991895 0.001666007

Marketing Analytics

What is the $ impact of promotion / adv

Coefficients Standard Error t Stat P-valueIntercept 757.3168569 274.9484797 2.754395506 0.013542618prom 5.915436041 0.874022866 6.768056391 3.28474E-06

adv 2.29581158 0.746485388 3.075494332 0.006855015lagadv 2.622828289 0.776793776 3.376479538 0.003585691

lagprom -3.191780961 0.855723945 -3.72991895 0.001666007

Marketing Analytics

What is the $ impact of promotion / adv

Coefficients Standard Error t Stat P-valueIntercept 757.3168569 274.9484797 2.754395506 0.013542618prom 5.915436041 0.874022866 6.768056391 3.28474E-06

adv 2.29581158 0.746485388 3.075494332 0.006855015lagadv 2.622828289 0.776793776 3.376479538 0.003585691

lagprom -3.191780961 0.855723945 -3.72991895 0.001666007

Marketing Analytics

What is the $ impact of promotion / adv

Coefficients Standard Error t Stat P-valueIntercept 757.3168569 274.9484797 2.754395506 0.013542618prom 5.915436041 0.874022866 6.768056391 3.28474E-06

adv 2.29581158 0.746485388 3.075494332 0.006855015lagadv 2.622828289 0.776793776 3.376479538 0.003585691

lagprom -3.191780961 0.855723945 -3.72991895 0.001666007

Marketing Analytics

What is the $ impact of promotion / adv

Coefficients Standard Error t Stat P-valueIntercept 757.3168569 274.9484797 2.754395506 0.013542618prom 5.915436041 0.874022866 6.768056391 3.28474E-06

adv 2.29581158 0.746485388 3.075494332 0.006855015lagadv 2.622828289 0.776793776 3.376479538 0.003585691

lagprom -3.191780961 0.855723945 -3.72991895 0.001666007

Marketing Analytics

What is the $ impact of promotion / adv

Coefficients Standard Error t Stat P-valueIntercept 757.3168569 274.9484797 2.754395506 0.013542618prom 5.915436041 0.874022866 6.768056391 3.28474E-06

adv 2.29581158 0.746485388 3.075494332 0.006855015lagadv 2.622828289 0.776793776 3.376479538 0.003585691

lagprom -3.191780961 0.855723945 -3.72991895 0.001666007

Carry over effects!

Net-Net – advertising is more powerful

Marketing Analytics

Dynamics Effects of Promotions / Advertising • Carry-over from the marketing mix variable

Marketing Analytics

Dynamics Effects of Promotions / Advertising • Carry-over from the marketing mix variable

• The following equation can help in capturing the short term and longer term effect• Salest = a + b Xt + c Xt-1

• If X is advertising, then the above equation captures the carry over effect of advertising

• If X is promotions, then the above equation captures the carry over effect of promotions.

Marketing Analytics

Overall Empirical Lessons• Be mindful marketing dynamics

Marketing Analytics

Overall Empirical Lessons• Be mindful marketing dynamics

• Advertising and Promotions• There is a tradeoff

Marketing Analytics

Regression AnalysisAdvertising and Promotions

Professor Raghu Iyengar

Validation of Model Predictions• Split Sample

• Run two regressions on half of the sample and cross-predict

Marketing Analytics

Validation of Model Predictions• Split Sample

• Run two regressions on half of the sample and cross-predict• Prediction in hold out samples

• Most obvious alternative if you have the data

Marketing Analytics

Validation of Model Predictions• Split Sample

• Run two regressions on half of the sample and cross-predict• Prediction in hold out samples

• Most obvious alternative if you have the data• Good to test against overfitting

Marketing Analytics

Summary• Regression is a simple tool. Keep the following in mind :

• Multicollinearity of variables• Adding more variables is not always better• Time trend and dynamics are important

Marketing Analytics

Summary• Regression is a simple tool. Keep the following in mind :

• Multicollinearity of variables• Adding more variables is not always better• Time trend and dynamics are important

• Model validation is important

Marketing Analytics