50
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 1/50
Business
Research Methods
William G. Zikmund
Chapter 12:
Experimental Research
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 2/50
Experiment
• A research investigation in which conditions are
controlled
• One independent variable is manipulated(sometimes more than one)
• Its effect on a dependent variable is measured
• To test a hypothesis
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 3/50
Basic Issues of Experimental
Design• Manipulation of the Independent Variable
• Selection of Dependent Variable
• Assignment of Subjects (or other Test
Units)
• Control Over Extraneous Variables
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 4/50
The experimenter has some degree of
control over the independent variable.
The variable is independent because its
value can be manipulated by the
experimenter to whatever he or she
wishes it to be.
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 5/50
Experiment Treatment
Alternative manipulations of the
independent variable beinginvestigated
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 6/50
Independent Variable
• The experimenter controls independent
variable.
• The variable’s value can be
manipulated by the experimenters to
whatever they wish it to be.
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 7/50
Manipulation of Independent
Variable• Classificatory Vs. continuous variables
• Experimental and control groups
• Treatment levels
• More than one independent variable
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 8/50
Experimental Treatments
• The alternative manipulations of the
independent variable being investigated
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 9/50
Dependent Variable
• Its value is expected to be dependent
on the experimenter’s manipulation
• Criterion or standard by which the
results are judged
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 10/50
Dependent Variable
• Selection
– e.g... sales volume, awareness, recall,
• Measurement
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 11/50
Test Units
• Subjects or
entities whose
response to the
experimental
treatment are
measured or
observed.
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 12/50
Two Types of Experimental
Error • Constant errors
• Random errors
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 13/50
Field versus
Laboratory Experiments
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 14/50
Controlling Extraneous Variables
• Elimination of extraneous variables
• Constancy of conditions
• Order of presentation
• Blinding
• Random assignment
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 15/50
How May an Experimenter control for
Extraneous Variation?• Eliminate Extraneous Variables
• Hold Conditions Constant
• Randomization
• Matching Subjects
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 16/50
Establishing Control
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 17/50
Demand Characteristics
• Experimental procedures that intentionally
hint to subjects something about the
experimenter’s hypothesis
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 18/50
Demand Characteristics
• Guinea pig effect
• Hawthorne effect
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 19/50
Field Vs. Laboratory Experiment
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 20/50
Laboratory Experiment Field Experiment
Artificial-Low Realism
Few ExtraneousVariables
High control
Low Cost
Short Duration
Subjects Aware of Participation
Natural-High Realism
Many ExtraneousVariables
Low control
High Cost
Long Duration
Subjects Unaware of Participation
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 21/50
Control Groups
Isolate
extraneous
variation
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 22/50
When does an Experiment have
Internal Validity?
Internal Validity - The ability of an
experiment to answer the question whether
the experimental treatment was the solecause of changes in a dependent variable
Did the manipulation do what it was supposed
to do?
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 23/50
Factors Influencing Internal
Validity• History
• Maturation
• Testing
• Instrumentation
•Selection
• Mortality
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 24/50
Isolating Extraneous Variation
with a Control Group• History Effects
• Maturation Effects
• Mortality Effects
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 25/50
Type of Extraneous Variable Example
History - Specific events in theenvironment between the Beforeand After measurement that arebeyond the experimenter’s control
Maturation - Subjects changeduring the course of the experiment
Testing - The Before measure alerts
or sensitizes subject to nature of experiment or second measure.
A major employer closes its plant intest market area
Subjects becometired
Questionnaire
about the traditionalrole of womentriggers enhancedawareness of womenin an experiment.
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 26/50
Instrument - Changes in
instrument result in response bias
Selection - Sample selection
error because of differentialselection comparison groups
Mortality - Sample attrition; somesubjects withdraw from experiment
New questions about
women are interpreteddifferently from earlier questions.
Control group and
experimental group isself-selected groupbased on preference for soft drinks
Subjects in one groupof a hair dying studymarry rich widows andmove to Florida
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 27/50
How can Internal Validity
Increase?
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 28/50
Increasing Internal Validity
• Control group
• Random assignment
• Pretesting and posttesting
• Posttest only
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 29/50
What are the Different Basic
Experimental Designs?
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 30/50
Quasi-Experimental Designs
• One Shot Design (After Only)
• One Group Pretest-Posttest
• Static Group Design
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 31/50
One Shot Design (After Only)
X O1
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 32/50
One Group Pretest-Posttest
O1 X O2
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 33/50
Static Group Design
Experimental Group X O1
Control Group O2
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 34/50
Three Good Experimental Designs
• Pretest - Posttest Control Group Design
• Posttest Only Control Group
• Solomon Four Group Design
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 35/50
Pretest-Posttest Control Group Design
Experimental Group R O1 X O2
Control Group R O3 X O4
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 36/50
Posttest Only Control Group
Experimental Group R X O1
Control Group R O2
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 37/50
One-Shot Design
Internal Validity Problems
• History
– weak
• Maturation – weak
• Testing
– not relevant
• Instrumentation
– not relevant
• Selection – weak
• Mortality
– weak
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 38/50
One-Group Pretest-Posttest
Internal Validity Problems
• History
– weak
• Maturation – weak
• Testing
– weak
• Instrumentation
– weak
• Selection – controlled
• Mortality
– controlled
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 39/50
Static-Group Design
Internal Validity Problems
• History
– controlled
• Maturation – possible source of
concern
• Testing
– controlled
• Instrumentation
– controlled
• Selection – weak
• Mortality
– weak
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 40/50
Pretest-Posttest Control
Internal Validity Problems• History
– controlled
• Maturation – controlled
• Testing
– controlled
• Instrumentation
– controlled
• Selection – controlled
• Mortality
– controlled
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 41/50
Solomon Four-Group Design
Internal Validity Problems• History
– controlled
• Maturation – controlled
• Testing
– controlled
• Instrumentation
– controlled
• Selection – controlled
• Mortality
– controlled
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 42/50
Posttest-Only Control
Internal Validity Problems• History
– controlled
• Maturation – controlled
• Testing
– controlled
• Instrumentation
– controlled
• Selection – controlled
• Mortality
– controlled
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 43/50
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 44/50
Advanced Experimental Designs are
More Complex
• Completely randomized
• Randomized block design
• Latin square
• Factorial
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 45/50
Completely Randomized Design
• An experimental design that uses a random
process to assign subjects (test units) and
treatments to investigate the effects of onlyone independent variable.
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 46/50
Completely Randomized Designs
Average minutesshopper spendsin store
Control:no music
Experimentaltreatment:slow music
Experimentaltreatment:fast music
16 18 12
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 47/50
Independent Variable A
Group A Group B Group C
Level 1 Level 2 Level 3
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 48/50
Completely Randomized Design
With a pretest posttest
Group A R O1 X1 O2
Group A R O3 X2 O4
Group A R O5 X3 O6
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 49/50
With a posttest
Group A R X1 O1
Group B R X2 O2
Group C R X3 O3
Completely Randomized Design
8/6/2019 08 02 09 Experiment A Research
http://slidepdf.com/reader/full/08-02-09-experiment-a-research 50/50
Randomized Block Design
• An extension of the completely randomized
design in which a single extraneous variablethat might affect test units’ response to the
treatment has been identified and the effects
of this variable are isolated by blocking outits effects.
