Date post: | 02-Oct-2015 |
Category: |
Documents |
Upload: | ganapathys |
View: | 20 times |
Download: | 0 times |
Research Methods & Design OutlineTypes of research designHow to choose a research designIssues in research design
Centre for Industrial Relations University of Toronto
Types of Research Design
CorrelationalField (survey)ExperimentalQualitativeMeta-analysis
Centre for Industrial Relations University of Toronto
Types of Research Design
Correlational StudyExplores or tests relations between variablesRules out alternative variables that could play a role in relations between variablesField Studies participants in their natural settingMaximizes realism
Sekaran, Saks
Centre for Industrial Relations University of Toronto
Types of Research Design
Experimental DesignsDirectly establishes cause-effect nature of relationship between variablesDecreases ambiguityLaboratory vs. Field Experiment Artificial setting with high control over variables
Centre for Industrial Relations University of Toronto
Types of Research Design
Experimental Designs Establish cause viaManipulation of cause (aka treatment)Temporal precedence of cause (and no other factor) before effectControl of all other extraneous factors
Centre for Industrial Relations University of Toronto
Experimental Research DesignExample
Centre for Industrial Relations University of Toronto
Types of Research Design
QualitativeNon-quantitativeNot necessarily informal data collection (cf. Saks)ExamplesInterview/focus group transcripts Some kinds of observational/archival dataCritical incidents methodologyHelps in Formulating hypothesesDeeper/richer understanding of phenomenaInterpret organization-specific results
Centre for Industrial Relations University of Toronto
Types of Research Design
Meta AnalysisStatistically combines results of existing research to estimate overall size of relation between variablesHelps in Developing theory Identifying research needs, Establishing validity/effectiveness of HR toolsCan replace large-scale research studiesBetter than literature reviews
Centre for Industrial Relations University of Toronto
Identify the type of research design for each study description in Aamodt Exercise 1-1 (handout) Types of Research DesignExamples
Centre for Industrial Relations University of Toronto
Guns & Crime Article What are the two hypotheses re: the relation between gun ownership and crime?What are different ways to measure gun ownership?Identify the experimental and correlational methods used to test the hypotheses Types of Research Design Examples
Centre for Industrial Relations University of Toronto
Types of Research Design
Types of research designHow to choose a research designIssues in research design
Centre for Industrial Relations University of Toronto
How to Choose a Research Design
Does it adequately test the hypothesis?Does it identify & control extraneous factors?Are results generalizable?Can the hypothesis be rejected or retained via statistical means?Is the design efficient in using available resources?
Centre for Industrial Relations University of Toronto
How to Choose a Research Design
Does it adequately test the hypotheses?Hypotheses determine participants, variables measured & data analysis methodsExample hypotheses tested in student projectsDiscussion of Requirements of proposal
Centre for Industrial Relations University of Toronto
How to Choose a Research Design
Does it identify and control extraneous factors?Eliminate alternative explanations for results to increase confidence in cause-effect conclusion (internal validity)Control depends on type of designCorrelational design has less controlExtraneous variables are measured and effects are statistically controlled
Centre for Industrial Relations University of Toronto
Controlling Extraneous Variables in Experimental DesignsRandom AssignmentDistributing extraneous variable across groups randomlyMatching GroupsSpreading the extraneous variable across groups via systematic assignmentLess effective than random assignment (p.148 Sekaran)Control Group Group that receives no manipulation
Centre for Industrial Relations University of Toronto
How to Choose a Research Design
Are results generalizable?Replicate to other samples and other contexts Random selection of participantsFeatures of field experiments enhancing external validityRealistic nature of setting and/or taskManipulation of treatmentUse of control group Nature of samples used Lack of control over confounding variables due to non-random assignment or inability for matching
Centre for Industrial Relations University of Toronto
How to Choose a Research Design
Can the hypothesis be rejected or retained via statistical means? (statistical conclusion validity)Need reliable measuresNeed large enough sample to detect true effect & avoid Type 1 & 2 errors (see over) What is a null hypothesis? No effect proposedWhat is an alternative hypothesis?What is a directional hypothesis?
Centre for Industrial Relations University of Toronto
Types of Decisions based on Statistics
Centre for Industrial Relations University of Toronto
Reality
Effect does not exist
Effect Exists
Conclusion
Effect does not Exist
Correct Decision
Type 2 Error
Effect Exists
Type 1 Error
Correct Decision
How to Choose a Research Design
Is the design efficient in using available resources? Optimal balance between research design, time, resources and researcher expertise
Centre for Industrial Relations University of Toronto
Research Methods & Design OutlineTypes of research designHow to choose a research designIssues in research design
Centre for Industrial Relations University of Toronto
Issues in Research DesignResearch contextNature & size of sampleData sources
Centre for Industrial Relations University of Toronto
Issues in Research DesignResearch ContextOne or several organizational contextsLaboratory vs. field setting depends on Goal of establishing nature of phenomenon (or process) that exists in most contextsGeneralizability of resultsControl required of extraneous/nuisance variables
Centre for Industrial Relations University of Toronto
Issues in Research DesignNature of sampleRandom vs. stratifiedConvenience sampleStudent vs. field based sampleSize of sample determinesGeneralizability of resultsAbility to detect a true effect
Centre for Industrial Relations University of Toronto
Issues in Research DesignData Sources: Self reportCommon method varianceSimilar response format Consistency bias of participants Unreliability of measuresSocial desirabilityAlternative methods to questionnaire (e.g., interviews, behavioral, archival)Multiple times of data collection Alternative sources (e.g., supervisor, peer)Measure of individuals susceptibility to social desirability
Centre for Industrial Relations University of Toronto
Issues in Research DesignData Sources: Self reportResponse shift biasAlpha =real (condition) changeBeta = change in frame of reference (change in standards)Cross cultural difference in uses of ends vs. middle of response scaleGamma=change in meaning of construct/variableCross cultural differences in meaning of term
Centre for Industrial Relations University of Toronto
Issues in Research DesignData Sources: AlternativesCo-workers (e.g., subordinates, supervisors, peers)ArchivalBiologicalTraceObjective term
Centre for Industrial Relations University of Toronto
Research Methods & Design OutlineRECAPTypes of research designHow to choose a research designIssues in research design
Centre for Industrial Relations University of Toronto