Post on 02-Jan-2016
transcript
Types of Research• Analytical– Historical– Philosophic– Reviews (qualitative)– Research synthesis (quantitative, meta-analysis)
• Underutilized in strength and conditioning research?
• Descriptive research (cross-sectional)– Questionnaire– Interview– Normative survey
Types of Research• Other types of descriptive research– Case study (job/performance analysis)– Observational research (TMA)– Developmental studies– Correlational studies• Cannot infer cause-and-effect
• Epidemiologic research– Limitations abound
Types of Research
• Experimental research–establishes cause and effect
• Qualitative research–uses a different paradigm–May not have hypotheses at the beginning–May be partially participant-driven
Continuum of Basic to Applied Research
• Basic research (high internal validity)– Goal: Theory-driven– Approach: Laboratory– Strangely, some believe this is “better” than
applied research
• Moderate relevance– Goal: Theory-based using relevant
procedures– Approach: Similar to real-world task or
setting
Continuum of Basic to Applied Research
• Applied research (high external validity)– Goal: Immediate solutions– Approach: Real-world settings
– Remember that this is a continuum, and not all research fits neatly into one category
– Follows the internal-external validity continuum
Reading Research• One of the main problems with bridging
the gap between research and the practitioner is the writing style, which tends to be unnecessarily complex– “If you can’t dazzle them with brilliance,
baffle them with BS”- W.C. Fields
• Become familiar with relevant publications in your area of work/interests– Subscriptions are often included with
professional memberships
Reading Research
• Read the abstract first• Do not worry too much about
“significance”–Magnitude of effect is the key
• Be critical but objective– Do not throw the baby out with the
bathwater
The How-to Section: Checklists for Reading a
Study
Introductions (Literature Reviews)
• Introduce the problem area• Demonstrate its importance• Provide an overview of the literature• Show the need for study• Define a specific question/hypothesis
Checklist for the Introduction
(and Literature Reviews)• Problem area identified?• Importance justified?• Underlying theories discussed?• Not study-by-study, but topic-by-
topic?• Subheadings appropriate?
Checklist for the Introduction
(and Literature Reviews)• Definitions sufficient?• “Facts” cited?• Purposes/questions/hypotheses are a
clear extension of the introduction?
Checklist for the Methods-Sample
• Randomized groups? Stratified?• Groups equal at beginning?• If a one-group design, is there random
order?• Sample adequately described?• If pilot study, is the demographic
correct?• Adequate size?
Methods-Identifying Variables
• Independent– Manipulated
• Categorical or moderator – Descriptive
• Dependent– Outcomes
• Control– Things that may
influence the outcome and are thus “controlled”
• Extraneous– Make sure this does not
affect the methods
Checklist for the Methods-Variables and Instruments
• Clearly identified variables?• Trained researchers?• Reliability of measures?• Validity of measures?• Calibration of equipment?
Checklist for the Methods-Procedures
• Blinding?– Single-blind– Double-blind
• Compliance?• Internal validity?• External validity?
Checklist for the Analysis and Results
• “There are three kinds of lies: lies, damned lies, and statistics"
• Normality?• Magnitude of effects, not just
significance?• Attrition?
Checklist for the Discussion
• Summary of purpose?• Acknowledge limitations?• Placed data in the context of the
body of literature?• Suggestions for future research?
Checklist for the Discussion
• Distinguished between speculation and data-based conclusions?
• Remember that correlation is not causation (correlation is necessary but not sufficient for cause-and-effect)
• Applications, recommendations, implications?
Continuum of Certainty• Applications-uses• Recommendations-advising actions• Implications-tentative logical step• Speculations-reasonable imaginative leap
• Appropriate helping verbs– Can, will, should, must, may, might, and
probably
• Beware of Rule, Law, and Proven
Tying It All Together
• Is the problem important?• Were the researchers reflective?• Is the paper cohesive?• Does it add to the body of literature?• Likely to foster more research?• Likely to affect practice?
The Take-Home Message