+ All Categories
Home > Documents > Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education...

Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education...

Date post: 26-Jun-2018
Category:
Upload: phungnguyet
View: 220 times
Download: 0 times
Share this document with a friend
37
Meta-Analysis 1 Quantitative Research Synthesis: Meta-Analysis of Research on Meeting Special Educational Needs Kenneth A. Kavale Regent University HANDBOOK OF SPECIAL EDUCATION Lani Florian (Ed.) Sage Publications
Transcript
Page 1: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 1

Quantitative Research Synthesis:

Meta-Analysis of Research on Meeting Special Educational Needs

Kenneth A. Kavale Regent University

HANDBOOK OF SPECIAL EDUCATION

Lani Florian (Ed.) Sage Publications

Page 2: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 2

Introduction

Since the passage of landmark federal law (now IDEA) in 1975, special education has

witnessed significant change but not necessarily real progress. The consequences are found in

attitudes that oscillate between optimism and pessimism about the prospects for special

education (see Zigler & Hodapp, 1986). For example, there is optimism about the law’s success

in providing access to special education but pessimism about whether or not the appropriate

education provision is achieving the desired outcomes (Finn, Rotherham & Hakanson, 2001).

Such pessimism is not new; the innovative program developed by Jean-Marc-Gaspard Itard for

Victor, the “wild boy of Aveyron” (Itard, 1806/1962) was perceived as a “failure” (e.g., Kirk &

Johnson, 1951) because of Victor’s modest attainments. In reality, the gains were meaningful

and demonstrated the potential of special education (Gaynor, 1973).

Questions about the efficacy of special education are thus long-standing (e.g., Milofsky,

1974) and typically take the form of asking: Is special education special? Answers may become

confounded because the special in special education possesses two meanings: a) teaching special

students, and b) using special instruction. Too often, however, the desire to enhance education

experiences for special students means that teaching may be based on uncritical decisions about

the efficacy of techniques used for special instruction. The fact that the most effective teaching is

predicated on scientific ground may be ignored when a teacher is faced with the challenge of

teaching special students (see Gage, 1978). Without a scientific foundation for practice, special

education is likely to become a variable enterprise that may be effective or not effective.

To determine whether methods for special instruction are effective (i.e., Do they work?),

special education how long-endorsed the scientific method where decisions about efficacy are

based on empirical evidence (Kauffman, 1987). The empirical evidence is available but too often

Page 3: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 3

remains isolated when individual study findings do not agree. Which findings are to be believed?

Differences among studies are not a problem if individual findings are combined to produce

“usable knowledge” (Lindblom & Cohen, 1979) that may be used to judge the efficacy of special

instruction.

Traditional methods for combining individual study findings (e.g., narrative review) are

too subjective and may produce biased findings (see Jackson, 1980). In an effort to reduce the

subjectivity associated with traditional methods of reviewing research findings (see Cooper &

Rosenthal, 1980), quantitative methods, usually termed “meta-analysis” (Glass, 1976), have

become an accepted means of combining empirical findings. Meta-analysis is the application of

statistical procedures to collections of empirical findings from individual studies for the purpose

of integrating, synthesizing, and making sense of them (Glass, McGaw, & Smith, 1981).

As a research methodology, meta-analysis uses rigorous and systematic procedures that

parallel primary research activities including: 1) problem formulation (Is intervention X

effective?), 2) sampling (a comprehensive and representative set of studies from the domain

under investigation), 3) study classification (organizing and coding study information), 4) data

analysis (calculation of the “effect size” (ES) statistic that permits quantification and

standardization of individual study findings), and 5) ES interpretation (Kavale, 2001b).

An ES is most often interpreted as a z-score indicating level of improvement on an

outcome assessment for students initially at the 50th percentile. To gain greater insight, two

additional ES interpretations are provided. The “common language effect size” (CLES)

(McGraw & Wong, 1992) converts ES into a probability that a score sampled from one

distribution will be greater than a score sampled from another. For example, in a sample of

studies investigating the use of intervention Y with a CLES of .83, 83 out of 100 would show

Page 4: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 4

that a subject using intervention Y would improve when compared to subjects not using

intervention Y. The “binomial effect size display” (BESD) (Rosenthal & Rubin, 1982) addresses

the question: What is the percentage increase in the number of successful responses when using a

new instructional practice? Based on converting an ES to r, the BESD for the use of intervention

Z (ES = 1.16, for example) would show an increase in success rate from 25% to 75%. The 50-

percentage-point spread between treatment (75%) and comparison (25%) success rate shows that

the use of intervention Z possesses, not only statistical significance, but also practical

significance. Finally, Cohen (1988), based on notions of statistical power, offered “rules of

thumb” for classifying ES as small (.20), medium (.50), or large (.80). Thus, the ES metric

imparts a clarity and explicitness to empirical findings that make synthesized evidence more

objective and verifiable (Kavale, 1984).

This chapter reviews meta-analyses investigating the effectiveness of special education in

order to make decisions about “what works” (see Kavale, 2001a).

The Nature of Special Education

The definition of special education as “specially designed instruction…to meet the

unique needs of a child with a disability (U.S. Department of Education, 1999, p. 12425)

emphasizes individualized instruction but does not stipulate the nature of the special instruction

to be delivered. Special education, in an effort to differentiate itself from general education, has

historically opted for developing unique and exclusive methods. Although “special” methods

provided a distinct identity, they also introduced a separateness from general education that

produced a skepticism about their benefits on the part of general education. Because of its higher

costs, special education was being held increasingly accountable: Could special education

substantiate its benefits?

Page 5: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 5

Special education has historically assumed a goal of correcting or reversing the altered

learning functions of students. Beginning with Itard, special education has focused on enhancing

cognitive processes so students in special education may then be able to learn in the same way as

general education students. Consequently, process training has long been a primary form of

special education (see Mann, 1979). Although intuitively appealing, does research support the

theoretical assumption that training processes enhances learning ability?

A large body of empirical research has investigated the efficacy of process training but

difficulties arise in deciding “what the research says” as was illustrated in the case of

psycholinguistic training, a prominent form of process training during the 1960s and 1970s.

Psycholinguistic training was developed by Samuel A. Kirk and embodied in the Illinois Test of

Psycholinguistic Abilities (ITPA). The model was based on the assumption that psycholinguistic

ability is comprised of discrete components and that these components can be improved with

training. By the mid 1970s, empirical research summaries revealed very different interpretations

about the efficacy of psycholinguistic training.

A review of 39 studies by Hammill and Larsen (1974) concluded that, “the idea that

psycholinguistic constructs, as measured by the ITPA, can, in fact, be trained by existing

techniques remains nonvalidated” (p. 11). In response, Minskoff (1975) offered a more positive

evaluation and concluded that psycholinguistic deficits can be remediated. The Minskoff review

was immediately challenged by Newcomer, Larsen, and Hammill (1975) who concluded that,

“the reported literature raises doubts regarding the efficacy of presently available Kirk-Osgood

psycholinguistic training programs” (p. 147). The divergent interpretations made it increasingly

difficult to determine “what the research says” about the efficacy of psycholinguistic training.

Page 6: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 6

Several years later, Lund, Foster, and McCall-Perez (1978) re-evaluated the original 39

studies, and concluded that, “It is, therefore, not logical to conclude either that all studies in

psycholinguistic training are effective or that all studies in psycholinguistic training are not

effective” (p. 319). Hammill and Larsen (1978) contested the Lund et al. analysis and concluded

that, “the cumulative results…failed to demonstrate that psycholinguistic training has value” (p.

413). Although polemics abounded, a primary question remained unanswered: What is really

known about the efficacy of psycholinguistic training?

Meta-analysis and the Efficacy of Special Education

Psycholinguistic Training

The traditional methods of research integration used to evaluate psycholinguistic training

failed to accumulate knowledge in an objective manner. To provide verifiable and replicable

conclusions, Kavale (1981) conducted a meta-analysis on 34 studies that yielded an average ES

of .39. In a statistical sense, an ES shows outcomes in standard deviation (SD) units that can be

interpreted in terms overlapping distributions (treatment vs. control). The ES of .39 indicates that

the average treated subject would gain 15 percentile ranks on the ITPA and would be better off

than 65% of control (no treatment) subjects. Using Cohen’s (1988) rules of thumb, an ES of .39

approaches a “medium” level but does not represent an unequivocal endorsement of

psycholinguistic training.

To gain insight, ES data were aggregated by ITPA subtest and five of nine ITPA subtests

revealed “small,” albeit positive, effects. Such a modest response suggests that training would

not be warranted in these five cases. For four subtests (Auditory and Visual Association, Verbal

and Manual Expression), however, training improves performance from 15 to 24 percentile ranks

Page 7: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 7

and makes the average trained subject better off than approximately 63% to 74% of untrained

subjects.

The findings regarding the Associative and Expressive constructs appear to belie the

conclusion of Hammill and Larsen (1974) that, “neither the ITPA subtests nor their theoretical

constructs are particularly ameliorative” (p. 12). The meta-analytic findings should not, however,

be interpreted as approval for psycholinguistic training. In the case of Auditory Association, for

example, there are difficulties in defining the skill: What is Auditory Association? Additionally,

it is important to determine whether improvement in Auditory Association provides enhanced

functioning in other than that discrete ability. In contrast, the case for Expressive constructs

particularly Verbal Expression presents a different scenario because it represents the tangible

process of productive language behavior whose improvement is critical for school success. In

fact, the Verbal Expression ES (.63) exceeds what would be expected from six months of general

education language instruction (ES=.50). Thus, the Kavale (1981) meta-analysis showed where

psycholinguistic training might be effective and might be initiated when deemed an appropriate

part of an intervention program.

Process Training

Mann (1979) suggested that, “process training is, in fact, one of the oldest forms of

education and that, despite periodic discontinuities in its practice, it has continued unabated into

our own day” (p. 537). Table 1 reveals that popular forms of process training demonstrate

limited efficacy. (The reported ES were obtained from the meta-analyses listed in Appendix A

and represent either the ES reported in a single meta-analysis investigating a particular

intervention or a weighted mean ES from meta-analyses investigating the same intervention.) For

example, perceptual-motor training, the embodiment of 1960s special education had practically

Page 8: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 8

no effect on improving educational performance; famous programs such as those developed by

Kephart (ES=.06) and Frostig (ES=.10) revealed very modest effectiveness. The limited efficacy

of process training may be related to difficulties in attempting to ameliorate unobservable

(hypothetical) constructs. The outcomes of training (products) are the only observable

component while the means by which those products were achieved (process) are not observable.

Although these difficulties are evident for constructs like perception, the same problems can be

identified for, as an example, social skills training where the actual skills represent products that

are presumed related to the hypothetical construct of social competence.

Although attacks on process training have been vigorous (e.g., Mann, 1971), its

historical, clinical, and philosophical foundation creates a resistance to accepting negative

evidence (e.g., Hallahan & Cruickskank, 1973) because, “the tension between belief and reality

provides a continuing sense of justification for process training” (Kavale & Forness, 1999, p.

35). The failure to change beliefs about efficacy was found for modality-matched instruction

(ES=.14) which has received a number of previous negative evaluations (e.g., Arter & Jenkins,

1979; Larrivee, 1981; Tarver & Dawson, 1978). The negative evidence is resisted because

teachers have maintained a strong belief that students learn best when instruction is modified to

match individual modality patterns (Kavale & Reese, 1991). The beliefs, however, must be

modulated by the empirical evidence indicating that interventions developed to define the

uniqueness of special education (e.g., process training methods not likely to be used in general

education) are not effective. Such evidence needs to be heeded because, “schools must view the

time, money, and other resources devoted to [process training] as wasteful [and] as an

obstruction to provision of appropriate services (Council for Learning Disabilities, 1986, p. 247).

Creating Effective Special Education

Page 9: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 9

The long dominant tradition of process training in special education reflected a pathology

model; academic problems were regarded as a “disease” and interventions were aimed at

“curing” the disease (i.e., removing the pathology) (Kauffman & Hallahan, 1974). By about

1975, the realization that process training was not producing desired outcomes shifted attention

to an “instructional imbalance” model where school failure was viewed as the result of a

mismatch between instructional methods and student developmental level (Hagin, 1973). The

“effective schools” research (see Bickel & Bickel, 1986) was a major influence that stressed, for

example, the importance of teachers believing that all students can achieve, that basic skill

instruction should be emphasized, and that clear instructional objectives should be used to

monitor student performance.

At the same time, a “learning process” model emerged that viewed teaching within a

“process-product” paradigm where variables depicting what occurs during teaching are

correlated with products (i.e., student outcomes) (Needels & Gage, 1991). Research revealed the

importance of a number of principles like, for example, encouraging student’s active engagement

in learning, exploring innovative approaches to grouping and organizing classroom instruction,

and making learning meaningful by keeping it enjoyable, interesting, student-centered, and goal-

oriented (see Brophy & Good, 1986). These principles became “best practice” and were

interpreted for special education (e.g., Christenson, Ysseldyke, & Thurlow, 1989; Reith &

Evertson, 1988; Reynolds, Wang, & Walberg, 1992).

Effective Special Educational Practice

Research investigating the teaching-learning process has identified a number of effective

instructional practices. Table 2 shows a sample of effective instructional practices and reveals

Page 10: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 10

that substantial positive influence on learning are possible by modifying the way instruction is

delivered.

The use of effective instructional practices moves special education toward the general

education teaching-learning model and away from a reliance on “special” interventions (e.g.,

process training). For example, mnemonic instruction (MI) is a strategy that transforms difficult-

to-remember facts into a more memorable form through recoding, relating, and retrieving

information (Mastropieri & Scruggs, 1991). A student receiving MI would be better off than

95% of students not receiving MI and would show a 45 percentile rank gain on an outcome

assessment. In a sample of studies investigating MI, 87 out of 100 would show that students

receiving MI would demonstrate improvement when compared to students in the control

condition (CLES=.87). The BESD shows a 64% increase in success rate which indicates

substantial practical significance. Compare the success rate of MI to, for example, perceptual-

motor training (ES=.08) where the modest 4% increase in success rate indicates a negligible

statistical effect and almost no practical significance.

Effective Special Education Instruction

The ultimate purpose of implementing effective instruction is to enhance academic

performance. Achievement outcomes are shown in Table 3 and indicate the potential for

substantial gains across subject areas. All achievement domains show “large” ES with gains

ranging from 29 to 41 percentile ranks on academic achievement measures. On average, almost

eight out of ten investigations of effective special education instruction will likely show

improvement (CLES=.77). The success rate increases from 27% to 73% indicating an average

46% improvement for students showing a positive response to instruction.

Page 11: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 11

The example of reading comprehension demonstrates how meta-analysis can be useful

for judging the magnitude of “real” effects. Two meta-analyses contributed almost all ES

measurements and produced ESs of 1.13 and .98, a modest three percentile rank difference in

outcomes (87 vs. 84). When specific methods for improving reading comprehension are

compared, the two meta-analyses revealed a similar pattern of findings. The largest effects

(ES=1.60 and 1.33) were found for metacognitive techniques (e.g., self-questioning, self-

monitoring). Text enhancement procedures (e.g., advanced organizers, mnemonics) produced ES

of 1.09 and .92. The least powerful (but nevertheless effective) techniques involved skill training

procedures (e.g., vocabulary, repeated reading) with ES of .79 and .62. The consistency of

findings across these two meta-analyses provides confidence in concluding that it is possible to

enhance reading comprehension.

The meta-analytic evidence suggests that, on average, the “real” effect of reading

comprehension instruction is 1.05, a level comparable to one year’s worth of reading

comprehension instruction in general education (ES=1.00). Thus, methods adapted for the

purposes of special education produced the same effect as 1 year of general education instruction

but did so in approximately 20 hours. Clearly, special education students can significantly

improve their ability to better understand what they read.

Effective Special Education Related Services

A hallmark of special education is the provision for related services to be provided when

deemed appropriate in augmenting the instruction program. Table 4 shows a sample of adjunct

activities and most demonstrate, at least, “medium” ES. On average (ES=.65), related services

produced a 24 percentile rank gain on an outcome assessment. In 68 out of 100 cases, a positive

Page 12: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 12

response to the related service was achieved (CLES=.68). Thus, related services appear to be

useful supplements to the instructional program.

Placement has often been viewed as having a positive influence on student performance

(see Kavale & Forness, 2000). The ES magnitude (.12) negates such a view and indicates that the

success rate associated with placement increases only 6% from 47% to 53% (BESD). The

“small” ES suggests that “what” (i.e., nature of the instruction) is a more important influence on

student outcomes than “where” (i.e., placement). In contrast, prereferral activities revealed

significant positive effects. The CLES (.78) indicates that in 78 of 100 cases prereferral activities

produce positive outcomes. Prereferral “works” because it is predicated in modification of

instructional activities, and its 48% success rate means that almost half of students given

preferential activities will not need to enter special education.

Drug treatment is often an integral part of the treatment regimen for some students in

special education. Stimulant medication (usually Ritalin) is the most popular and produces

significance positive changes in behavior. In 2 out of 3 cases (CLES=.67), positive outcomes

were found in gains averaging 23 percentile ranks on behavior ratings and checklists. The ES

(.62) was obtained primarily from a meta-analysis done in 1982 (ES=.58) and a replication

completed in 1997 (ES=.64). The consistency of the obtained ES (i.e., .58 and .64) provides

confirmation for the positive influence of stimulant medication. Special education, however, has

long criticized the use of stimulant medication and has sought more natural and unobtrusive

treatments. One such alternative, popularized during the 1970s, was the Feingold diet designed to

eliminate all foods containing artificial additives from the diet. The ES (.12) obtained for the

Feingold diet (see Table 1) clearly indicates that it has limited influence on modifying behavior.

A comparison of the two treatments shows stimulant medication to be better than five times

Page 13: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 13

more effective than the Feingold diet; the debate about the efficacy of stimulant medication

appears unequivocal.

Evaluating Special Education

Special education has demonstrated increased efficacy that may be attributable to a

change in instructional emphasis. Until about 25 years ago, special education emphasized its

“special” nature by developing singular and different methods not found in general education.

The goal was to enhance hypothetical constructs (e.g., “processes”) that were presumed to be the

cause of learning deficits. Basic skill instruction was a secondary consideration until processes

were remediated and learning became more efficient. When intervention activities emphasize,

for example, process training and basic skill instruction is subordinate, the nature of special

education can be conceptualized as SPECIAL education, with a focus on unique and exclusive

“special” interventions. The limited efficacy of SPECIAL education (see Table 1) suggest that

process deficits are difficult to “fix” and such an intervention focus produces little benefit.

The recognition that “special” interventions did not produce desired outcomes moved

special education to emphasize “education” in an effort to enhance academic outcomes. When

intervention activities emphasize alternative instructional techniques, the nature of special

education can be conceptualized as special EDUCATION. Such instructional techniques usually

originate in general education and are adapted to assist students with disabilities in acquiring and

assimilating new knowledge; special EDUCATION demonstrates significant success (see Table

2) and produces improved achievement outcomes (see Table 3).

The difference between the two forms of special education are seen in the mega ES

(mean of means) for “special” (.15) versus “education” (.89) techniques. The comparison reveals

special EDUCATION to be six times more effective than SPECIAL education; it produces

Page 14: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 14

achievement outcomes (mega ES=1.04) that exceed one year’s worth of general education

instruction (ES=1.00). On average, SPECIAL education provides only a 6% advantage meaning

that the students in special education receiving primarily “special” interventions exceeds only

about 56% of the group not receiving such interventions; this level of improvement is only

slightly above chance (50%). Additionally, across meta-analyses investigating SPECIAL

education, about 25% of the calculated ES were negative indicating that in one out of four cases

the student not receiving the “special” intervention performed better. Clearly, there is little

reason to include SPECIAL education in most intervention programs.

In contrast, the methods associated with special EDUCATION provide an efficacious

foundation for designing an academic instructional program. The use of effective techniques is

likely to move the average student in special education from the 50th to the 81st percentile. The

31-percentile-rank gain is better than 5 times the gain found with the use of “special”

interventions, and indicates students are better off than 81% of those not receiving the preferred

special EDUCATION. For example, Direct Instruction (DI), a behaviorally oriented teaching

procedure based on an explicit step-by-step strategy (ES=.93) is 6 ½ times more effective than

the intuitively appealing modality-matched instruction that attempts to enhance learning by

capitalizing on learning style differences (ES=.14). Students in special education taught with DI

would be better off than 87% of students not receiving DI and would gain over 11 months credit

on an achievement measure compared to about one month for modality-matched instruction.

With its grounding in effective instructional methodology, special EDUCATION can sometimes

be up to 20 times more effective than SPECIAL education.

Effective Special Education

Page 15: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 15

The meta-analyses synthesized provide insight into the indications and contra-indications

of special education interventions (Lipsey & Wilson, 2001). The interventions associated with

special EDUCATION may be considered a form of “evidenced-based practice” (EBP) (Odom,

Brantlinger, Gersten, Horner, Thompson, & Harris, 2005) where intervention decisions are based

on empirical findings demonstrating that the actions produce efficacious and beneficial

outcomes. The use of EBP promotes instructional validity where changes can be attributed to the

specific activities and can be used to produce similar results with other students in special

education (generalization).

Although EBP is desirable, the implementation of EBP is often limited by extraneous

factors. For example, tradition (“We have always used it”) and history (“It has worked before”)

are powerful barriers. Additionally, the bandwagon effect, where an intervention suddenly

becomes popular and gains momentum rapidly, may have a significant influence. As pointed out

by Mostert (1999-2000), “Bandwagons are used to champion a cause, engage in sweeping yet

attractive rhetoric, and generally to promise far more than they ever have hope of delivering” (p.

124). Finally, belief, a strong conviction about the truth, although a legitimate consideration in

making intervention decisions, is only appropriate when the belief is grounded in empirical

evidence.

The negative influence of these extraneous factors is one reason why research findings in

special education “are embraced by some, ignored by others, and modified to suit the routines

and preferences of still others” (Gersten, Vaughn, Deshler, & Schiller, 1997, p. 466). Regardless

of how exciting teachers may find new proven techniques, they often resist implementing them

in favor of more comfortable existing practices (Swanson, 1984). Heward (2003) identified ten

faulty notions that may hinder the effective delivery of special education. All told, the obstacles

Page 16: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 16

that interfere with making sound instructional decisions are a primary reason why there is a

continuing research-to-practice gap in special education (Greenwood & Abbott, 2001). The

failure to use EBP is a major contributor to the problem of sustainability, the maintained use of

an instructional practice supported by evidence of improved outcomes for students in special

education (Gersten, Vaughn, & Kim, 2004).

Because students in special education, by definition, possess unique learning needs,

instructional decisions are critically important in the design of individualized programs. The

complexities surrounding the instructional decision making introduces a degree of “uncertainty”

(i.e., the program may not work) (Glass, 1979). Besides uncertainty, there is also the possibility

of “risk” (i.e., negative outcomes) that can be described in meta-analysis by the standard

deviation (SD), a measure of dispersion around the mean ES that represents an index of

variability. Taken together, the ES and SD provide a theoretical expectation about intervention

efficacy (i.e., ES ± SD). For example, psycholinguistic training (.39 ± .54) spans a theoretical

range (-.15 to .93) from negative ES to “large” ES; the difficulty is the inability to predict the

outcome (i.e., ES) for a particular student. The mega ES for SPECIAL education (.15) is

associated with a larger mega SD (.48) making “special” interventions actually more variable

than effective (.15 ± .48). The theoretical range for SPECIAL education (-.33 to .63), although

possibly producing “medium” effects, also includes significant risk (i.e., a negative ES indicating

that those not receiving the intervention perform better). In contrast, special EDUCATION (.89 ±

.87) reveals itself to be more effective than variable and, although the theoretical range shows

that it may not “work” in some cases (ES=.02), there also exists the theoretical possibility of

being almost twice as effective (ES=1.76).

Page 17: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 17

Although the use of special EDUCATION can reduce risk (i.e., no negative ES), the

special education teaching-learning process remains a capricious enterprise (i.e., variable,

unpredictable, and indeterminate). To create more certainty, instructional decisions should not be

prescriptive (i.e., do A in circumstance X or Y, and do B in circumstance Z) but rather based on

an assortment of effective options (i.e., practices with large ES). This means that teachers are

central characters in the special education decision making process who must replace dogmatic

beliefs with rational choices about “what works.” Instructional decisions thus include elements

of science (theoretical and empirical knowledge) and art (interpretation necessary to initiate

action (see Gage, 1978). The teacher’s goal is to narrow the gap between the state of the art

(what has been demonstrated to be possible) and the state of practice (current ways of providing

instruction). Consequently, the actions of

special education practitioners will need to go beyond the scientific basis of their work …

and must be mediated through the teacher’s own creative rendering of best practice …

because quality education for special education students will always be based on the

artful application of science (Kavale & Forness, 1999, p. 93).

Page 18: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 18

Table 1

Effectiveness of Process Training ______________________________________________________________________________ Method Mean Effect Size Percentile Rank Power Rating Equivalent ______________________________________________________________________________ Irlen Lenses -.02 49 Negative (34) Perceptual-Motor Training .08 53 Negligible (33) Diet Modification (Feingold) .12 55 Small (31) Modality-Matched Instruction .14 56 Small (32) Social Skills Training .36 64 Small (17, 42, 44) Psycholinguistic Training .39 65 Small-Medium (27, 29) Frostig Visual Perceptual Training .10 54 Negligble-Small (30) ( ) = ES source listed in Appendix A

Page 19: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 19

Table 2

Effective Instructional Practices

______________________________________________________________________________

Practice Mean Effect Size Common Language Binomial Effect Size Effect Size Display

Success Rate Increase From % To % _____________________________________________________________________________________________ Mnemonic Instruction 1.62 .87 18 82 (39) Self-Monitoring 1.36 .83 22 78 (55, 58, 59) Reinforcement 1.17 .80 25 75 (58, 59, 64) Self-Questioning 1.16 .79 25 75 (55, 57) Drill & Practice .99 .76 28 72 (4, 58, 64) Strategy Instruction .98 .75 28 72 (55, 56, 57, 58) Feedback .97 .75 28 72 (58, 59, 64) Direct Instruction .93 .75 29 71 (1, 2, 65) Visual Displays .90 .74 29 71 (58) Computer-Assisted Instruction .87 .73 30 70 (47, 58) Repeated Reading .76 .71 32 68 (59, 61) Error Correction .72 .70 33 67 (58, 64) Tabled 2 continued on next page

Page 20: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 20

Table 2 (continued) Effective Instructional Practices

______________________________________________________________________________

Practice Mean Effect Size Common Language Binomial Effect Size Effect Size Display

Success Rate Increase From % To % _____________________________________________________________________________________________ Early Intervention .71 .70 33 60 (8, 23, 24, 49, 50, 51, 65) Formative Evaluation .70 .69 33 67 (18, 52) Peer Mediation .64 .67 35 65 (58, 59) Diagnostic-Prescriptive Teaching .64 .67 35 65 (58) Peer Tutoring .62 .67 35 65 (10, 41, 59) Positive Class Morale .60 .66 36 64 (64) Grouping .43 .62 40 60 (13, 14, 48) Cooperative Learning .40 .61 40 60 (7, 26, 53) Increased Time .38 .61 41 59 (64) ( ) = ES source listed in Appendix A

Page 21: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 21

Table 3

Effective Special Education Instruction _____________________________________________________________________________ Subject Area Mean Effect Percentile Rank Common Language Binomial Effect

Size Equivalent Effect Size Size Display Success Rate Increase

From % To % _____________________________________________________________________________ Handwriting 1.32 91 .82 22 78 (21, 56, 58) Oral Reading 1.31 90 .82 22 78 (9, 54, 59) Language 1.27 90 .82 23 77 (36, 43, 50) Reading Comprehension 1.04 85 .77 27 73 (40, 54, 60) Word Recognition .98 84 .75 28 72 (3, 54, 56) Narrative Writing .97 83 .75 28 72 (19, 21, 22) Math .96 83 .75 28 72 (35, 37, 67) Spelling .87 81 .73 30 70 (56, 58) Vocabulary .85 80 .73 30 70 (25, 54, 58) ( ) = ES source listed in Appendix A

Page 22: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 22

Table 4 Effective Special Education Related Services and Activities ______________________________________________________________________________ Service Mean Effect Size Common Language Binomial Effect Size

Effect Size Display Success Rate Increase

From % To % _____________________________________________________________________________________________ Memory Training 1.12 .79 25 75 (16, 58) Prereferral 1.10 .78 26 74 (5) Cognitive Behavior .74 .70 32 68 Modification (12, 46) Stimulant Medication .62 .67 35 65 (11, 28, 62) Counseling .60 .66 35 65 (58) Consultation .55 .65 36 64 (45, 58) Rational-Emotive Therapy .50 .64 38 62 (15, 20) Attribution Training .43 .62 39 61 (56, 58) Placement .12 .53 47 53 (6, 57, 63) ( ) = ES source listed in Appendix A

Page 23: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 23

References

Arter, J. A., & Jenkins, J. R. (1977). Examining the benefits and prevalence of modality

considerations in special education. Journal of Special Education, 11, 281-298.

Bickel, W. E., & Bickel, D. D. (1986). Effective schools, classrooms, and instruction:

Implications for special education. Exceptional Children, 52, 489-500.

Brophy, J., & Good, T. (1986). Teacher behavior and student achievement. In M.C. Wittrock

(Ed.), Handbook of research on teaching (Vol. 3, pp. 328-375). New York: Macmillan.

Christenson, S. L., Ysseldyke, J. E., & Thurlow, M. L. (1989). Critical instructional factors for

students with mild handicaps: An integrative review. Remedial and Special Education,

10, 21-31.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ:

Erlbaum.

Cooper, H., & Hedges, L. V. (Eds.). (1994). Handbook of research synthesis. New York: Sage.

Cooper, H. M., & Rosenthal, R. (1980). Statistical versus traditional procedures for summarizing

research findings. Psychological Bulletin, 87, 442-449.

Council for Learning Disabilities. (1986). Measurement and training of perceptual and

perceptual-motor functions: A position statement. Learning Disability Quarterly, 9, 247.

Finn, Jr., C.E., Rotherham, A.J., * Hakanson, Jr., C.R. (Eds.). (2001). Rethinking special

education for a new century. Washington, D.C.: Thomas B. Fordham Foundation.

Gage, N. L. (1978). The scientific basis of the art of teaching. New York: Teachers College

Press.

Gaynor, J. F. (1973). The “failure” of J. M. G. Itard. Journal of Special Education, 7, 439-445.

Gersten, R., Vaughn, S., Deshler, D., & Schiller, E. (1997). What we know about using research

Page 24: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 24

findings: Implications for improving special education practice. Journal of Learning

Disabilities, 30, 466-476.

Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher,

5, 3-8.

Glass, G. V. (1979). Policy for the unpredictable (uncertainty research and policy). Educational

Researcher, 8, 12-14.

Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly

Hills, CA: Sage.

Greenwood, C. R., & Abbott, M. (2001). The research to practice gap in special education.

Teacher Education and Special Education, 24, 276-289.

Hagin, R.A. (1973). Models of intervention with learning disabilities: Ephemeral and otherwise.

School Psychology Monograph, 1, 1-24.

Hammill, D. D., & Larsen, S. C. (1974). The effectiveness of psycholinguistic training.

Exceptional Children, 41, 5-14.

Hammill, D. D., & Larsen, S. C. (1978). The effectiveness of psycholinguistic training: A

reaffirmation of position. Exceptional Children, 44, 402-414.

Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA:

Academic Press.

Heward, W. L. (2003). Ten faulty notions about teaching and learning that hinder the

effectiveness of special education. Journal of Special Education, 36, 186-205.

Itard, J. M. G. (1806/1962). The wild boy of Areyron. (G. Humphrey & M. Humphrey, trans.).

New York: Appleton-Century-Crafts. (Original work published 1806).

Kauffman, J.M., & Hallahan, D.P. (1974). The medical model and the science of special

Page 25: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 25

education. Exceptional Children, 41, 97-102.

Kavale, K. A. (1981). Functions of the Illinois Test of Psycholinguistic Abilities (ITPA): Are

they trainable? Exceptional Children, 47, 496-510.

Kavale, K. A. (2001a). Meta-analysis: A primer. Exceptionality, 9, 177-183.

Kavale, K. A. (2001b). Decision making in special education: The function of meta-analysis.

Exceptionality, 9, 245-268.

Kavale, K. A. (1984). Potential advantages of the meta-analysis technique for research in special

education. The Journal of Special Education, 18, 61-72.

Kavale, K. A., & Forness, S. R. (1999). Efficacy of special education and related services.

Washington, D.C.: American Association on Mental Retardation.

Kavale, K. A., & Forness, S. R. (2000). History, rhetoric, and reality: Analysis of the inclusion

debate. Remedial and Special Education, 21, 279-296.

Kavale, K. A., & Reese, J. H. (1991). Teacher beliefs and perceptions about learning disabilities:

A survey of Iowa practitioners. Learning Disability Quarterly, 14, 141-160.

Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and

Psychological Measurement, 36, 746-759.

Larrivee, B. (1981). Modality preference as a model for differentiating beginning reading

instruction: A review of the issues. Learning Disability Quarterly, 4, 180-188.

Lindblom, C. E., & Cohen, D. K. (1979). Usable knowledge: Social science and social problem

solving. New Haven, CT: Yale University Press.

Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis (Vol. 49). Thousand Oaks, CA:

Sage.

Lund, K. A., Foster, G. E., & McCall-Perez, G. C. (1978). The effectiveness of psycholinguistic

Page 26: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 26

training: A reevaluation. Exceptional Children, 44, 310-319.

Mann, L. (1971). Psychometric phrenology and the new faculty psychology: The case against

ability assessment and training. Journal of Special Education, 5, 3-14.

Mann, L. (1979). On the trail of process: A historical perspective on cognitive processes and

their training. New York: Grune & Stratton.

Mastropieri, M. A., & Scruggs, T. E. (1991). Teaching students ways to remember: Strategies for

learning mnemonically. Cambridge, MA: Brookline Books.

McGraw, K. O., & Wong, S. P. (1992). A common language effect size. Psychological Bulletin,

111, 361-365.

Milofsky, C.D. (1974). Why special education isn’t special. Harvard Educational Review, 44,

437-458.

Minskoff, E. (1975). Research on psycholinguistic training: Critique and guidelines. Exceptional

Children, 42, 136-144.

Mostert, M. P. (1999-2000). A partial etiology and sequelae of discriminative disability:

Bandwagons and beliefs. Exceptionality, 8, 117-132.

Needels, M. C., & Gage, N. L. (1991). Essence and accident in process-product research on

teaching. In H. C. Waxman & H. J. Walberg (Eds.), Effective teaching: Current research

(pp. 3-31). Berkeley, CA: McCuthan.

Newcomer, P., Larsen, S., & Hammill, D. (1975). A response. Exceptional Children, 42, 144-

148.

Odom, S. L., Brantlinger, E., Gersten, R., Horner, R. H., Thompson, B., & Harris, K. R. (2005).

Research in special education: Scientific methods and evidence-based practices.

Exceptional Children, 71, 137-148.

Page 27: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 27

Reith, H. J., & Evertson, C. (1988). Variables related to the effective instruction of difficult-to-

teach children. Focus on Exceptional Children, 20, 1-8.

Reynolds, M. C., Wang, M. C., & Walberg, H. J. (1992). The knowledge bases for special and

general education. Remedial and Special Education, 13, 6-10, 33.

Rosenthal, R., & Rubin, D. B. (1982). A simple, general purpose display of magnitude of

experimental effect. Journal of Educational Psychology, 74, 166-169.

Sarason, S. B., & Doris, J. (1979). Educational handicap, public policy, and social history. New

York: Cambridge University Press.

Swanson, H. L. (1984). Does theory guide practice? Remedial and Special Education, 5(5), 7-16.

Tarver, S. G., & Dawson, M. M. (1978). Modality preference and the teaching of reading: A

review. Journal of Learning Disabilities, 11, 5-17.

U.S. Department of Education (1999). Assistance to states for the education of children with

disabilities program and the early intervention program for infants and toddlers with

disabilities: final regulations. Federal Register, 64 (48), CFR Parts 300 and 303.

Page 28: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 28

Appendix A

Reported Effect Size were obtained from the following sources:

(1) Adams, G. L, & Carnin, D. (2003). Direct Instruction. In

Adams, G. L., & Englemann, S. (1996). Research on Direct Instruction: 25 years beyond

DISTAR. Seattle, WA: Educational Achievement Systems.

Ang, R. P., & Hughes, J. N. (2002). Differential benefits of skills training with antisocial youth

based on group composition: A meta-analytic investigation. School Psychology Review,

31, 164-186.

Arnold, K. S., Myette, B. M., & Casto, G. (1986). Relationships of language intervention

efficacy to certain subject characteristics in mentally retarded preschool children: A

meta-analysis. Education and Training of the Mentally Retarded, 21, 108-116.

Beelman, A., Pfingsten, U., & Losel, F. (1994). Effects of training social competence in children:

A metaanalysis of recent evaluation studies. Journal of Clinical Psychology, 23, 260-271.

Borman, G. D., Hewes, G. M., Overman, L. T., & Brown, S. (2002). Comprehensive school

reform and student achievement: A meta-analysis (Report No. 59). Baltimore, MD:

Center for Research on Education of Students Paced At-Risk, Johns Hopkins University.

Browder, D. M., & Xin, Y. P. (1998). A meta-analysis and review of sight word research and its

implications for teaching functional reading to individuals with moderate and severe

disabilities. Journal of Special Education, 32, 130-153.

Burns, M. K. (2004). Empirical analysis of drill ratio research: Refining the instructional level

for drill tasks. Remedial and Special Education, 25, 167-173.

Burns, M. K., & Symington, T. (2002). A meta-analysis of prereferral intervention teams:

Student and systemic outcomes. Journal of School Psychology, 40, 437-447.

Page 29: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 29

Carlberg, C., & Kavale, K. (1980). The efficacy of special versus regular class placement for

exceptional children: A meta-analysis. Journal of Special Education, 14, 296-309.

Casto, G., & Mastropieri, M. A. (1986). The efficacy of early intervention programs: A meta-

analysis. Exceptional Children, 52, 417-424.

Conners, F. A. (1992). Reading instruction for students with moderate mental retardation:

Review and analysis of research. American Journal on Mental Retardation, 96, 577-597.

Cook, S. B., Scruggs, T. E., Mastropieri, M. A., & Casto, G. C. (1985-86). Handicapped students

as tutors. Journal of Special Education, 19, 483-492.

Crenshaw, T. M., Kavale, K. A., Forness, S. R., & Reeve, R. E. (1999). Attention deficit

hyperactivity disorder and the efficacy of stimulant medication: A meta-analysis. In T. E.

Scruggs & M. A. Mastropieri (Eds.), Advances in learning and behavioral disabilities

(Vol. 13, pp. 135-165). Stamford, CT: JAI Press.

de Castro, B., Veerman, J. W., Koops, W., Bosch, J. D., & Monshouwer, H. J. (2002). Hostile

attribution of intent and aggressive behavior: A meta-analysis. Child Development, 73,

916-934.

Didden, R., Duker, P. C., & Karzilius, H. (1997). Meta-analytic study on treatment effectiveness

for problem behaviors with individuals who have mental retardation. American Journal

on Mental Retardation, 101, 387-399.

Dunn, R., Griggs, S. A., Olson, J., Beasley, A., & Gorman, B. S. (1995). A meta-analytic

validation of the Dunn and Dunn model of learning style preferences. Journal of

Educational Research, 88, 353-362.

Durlak, J. A., Fuhrman, J., & Lampman, C. (1991). Effectiveness of cognitive-behavior therapy

for maladapting children: A meta-analysis. Psychological Bulletin, 110, 204-214.

Page 30: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 30

Elbaum, B., Vaughn, S., Hughes, M., Moody, S. W., & Schumm, J. S. (2000). How reading

outcomes of students with disabilities are related to instructional grouping formats: A

meta-analytic review. In R. Gersten, E. Schiller, & S. Vaughn (Eds.), Contemporary

Special Education Research (pp. 105-135). Mahwah, NJ: Erlbaum.

Engles, G. I., Garnefski, N., & Diekstra, R. F. W. (1993). Efficacy of rational emotive therapy: A

quantitive analysis. Journal of Consulting and Clinical Psychology, 61, 1083-1090.

Forness, S. R. (2001). Special education and related services: What have we learned from meta-

analysis? Exceptionality, 9, 185-198.

Forness, S. R., & Kavale, K. A. (1993). Strategies to improve basic learning and memory deficits

in mental retardation: A meta-analysis of experimental studies. Education and Training

in Mental Retardation, 28, 99-110.

Forness, S. R., & Kavale, K. A. (1996). Treating social skill deficits in children with learning

disabilities: A meta-analysis of the research. Learning Disability Quarterly, 19, 1-13.

Forness, S. R., Kavale, K. A., Blum, I. M., & Lloyd, J. W. (1997). Mega-analysis of meta-

analysis: What works in special education and related services. Teaching Exceptional

Children, 29, 4-9.

Forness, S. R., Kavale, K. A., Blum, I. M., & Lloyd, J. W. (1997). Mega-analysis of meta-

analysis: What works in special education and related services. Teaching Exceptional

Children, 29(6), 4-9.

Fuchs, L. S., & Fuchs, D. (1986b). Effects of systematic evaluation. A meta-analysis.

Exceptional Children, 53, 199-208.

Gersten, R., & Baker, S. (2001). Teaching expressive writing to students with learning

disabilities: A meta-analysis. Elementary School Journal, 101, 251-272.

Page 31: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 31

Glass, G. V., & Smith, M. L. (1979). Meta-analysis of research on class size and achievement.

Educational Evaluation and Policy Analysis, 1, 2-16.

Gonzalez, J. E., Nelson, J. R., Gutkin, T. B., Saunders, A., Galloway, A., & Shwery, G. S.

(2004). Rational emotive therapy with children and adolescents: A meta-analysis. Journal

of Emotional and Behavioral Disorders, 12, 222-235.

Gresham, F. M. (1998). Social skills training: Should we raze, remodel, or rebuild? Behavioral

Disorders, 24, 19-25.

Gresham, F. M., Sugai, G., & Horner, R. H. (2001). Interpreting outcomes of social skills

training for students with high-incidence disabilities. Exceptional Children, 67, 331-344.

Hedges, L. V., & Stock, W. A. (1983). The effects of class size: An examination of rival

hypotheses. American Educational Research Journal, 20, 63-85.

Hillocks, G. (1984). What works in teaching composition: A meta-analysis of experimental

treatment studies. American Journal of Education, 93, 133-170.

Horn, W. F., & Packard, T. (1985). Early identification of learning problems: A meta-analysis.

Journal of Educational Psychology, 77, 597-607.

Innocenti, M. S., & White, K. R. (1993). Are more intensive early intervention programs more

effective? A review of the literature. Exceptionality, 4, 31-50.

Joseph, L. M., & Scery, M. E. (2004). Where is the phonics? A review of the literature on the use

of phonetic analysis with students with mental retardation. Remedial and Special

Education, 25, 88-94.

Kavale, K. (1981a). Function of the Illinois Test of Psycholinguistic Abilities (ITPA). Are they

trainable? Exceptional Children, 47, 496-510.

Kavale, K. (1982a). The efficacy of stimulant drug treatment for hyperactivity: A meta-analysis.

Page 32: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 32

Journal of Learning Disabilities, 15, 280-289.

Kavale, K. (1982c). Psycholinguistic training programs: Are there differential treatment effects?

The Exceptional Child, 29, 21-30.

Kavale, K. A. (1984). A meta-analytic evaluation of the Frostig test and training program. The

Exceptional Child, 31, 134-141.

Kavale, K. A. (1990). Variances and verities in learning disability interventions. In T. E. Scruggs

& B. Y. L. Wong (Eds.), Intervention research in learning disabilities (pp. 3-33). New

York: Springer-Verlag.

Kavale, K. A., & Dobbins, D. A. (1993). The equivocal nature of special education interventions.

Early Child Development and Care, 86, 23-37.

Kavale, K. A., & Forness, S. R. (1983). Hyperactivity and diet treatment: A meta-analysis of the

Feingold hypothesis. Journal of Learning Disabilities, 16, 324-330.

Kavale, K. A., & Forness, S. R. (1987). Substance over style: Assessing the efficacy of modality

testing and teaching. Exceptional Children, 54, 228-239.

Kavale, K. A., & Forness, S. R. (2000). Policy decisions in special education: The role of

analysis. In R. Gersten, E. Schiller, & S. Vaughn (Eds.), Contemporary special education

research (pp. 281-326). Mahwah, NJ: Erlbaum.

Kavale, K. A., & Glass, G. V. (1982). The efficacy of special education interventions and

practices: A compendium of meta-analysis findings. Focus on Exceptional Children,

15(4), 1-14.

Kavale, K. A., & Glass, G. V. (1984). Meta-analysis and policy decisions in special education. In

B. K. Keogh (Ed.), Advances in special education (Vol. IV, pp. 195-247), Greenwich,

CT: JAI.

Page 33: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 33

Kavale, K. A., Mathur, S. R., Forness, R., Rutherford, R. B., & Quinn, M. M. (1997).

Effectiveness of social skills training for students with behavior disorders: A meta-

analysis. In T. E. Scruggs & M. A. Mastropieri (Eds.), Advances in learning and

behavioral disabilities (pp. 1-28). New York: Elsevier.

Kavale, K. A., & Mattson, P. D. (1983). “One jumped off the balance beam”: Meta-analysis of

perceptual-motor training. Journal of Learning Disabilities, 16, 165-173.

Kroesbergen, E. H., & VanLuit, J. E. H. (2003). Mathematics interventions for children with

special educational needs: A meta-analysis. Remedial and Special Education, 24, 97-114.

Lapadat, J. C. (1991). Pragmatic language skills of students with language and/or learning

disabilities: A quantitative synthesis. Journal of Learning Disabilities, 24, 147-158.

Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and

behavioral treatment. American Psychologist, 48, 1181-1209.

Mastropieri, M. A., Bakken, J. P., & Scruggs, T. E. (1991). Mathematics instruction for

individuals with mental retardation: A perspective and research synthesis. Education and

Training in Mental Retardation, 26, 115-129.

Mastropieri, M. A., & Scruggs, T. E. (1985-86). Early intervention for socially withdrawn

children. Journal of Special Education, 19, 429-441.

Mastropieri, M. A., Scruggs, T. E., & Casto, G. (1985). Early intervention for behaviorally

disordered children: An integrative review. Behavior Disorders Monograph, 11, 27-35.

Mastropieri, M. A., Scruggs, T. E., & Casto, G. (1985-86). Early intervention for behaviorally

disordered children: An integrative review [Monograph]. In R. B. Rutherford, Jr. (Ed.),

Monographs in behavior disorders (pp. 27-35). Tempe, AZ: Council for Children with

Behavior Disorders.

Page 34: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 34

Mathur, S. R., Kavale, K. A., Quinn, M. M., Forness, S. R., & Rutherford, R. B. (1998). Social

skills interventions with students with emotional and behavioral problems: A quantitative

synthesis of single-subject research. Behavioral Disorders, 23, 193-201.

Niemiec, R., & Walberg, H. J. (1987). Comparative effects of computer-assisted instruction: A

synthesis of reviews. Journal of Educational Computing Research, 3, 19-37.

Nye, C., Foster, S. H., & Seaman, D. (1987). Effectiveness of language intervention with the

language/learning disabled. Journal of Speech and Hearing Disorders, 52, 348-357.

Quinn, M. M., Kavale, K. A., Mathur, S., Rutherford, R. B., & Forness, S. R. (1999). A meta-

analysis of social skill interventions for students with emotional or behavioral disorders.

Journal of Emotional and Behavioral Disorders, 7, 54-64.

Robinson, T. R., Smith, S. W., Miller, M. D., & Brownell, M. T. (1999). Cognitive behavior

modification of hyperactivity-impulsivity and aggression: A meta-analysis of school-

based studies. Journal of Educational Psychology, 91, 195-203.

Schmidt, M., Weinstein, T., Niemic, R., & Walberg, H. J. (1985-86). Computer-assisted

instruction with exceptional children. Journal of Special Education, 19, 494-501.

Schumm, J. S., Moody, S. W., & Vaughn, S. (2000). Grouping for reading instruction: Does one

size fit all? Journal of Learning Disabilities, 33, 477-488.

Scotti, J. R., Evans, I. M., Meyer, L. H., & Walker, P. (1991). A meta-analysis of intervention

research with problem behavior: Treatment validity and standards of practice. American

Journal on Mental Retardation, 96, 233-256.

Scruggs, T. E., Mastropieri, M. A., Cook, S., & Escobar, C. (1986). Early intervention for

children with conduct disorders: A quantitative synthesis of single-subject research.

Behavioral Disorders, 11, 260-271.

Page 35: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 35

Scruggs, T. E., Mastropieri, M. A., Forness, S. R., & Kavale, K. A. (1988). Early language

intervention: A quantitative synthesis of single-subject research. Journal of Special

Education, 22, 259-283.

Shonkoff, J. P., & Hauser-Cram, P. (1987). Early intervention for disabled infants and their

families: A quantitative analysis. Pediatrics, 80, 650-658.

Skiba, R. J., & Casey, A. (1985). Interventions for behaviorally disordered students: A

quantitative review and methodological critique. Behavioral Disorders, 10, 239-252.

Smith, M. L., & Glass, G. V. (1980). Meta-analysis of research on class size and related

estimators. American Educational Research Journal, 17, 419-433.

Smith, M. S., Glass, G. V., & Miller, T. I. (1980). The benefits of psychotherapy. Baltimore:

Johns Hopkins University Press.

Soto, G., Toro-Zambrana, W., & Belfiore, P. J. (1994). Comparison of two instructional

strategies on social skills acquisition and generalization among individuals with moderate

and severe mental retardation working in a vocational setting: A meta-analytical review.

Education and Training in Mental Retardation and Developmental Disabilities, 29, 307-

320.

Swanson, H. L. (1999). Interventions for students with learning disabilities: A meta-analysis of

treatment outcomes. New York: Guilford.

Swanson, H. L. (1999). Reading research for students with LD: A meta-analysis of intervention

outcomes. Journal of Learning Disabilities, 32, 504-532.

Swanson, H. L. (2001). Research on interventions for adolescents with learning disabilities: A

meta-analysis of outcomes related to higher-order processing. Elementary School

Journal, 101, 331-348.

Page 36: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 36

Swanson, H. L., Carson, C., & Sachsee-Lee, C. M. (1996). A selective synthesis of intervention

research for students with learning disabilities. School Psychology Review, 25, 370-391.

Swanson, H. L., & Hoskyn, M. (1998). Experimental intervention research on students with

learning disabilities: A meta-analysis of treatment outcomes. Review of Educational

Research, 68, 277-321.

Swanson, H. L., & Hoskyn, M. (2000). Intervention research for students with learning

disabilities: A comprehensive meta-analysis of group design studies. In T. E. Scruggs &

M. A. Mastropieri (Eds.), Advances in learning and behavioral disabilities (Vol. 14, pp.

1-153). Stamford, CT: JAI Press.

Swanson, H. L., O’Shaughnessy, T. E., McMahon, C. M., Hoskyn, M., & Sachsee-Lee, C. M.

(1998). A selective synthesis of single subject design intervention research on students

with learning disabilities. In T. E. Scruggs & M. A. Mastropieri (Eds.), Advances in

learning and behavioral disabilities (Vol. 12, pp. 79-126). Greenwich, CT: JAI Press.

Therrien, W. J. (2004). Fluency and comprehension gains as a result of repeated readings: A

meta-analysis. Remedial and Special Education, 25, 252-261.

Thurber, S., & Walker, C. E. (1983). Medication and hyperactivity: A meta-analysis. Journal of

General Psychology, 108, 79-86.

VanIjzendoorn, M. H., & Bus, A. G. (1994). Meta-analytic confirmation of the nonword reading

deficit in developmental dyslexia. Reading Research Quarterly, 29, 267-275.

Vaughn, S., Gersten, R., & Chard, D. J. (2000). The underlying message in LD intervention

research: Findings from research syntheses. Exceptional Children, 67, 99-114.

Walberg, H. J. (1984). Improving the productivity of America’s schools. Educational

Leadership, 41, 19-30.

Page 37: Meta-Analysis 1 1 Quantitative ... Meta-analysis and the Efficacy of Special Education Psycholinguistic Training ... and Manual Expression), however, ...

Meta-Analysis 37

Wang, M. C., & Baker, E. T. (1985-86), Mainstreaming programs: design features and effects,

Journal of Special Education, 19, 503-521.

Waxman, H. C., Wang, M. C., Anderson, K. A., & Walberg, H. J. (1985). Adaptive education

and student outcomes: A quantitative synthesis. Journal of Educational Research, 78,

228-236.

Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of

psychotherapy with children and adolescents revisited: A meta-analysis of treatment

outcome studies. Psychological Bulletin, 117, 450-468.

White, K. R. (1985-86). Efficacy of early interventions. Journal of Special Education, 19, 401-

416.

White, W. A. T. (1988). A meta-analysis of the effects of direct instruction in special education,

Education and Treatment of Children, 11, 364-374.

Whiteley, B. E., & Frieze, I. H. (1985). Children’s causal attributions for success and failure in

achievement settings: A meta-analysis. Journal of Educational Psychology, 77, 608-616.

Wilson, S. J., Lipsey, M. W., & Derzon, J. (2003). The effects on aggressive behavior: A meta-

analysis. Journal of Consulting and Clinical Psychology, 71, 136-149.

Xin, Y. P., & Jitendra, A. K. (1999). The effects of instruction in solving mathematical word

problems for students with learning problems: A meta-analysis. Journal of Special

Education, 32, 207-225.


Recommended