+ All Categories
Home > Documents > The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name...

The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name...

Date post: 23-Aug-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
25
1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle Park, North Carolina, USA 27709 Phone 919 485-7705 e-mail [email protected] Fax 919 485-5740 The Challenges of Conducting Child Assessments in a Home Environment with Lay Interviewers Amanda Meehan and Leslie Erickson May 2007
Transcript
Page 1: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

1

RTI

Inte

rnat

iona

l is

a tra

de n

ame

of R

esea

rch

Tria

ngle

Inst

itute

3040

Cor

nwal

lis R

oad

P.O

. Box

121

94

■R

esea

rch

Tria

ngle

Par

k, N

orth

Car

olin

a, U

SA

277

09

P

hone

919

485

-770

5 e-

mai

l am

eeha

n@rti

.org

Fax

919

485-

5740

The

Cha

lleng

es o

f Con

duct

ing

Chi

ld

Ass

essm

ents

in a

Hom

e En

viro

nmen

t w

ith L

ay In

terv

iew

ers

Am

anda

Mee

han

and

Lesl

ie E

ricks

onM

ay 2

007

Page 2: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

2

Ove

rvie

w

!C

halle

nges

of a

dapt

ing

child

ass

essm

ents

to b

e co

nduc

ted

in a

hom

e en

viro

nmen

t

!R

ecru

iting

fiel

d in

terv

iew

ers

(FIs

) to

cond

uct c

hild

as

sess

men

ts

!D

evel

opin

g ch

ild a

sses

smen

t tra

inin

g

!M

onito

ring

data

qua

lity

!Le

sson

s Le

arne

d

Page 3: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

3

Expe

rienc

e w

ith u

sing

Chi

ld A

sses

smen

ts

!R

TI s

tudi

es th

at in

clud

e ch

ild a

sses

smen

ts:

!Ea

rly C

hild

hood

Lon

gitu

dina

l Stu

dy B

irth

Coh

ort (

ECLS

-B) �

Spon

sore

d by

Nat

iona

l Cen

ter f

or E

duca

tion

Stat

istic

s

!N

atio

nal S

tudy

of C

hild

and

Ado

lesc

ent W

ell-B

eing

(NSC

AW)

�Sp

onso

red

by A

dmin

istra

tion

on C

hild

ren

and

Fam

ilies

!C

hild

and

Fam

ily W

ell-B

eing

Stu

dy (C

FW) �

Spon

sore

d by

N

atio

nal I

nstit

ute

of C

hild

Hea

lth a

nd H

uman

Dev

elop

men

t

!Lo

s An

gele

s Fa

mily

and

Nei

ghbo

rhoo

d Su

rvey

(LA

Fans

) �Sp

onso

red

by R

and

Cor

pora

tion

Page 4: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

4

Hom

e-B

ased

Chi

ld A

sses

smen

ts

!C

hild

ass

essm

ents

wer

e in

itial

ly d

evel

oped

to b

e co

nduc

ted

by c

linic

ians

in c

ontro

lled

setti

ngs.

!Tr

ends

in s

urve

y re

sear

ch s

how

a c

hang

e in

this

tra

ditio

nal m

etho

d of

con

duct

ing

child

ass

essm

ents

.

!In

crea

sing

ly, s

urve

y re

sear

ch s

tudi

es a

re re

quiri

ng

that

chi

ld a

sses

smen

ts ta

ke p

lace

in a

hom

e en

viro

nmen

t.

Page 5: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

5

Cha

lleng

es In

Usi

ng C

hild

Ass

essm

ents

in

Hom

e En

viro

nmen

ts

!A

dmin

istra

tion

mod

e ch

alle

nges

!A

sses

smen

t cop

yrig

hts

!D

evel

opm

ent t

ime

for i

nstru

men

ts a

nd tr

aini

ng

mat

eria

ls

!D

evel

opin

g a

train

ing

plan

to tr

ain

lay

inte

rvie

wer

s to

co

nduc

t chi

ld a

sses

smen

ts w

ithou

t com

prom

isin

g qu

ality

relia

bilit

y an

d va

lidity

of m

easu

res

Page 6: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

6

Adm

inis

tratio

n M

ode

Cha

lleng

es

!Th

e ch

osen

chi

ld a

sses

smen

t adm

inis

tratio

n m

ode

shou

ld ta

ke

into

acc

ount

oth

er d

utie

s pe

rform

ed b

y FI

.

!C

hild

ass

essm

ent a

dmin

istra

tion

shou

ld b

e si

mpl

ified

whe

re

poss

ible

with

out s

acrif

icin

g re

liabi

lity

and

valid

ity o

f the

mea

sure

!If

FIs

are

com

plet

ing

mul

tiple

task

s do

not

ove

rbur

den

them

with

mak

ing

the

child

ass

essm

ent a

dmin

istra

tion

com

plic

ated

.

!D

ata

qual

ity s

houl

d be

a fa

ctor

whe

n de

term

inin

g th

e ad

min

istra

tion

mod

e.

Page 7: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

7

Ass

essm

ent C

opyr

ight

s

!N

eed

to g

et p

ublis

her p

erm

issi

on to

use

chi

ld a

sses

smen

ts,

whi

ch m

ay b

e co

stly

!D

eter

min

e ot

her t

ools

are

nee

ded

othe

r tha

n ch

ild a

sses

smen

t ea

sel(

i.e.:

inst

ruct

ion

man

uals

, sc

orin

g sh

eets

)

!D

eter

min

e ad

min

istra

tion

or u

sage

fees

!D

eter

min

e if

asse

ssm

ent i

s av

aila

ble

in o

ther

lang

uage

s be

side

s En

glis

h

!Al

low

eno

ugh

time

in p

roje

ct s

ched

ule

for a

ppro

val d

elay

s

Page 8: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

8

Prep

arat

ion

Tim

e to

Impl

emen

t Stu

dy

!A

llow

for e

noug

h pr

epar

atio

n tim

e to

impl

emen

t stu

dy

desi

gn.

!D

evel

op d

etai

led

proj

ect s

ched

ule

and

train

ing

plan

.

!Tr

aini

ng p

lan

shou

ld a

ccou

nt fo

r the

exp

erie

nce

leve

l(s) o

f you

r fie

ld in

terv

iew

ers

Page 9: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

9

Exam

ples

of A

sses

smen

ts U

sed

at R

TI

!P

eabo

dy P

ictu

re V

ocab

ular

y Te

st!

Cog

nitiv

e vo

cabu

lary

test

to m

easu

re re

cept

ive

voca

bula

ry a

nd a

scr

eeni

ng te

st o

f ver

bal a

bilit

y.

!P

reLA

S !

Asse

ss o

ral l

angu

age

prof

icie

ncy

in y

oung

chi

ldre

n

!B

ayle

y In

fant

Neu

rode

velo

pmen

tal S

cree

ner (

BIN

S)

!C

ogni

tive

asse

ssm

ent t

hat s

cree

ns in

fant

s fo

r ne

urol

ogic

al im

pairm

ent o

r dev

elop

men

tal d

elay

Page 10: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

10

Exam

ples

of A

sses

smen

ts U

sed

at R

TI (c

ont.)

!Ka

ufm

an B

rief I

ntel

ligen

ce T

est (

K-BI

T)

!M

easu

res

cogn

itive

ver

bal a

nd n

on-v

erba

l ass

essm

ent

!Ba

ttelle

Dev

elop

men

tal I

nven

tory

(BD

I)!

Mea

sure

s pe

rson

al-s

ocia

l, ad

aptiv

e, m

otor

, co

mm

unic

atio

n, a

nd c

ogni

tive

abilit

y

!W

oodc

ock-

John

son

!M

easu

res

gene

ral i

ntel

lect

ual a

bilit

y, s

peci

fic c

ogni

tive

abilit

ies,

sch

olas

tic a

ptitu

de, o

ral l

angu

age,

and

ac

adem

ic a

chie

vem

ent

Page 11: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

11

Rec

ruiti

ng F

ield

Inte

rvie

wer

s to

Con

duct

C

hild

Ass

essm

ents

!D

eter

min

e sk

ill s

et n

eede

d or

requ

ired

by F

I.

!W

hat e

duca

tiona

l bac

kgro

und

is n

eede

d by

FI?

!W

hat o

ther

dut

ies

will

FI n

eed

to p

erfo

rm in

add

ition

to

child

ass

essm

ent (

i.e. i

n-pe

rson

trac

ing,

refu

sal

conv

ersi

on, c

ondu

ct o

ther

type

s of

inte

rvie

ws

with

pa

rent

s/ch

ild g

iver

s)?

!Is

the

stud

y lo

ngitu

dina

l?

!W

hat i

s th

e bu

dget

ed p

ay ra

te?

Page 12: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

12

Pros

and

Con

s of H

iring

a M

ore

Expe

rienc

ed F

I R

egar

dles

s of

Chi

ldho

od E

duca

tion

Bac

kgro

und

Pro

s

!S

trong

at c

onta

ctin

g an

d lo

catin

g re

spon

dent

s

!S

trong

at c

onve

rting

refu

sals

!Ty

pica

lly w

ork

on a

var

iety

of

rese

arch

stu

dies

and

are

tra

inab

le

!C

an d

evel

op a

goo

d ra

ppor

t with

re

spon

dent

s an

d w

ork

hard

to

get t

heir

foot

in th

e do

or

!G

ood

at m

ulti-

task

ing

Con

s

!O

ften

do n

ot h

ave

a sp

ecifi

c ba

ckgr

ound

in c

hild

hood

ed

ucat

ion

or in

con

duct

ing

child

as

sess

men

ts

!S

ome

may

lack

rapp

ort t

o w

ork

with

chi

ldre

n

!E

xtra

trai

ning

tim

e is

nee

ded

to

train

FIs

to w

ork

with

m

anip

ulat

ives

use

d in

chi

ld

asse

ssm

ents

Page 13: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

13

Pros

and

Con

s of H

iring

Inex

perie

nced

FI w

ith

Chi

ldho

od E

duca

tion

Bac

kgro

und

Pros

!Fa

milia

r with

chi

ld

asse

ssm

ents

and

thei

r in

tent

ion

!D

o no

t nee

d as

muc

h tra

inin

g in

how

to c

ondu

ct c

hild

as

sess

men

ts

!St

rong

rapp

ort w

ith c

hild

ren

!U

nder

stan

d sc

orin

g co

ncep

ts

of c

hild

ass

essm

ent

Con

s

!N

o di

rect

exp

erie

nce

with

ho

useh

old

inte

rvie

win

g te

chni

ques

!N

o st

rong

trac

ing

or re

fusa

l co

nver

sion

ski

lls

!Ex

perie

nce

may

lead

them

to

ques

tion

and

inte

rpre

t chi

ld

asse

ssm

ent r

esul

ts in

way

s th

at w

ould

affe

ct th

e re

liabi

lity

and

valid

ity o

f the

m

easu

re

Page 14: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

14

Trai

ning

Des

ign

!N

eed

ampl

e tim

e to

dev

elop

det

aile

d tra

inin

g m

ater

ials

!C

hoos

e tra

inin

g te

chni

ques

that

sho

w th

e be

st w

ay to

ad

min

iste

r ass

essm

ents

!A

llow

eno

ugh

time

for t

horo

ugh

train

ing

and

certi

ficat

ion

Page 15: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

15

Trai

ning

App

roac

hes

!H

ome

stud

y pr

actic

e

!In

-per

son

lect

ure

!C

hild

ass

essm

ent d

emon

stra

tion

with

trai

ners

or w

ith

child

!V

ideo

dem

onst

ratio

ns

!H

ands

-on

prac

tice

at tr

aini

ng (r

ound

-robi

n an

d pa

ired

prac

tice)

!S

tudy

Hal

l

Page 16: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

16

Chi

ld A

sses

smen

t Cer

tific

atio

ns

!S

tudi

es th

at u

se c

hild

ass

essm

ents

are

com

plex

.

!C

ertif

icat

ions

do

two

thin

gs:

1.H

elp

inte

rvie

wer

s to

feel

com

forta

ble

cond

uctin

g as

sess

men

ts, a

nd

2.R

eass

ure

proj

ect s

taff

that

FIs

can

con

duct

as

sess

men

ts a

ccor

ding

to p

roje

ct p

roto

cols

.

!C

ompr

ehen

sive

cer

tific

atio

ns w

ill im

prov

e th

e qu

ality

of

dat

a in

the

field

.

Page 17: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

17

Dev

elop

ing

Cer

tific

atio

ns

!C

hild

Ass

essm

ent e

xper

t nee

ded

to c

ertif

y tra

inin

g te

am

!N

eed

thor

ough

inst

ruct

ions

and

mat

eria

ls

!In

clud

e al

l ass

essm

ents

bei

ng a

dmin

iste

red

!A

gend

a m

ust i

nclu

de s

uffic

ient

tim

e fo

r cer

tific

atio

ns

and

re-c

ertif

icat

ions

Page 18: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

18

Exam

ple

of C

hild

Ass

essm

ent C

ertif

icat

ion

Que

stio

nsC

ER

TIF

IER

S:

SAY

: W

e w

ill b

egin

with

the

Lan

guag

e an

d L

itera

cy s

ectio

ns. Y

ou w

ill p

rete

nd th

at I

am

th

e ch

ild. A

dmin

iste

r th

e ite

ms

usin

g th

e ea

sel a

nd th

e la

ptop

her

e, ju

st a

s w

e do

in

the

field

.

A.

LL

30

FI S

HO

ULD

: SW

EEP

HA

ND

IN C

IRC

ULA

R M

OTI

ON

AR

OU

ND

TH

E PA

GE

AN

D

SAY:

Poi

nt to

dre

ssin

g.

CE

RT

IFIE

R: P

OIN

T T

O Q

UA

DR

AN

T 2

(LE

AV

ING

)

FI S

HO

ULD

EN

TER

2

�CH

ILD

PO

INTS

TO

QU

AD

RA

NT

2 (L

EAV

ING

)�,

SCO

RE

(CIR

CLE

YES

OR

NO

FO

R E

AC

H IT

EM A

ND

EN

TER

SC

OR

E):

C

ircle

One

En

ter S

cor e

1.

Adm

inis

tere

d ite

m v

erba

tim (1

PO

INT

).....

......

......

......

......

......

......

.Yes

.....

No

......

......

..__

____

2.

Swep

t han

d in

circ

ular

mot

ion

with

out s

topp

ing

or li

nger

ing

on a

ny o

ne re

spon

se (1

PO

INT

)....

......

......

......

......

......

......

......

......

..Yes

.....

No

......

......

..__

____

3.

Prop

erly

ent

ered

resp

onse

(1 P

OIN

T).

......

......

......

......

......

......

......

..Yes

.....

No

......

......

..__

____

B.

LL

33

FI S

HO

ULD

: SW

EEP

HA

ND

IN A

CIR

CU

LAR

MO

TIO

N A

RO

UN

D T

HE

RES

PON

SE A

REA

AN

DSA

Y: P

oint

to fr

uit.

CE

RT

IFIE

R: J

UST

LO

OK

AT

PIC

TU

RE

S. D

O N

OT

SA

Y A

NY

TH

ING

. IF

FI P

RO

MPT

S (R

EPE

AT

S IT

EM

), D

O N

OT

SA

Y A

NY

TH

ING

AG

AIN

.

FI S

HO

ULD

EN

TER

�7

CH

ILD

DO

ES N

OT

RES

PON

D�

Page 19: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

19

Mon

itorin

g th

ose

FIs W

ho S

trugg

le w

ith

Pass

ing

Cer

tific

atio

n

!S

igni

fican

t mon

ey a

nd ti

me

go in

to re

crui

ting

and

train

ing

staf

f.

!If

an F

I is

stru

gglin

g or

can

not p

ass

certi

ficat

ion

othe

r op

tions

afte

r tra

inin

g ca

n be

impl

emen

ted.

!FI

s ca

n be

giv

en a

dditi

onal

pra

ctic

e an

d re

-cer

tifie

d by

th

eir s

uper

viso

r afte

r tra

inin

g.

!FI

s ca

n sh

adow

oth

er F

Is to

feel

com

forta

ble

cond

uctin

g as

sess

men

ts.

Page 20: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

20

Mai

ntai

ning

Dat

a Q

ualit

y

!M

onito

r dat

a qu

ality

repo

rts a

nd te

leph

one

verif

icat

ion

resu

lts

!R

evie

w C

ompu

ter A

udio

Rec

ordi

ng In

terv

iew

(CA

RI)

files

!R

evie

w d

ata

cons

iste

ncy

chec

ks

!O

bser

ve in

terv

iew

ers

in th

e fie

ld

!S

end

out d

ata

qual

ity n

ewsl

ette

rs to

all

field

sta

ff

!Fo

llow

-up

with

FIs

ofte

n on

dat

a qu

ality

issu

es

Page 21: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

21

Oth

er T

hing

s to

Con

side

r

!S

corin

g of

chi

ld a

sses

smen

ts

!D

evel

opin

g tra

inin

g vi

deos

Page 22: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

22

Less

ons L

earn

ed

!R

ecru

iting

and

Hiri

ng: C

hild

ass

essm

ent e

xper

ienc

e is

no

t nec

essa

ry

!Tr

aini

ng m

ater

ials

mus

t be

clea

r to

a la

yper

son

!C

ertif

icat

ion

is a

crit

ical

com

pone

nt to

the

train

ing

proc

ess

!K

eep

com

preh

ensi

ve re

cord

s of

cer

tific

atio

n an

d fie

ld

oper

atio

n gu

idan

ce to

dem

onst

rate

qua

lity.

!M

onito

r dat

a qu

ality

car

eful

ly o

nce

in th

e fie

ld

Page 23: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

23

Chi

ld A

sses

smen

t Ref

eren

ces

!P

eabo

dy P

ictu

re V

ocab

ular

y Te

st (P

PVT

) �D

unn

& D

unn,

199

7, P

ears

on A

sses

smen

ts.

!P

reLA

S 20

00 �

Dun

can

& D

eAvi

la, 2

003,

C

TB/M

cGra

w-H

ill.

!B

ayle

y In

fant

Neu

rode

velo

pmen

tal S

cree

ner (

BIN

S) �

Ayl

war

d, 1

995,

Har

cour

t Ass

essm

ent.

Page 24: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

24

Chi

ld A

sses

smen

t Ref

eren

ces (

cont

.)

!K

aufm

an B

rief I

ntel

ligen

ce T

est (

K-B

IT) �

Kau

fman

19

90, P

ears

on A

sses

smen

ts.

!B

atte

lle D

evel

opm

enta

l Inv

ento

ry (B

DI)

�N

ewbo

rg,

Sto

ck, W

nek,

Gui

duba

ldi,

& S

vini

cki,

1988

, Riv

ersi

de

Pub

lishi

ng.

!W

oodc

ock-

John

son

�, W

oodc

ock,

McG

rew

, & M

athe

r,

Riv

ersi

de P

ublis

hing

.

Page 25: The Challenges of Conducting Child Assessments in a Home ... · 1 RTI International is a trade name of Research Triangle Institute 3040 Cornwallis Road P.O. Box 12194 Research Triangle

25

Con

tact

Info

rmat

ion

Am

anda

Mee

han

RTI

Inte

rnat

iona

l

919-

485-

7705

amee

han@

rti.o

rg

Pre

sent

atio

n av

aila

ble

at: w

ww

.rti.o

rg/if

dtc


Recommended