31
TR Assessments – Moving From Paper & Pencil to iPads Randy Wyble, MS, CTRS Roy H. Olsson, Jr., Ph.D., CTRS
TR Assessments – Moving From Paper & Pencil to
iPads
Randy Wyble, MS, CTRS
Roy H. Olsson, Jr., Ph.D., CTRS
A copy of this presentation can be found at:
www.gvsu.edu/tr
About>Faculty/Staff and then scroll down to Randy’s profile
Learning Objectives
• Identify the different domains of the Recreation Profile Inventory (RPI) assessment app
• Administer and retrieve results using the RPI assessment app
• Identify three ways in which the app could be redesigned for future use
• Identify one example of the role the app could play in their own assessment process
Session Overview
• Development of the Recreational Profile Inventory and relevant research
• Development of the RPI app
• Hands on experience with provided iPads (or download onto your own from the App store)
• Generated report
• Further development….we need your input!
Development of the Recreational Profile Inventory and Relevant Research
Functional Living Skills
Assessment Parameters
M
SD
COTES
Parameters
M
SD
Statistical Relationship
r T p
I. New learning 3.0 0.43 I. Initial learning 2.3 0.97 0.87 8.5 <0.001
2. Organization of
time and material
2.7
1.0
2. Complexity and
organization of task
2.9
1.0
0.91
10.8
<0.001
3. Following directions 3.3 0.88 3. Following directions 3.2 0.85 0.93 12.4 <0.001
4. Decision making 1.8 1.8 4. Decision making 2.0 1.6 0.98 23.8 <.001
5. Problem solving 2.5 1.3 5. Problem solving 2.2 1.2 0.94 13.3 <0.001
6. Reality orientation 1.0 0.99 6. Reality orientation 1.1 0.89 0.91 10.8 <0.001
7. Attention span 1.3 1.6 7. Concentration 1.6 1.5 0.97 18.3 <0.001
8. Motor performance 1.7 1.5 8. Coordination 1.8 1.4 0.94 12.9 <0.001
9. Self-esteem 0.58 0.56 9. Appearance + negative
response from others + self-asserting
(X = total number/3)
0.45
0.44
0.94
13.6
<0.001
10. Motivation 1.2 0.68 10. Punctuality + engagement
+ activity neatness + attention to detail + interest in activity + interest or accomplishment
(X = total number/6)
1.3
0.52
0.88
9.0
<0.001
11. Frustration tolerance
1.1 1.6 11. Frustration tolerance 0.96 1.4 0.97 21.7 <0.001
12. Nonproductive
behavior
0.46 0.50 12. Nonproductive behavior 0.46 0.50 1.0 IO.I <0,001
TABLE 1
Criterion-Related Validity: Functional Living Skills Assessment to
Comprehensive Occupational Therapy Evaluation Scale on Select Parameters
Study 3; CVA and TBI
N = 21
Functional skills
Study 1
(N = 39)
Study 2
(N = )
Short-term visual memory 1.0 0.966
Organization of time and materials 0.895 0.915
Following directions 0.946 0.952
Long-term memory 0.991 1.0
Decision making 1.0 0.990
Money management 1.0 1.0
Reality orientation 1.0 1.0
Short-term verbal memory 0.986 0.994
Attention span 0.998 0.951
Motor performance 0.989 0.978
Behavior skills
Appearance 1.0 1.0
Motivation 0.948 0.979
Frustration tolerance 0.977 1.0
Nonproductive behavior 0.943 0.977
Social/Communication skills
Verbal communication 1.0 1.0
Interaction skills 1.0 0.988
Attention seeking 1.0 1.0
Nonverbal communication 1.0 1.0
Self-assertion 1.0 1.0
Study I: Moderate to mild MR and CP
Study 2: CVA and Alzheimer's long-term care
TABLE 2
Interrater Reliability for Select Parameters
from the Functional Living Skills Assessment
Parameter
Observer 1 Observer 2 Statistical Analyses
M SD M SD r T SD
1. New learning
2.
3.0 0.43 3.1 0.79 0.97 10.9 <0.001
2. Organization of time and material 2.7 1.0 2.8 1.1 0.97 18.7 <0.001
3. Following directions 3.3 0.88 3.3 0.88 1.0 10.1 <0.001
4. Old learning 2.2 1.3 2.3 1.3 0.99 33.7 <0.001
5. Decision making 1.8 1.8 1.8 1.8 0.99 44.7 <0.001
6. Problem solving 2.5 1.3 2.4 1.5 0.98 23.9 <0.001
7. Money management 3.2 0.90 3.3 0.92 0.98 22.5 <0.001
8. Reality orientation 1.0 0.99 1.0 0.99 1.0 10.1 <0.001
9. Retention span 3.0 0.87 2.9 1.0 0.93 12.6 <0.001
10. Attention span 1.3 1.6 1.3 1.6 0.99 10.l <0.001
11. Motor performance 1.7 1.5 1.7 1.5 1.0 72.3 <0.001
12. Self-esteem 0.58 0.50 0.58 0.50 1.0 10.1 <0.001
13. Motivation 1.2 0.68 1.1 0.75 0.93 12.5 <0.001
14. Frustration tolerance 1.1 1.6 1.0 1.6 0.98 23.3 <0.001
15. Nonproductive behavior 0.46 0.50 0.46 0.50 1.0 10.1 <0.001
TABLE 3
Interrater Reliability for Select Parameters from the
Functional Living Skills Assessment
Study 3; CVA and TBI
N = 21
Parameters
Cognitive Behavior
ORG FD OL DM PS MM RO RS AS MP MOT FT NP
Cognitive
New learning
Organization of
time and materials
Following directions
Old learning Decision
making Problem
solving Money
management Reality
orientation Retention
span Attention span
Behavior
Self-esteem
Motivation Frustration
tolerance
.65
.78
.75
.48
.80
.66
.56
.68
.43
.74
.72
.55
.70
.74
.70
.65
.40
.42
.82
.69
.66
.68
.71
.31
,68
.73
.53
.70 .42 .68 .64 .61 .41 .56
.43 .73 .44 .52 .48 .61
.56 .51 .60 .39 .72
.33 .66 .51 .53
.40 .50 .37
.61 .67
.43
.59 .63 .61
.68 .52
.56
TABLE 4
Intercorrelations of Functional Parameters
ORG = organization of time and materials, FD = following directions, OL = old learning, DM = decision making,
PS = problem solving, MM = money management, RO = reality orientation, RS = retention span, AS = attention span, MP =
motor performance, MOT = motivation, FT = frustration tolerance, NP = nonproductive behavior
RLP Mirenda
rho = 1.0
p <0.01
Interest Area RLP Interest Area Mirenda X Rank X Rank
Sports Sports 30.6 5 35.1 5
Games Games 22.3 2 30.3 2
Crafts Crafts 14.0 1 28.1 1
Expression Art and music 24.5 3 31.1 3
Community Education/entertainment/
culture and nature
divided by 2
27.3
4
34.1
4
TABLE 5
Validity Correlation between the Recreation and Leisure Profile
and the Mirenda for Select Activity Interest Areas
N = 60 adults, male subjects = 27, female subjects = 33, age range 27-61, n = 44
High scores/ranges indicate highest interest
RLP Mirenda
rho = 1.0
p <0.01
Interest Area RLP Interest Area Mirenda X Rank X Rank
Sports Sports 32.5 5 36.8 5
Games Games 23.4 3 30.0 3
Crafts Crafts 9.4 1 24.1 1
Expression Art and music 22.6 2 27.8 2
Community Education/entertainment/
culture and nature
divided by 2
31.2
4
30.7
4
TABLE 6
Validity Correlation between the Leisure Profile Inventory
and the Mirenda for Select Activity Interest Areas
N = 38 high school juniors and seniors, male subjects = 20, female subjects = 18, age range 16-18, X = 17
High scores/ranges indicate highest interest
Motivational
Attitude Areas
RLP
Leisure Value Areas
Leisure
Satisfaction
Areas
LPI
X
Values
X
Satisfaction
X
r
T
P
Emotional release Relaxation
2.3 18.3
0.59 3.0 <0.01
Physical enhancement Physical development
2.7 14.8
0.75 13.9 <0.001
Self-expression Self-expression
2.4 12.8
0.53 2.6 <0.05
Social interaction
enhancement
Social +
social recognition
divided by 2
2.2
10.6
0.76
5.0
<0.001
Sense of control Self-dependence
1.9 13.8
0.49 2.4 <0.001
Sense of accomplishment Accomplishment
2.6 14.6
0.80 5.7 <0.001
Intellectual enhancement Intellectual development
2.3 13.8
0.62 3.3 <0.01
Creative enhancement
Creativity 2.0
13.8 0.83 6.5 <0.001
TABLE 7
Validity Correlations between the Recreation and Leisure Profile and the
Leisure Values and Satisfaction Scales for Motivational Attitude Areas
N = 60 adults, male subjects = 27, female subjects = 33, age range 27-61, X = 44
Style Areas
RLP
Style Areas
LDB Style Areas
Mirenda
LPI
X
I.DB
X
Mirenda
X
r
T
p
Participating/spectating Active/passive
3.5 6.3
0.81 6.2 <0.001
Myself/group Group/individual
2.7 7.9
-0.83 -6.1 <0.001
Nonrisk/risk Risk/non risk
3.7 3.1
-0.72 -4.4 <0.001
Competitive/
noncompetitive
Competitive/
noncompetitive
2.9
16.0
0.72
4.3
<0.001
N = 60 adults, male subjects = 27, female subjects = 33, age range 27-61, X = 44
TABLE 8
Validity Correlations between the Recreation and Leisure Profile and the
Leisure Diagnostic Battery and Mirenda for Styles Areas
TABLE 9
Validity and Correlations between the Recreation and Leisure Profile
and the Leisure Diagnostic Battery for Barriers Scales
Barriers
RLP
Barriers
LDB
LPI
X
LDB
X
r
T
P
Lack of time Time 2.6 9.4 0.67 3.8 <0.01
Lack of money Money 2.0 6.8 0.58 2.9 <0.01
Fear of failure Ability l.5 6.0 0.50 2.4 <0.01
Lack of recreation skills Ability 1.6 6.0 0.67 3.8 <0.01
Lack of transportation Opportunity
1.1 5.8 0.46 2.1 <0.05
Lack of motivation Motivation 1.8 7.2 0.86 7.1 <0.001
Lack of social skills Social
1.4 6.6 0.78 5.2 <0.001
Lack of decision-making skills Decision making 1.4 6.5 0.78 5.2 <0.001
Lack of problem-solving skills
Decision making 1.4 6.5 0.83 6.3 <0.001
Lack of physical mobility Ability 1.8 6.0 0.59 3.1 <0.01
N = 60 adults, male subjects = 27, female subjects = 33, age range 27-61, X = 44
Interest Areas
Test 1 Test 2
X Rank X Rank
Sports Area
Team sports 8.7 10 9.2 10
Adventure sports 10.5 13 10.2 13
Individual/dual sports 11.8 14 11.5 14
Games Area
Table games 7.2 7 7.7 7
Solitary games 8.5 9 8.7 9
Physical skill games 6.4 5 6.4 5
Expression Area
rho = 0.99
Music 9.6 11 9.6 11.5 P < 0.001
Art 6.9 6 7.1 6
Dance/drama 7.9 8 7.8 8
Crafts Area
Wood/tooling 5.0 2 4.7 2
Clay 3.8 1 3.8 1
Stitchery 5.2 3 5.3 3
Community
Entertainment 9.7 12 9.6 11.5
Pets 6.0 4 5.5 4
Outdoor recreation 12.8 15 12.8 15
TABLE 10
Reliability Correlations for the Recreation and Leisure Profile:
Leisure Interest Section B
N = 60 adults, male subjects = 27, female subjects = 33, age range 27-61, X = 44
High scores/ranks indicate highest interest
Interest Areas
Test 1 Test 2
X Rank X Rank
Sports Area
Team sports 12.1 14 12.4 14
Adventure sports 11.3 12 11.3 12
Individual/dual sports 11.7 13 11.4 13
Games Area
Table games 6.8 6 7.3 6
Solitary games 6.5 5 6.6 5
Physical skill games 8.2 9 7.6 8
Expression Area
rho = 0.99
Music 9.6 10 9.6 10 P < 0.001
Art 5.5 4 5.5 4
Dance/drama 7.4 7 7.5 7
Crafts Area
Wood/tooling 3.6 3 3.3 3
Clay 2.7 1 2.6 1
Stitchery 2.9 2 3.0 2
Community
Entertainment 12.7 15 12.7 15
Pets 7.7 8 8.2 9
Outdoor recreation 11.0 11 10.8 11
TABLE 11
Reliability Correlations for the Leisure Profile Inventory:
Leisure Interest Section B
N = 38 high school juniors and seniors, male subjects = 20, female subjects = 18, age range 16-18, X = 17
High scores/ranges indicate highest interest
Motivational attitudes
Study 1: N = 60
Adults
Study 1: N = 38
High School Students
Test 1
X
Test 2
X
r
T
P Test 1
X
Test 2
X
r
T
P
Emotional release 2.3 2.3 0.89 8.4 <0.001 2.5 2.7 0.71 4.2 <0.001
Physical enhancement 2.7 2.5 0.81 6.0 <0.001 2.7 2.7 0.92 10.2 <.001
Self-expression 2.4
2.3 0.80 5.7 <0.001 2.5 2.6 0.93 10.2 <0.001
Creative enhancement 2.0 1.8 0.79 5.5 <0.001 2.4 2.5 0.89 8.2 <0.001
Social interaction enhancement 2.2 2.2 0.96 15.3 <0.001 2.9 2.9 0.87 7.1 <0.001
Sense of control 1.9 2.1 0.88 7.7 <0.001 2.5 2.6 0.81 5.7 <0.001
Sense of accomplishment 2.6 2.6 1.0 8.8 <0.001 3.2 3.2 0.93 11.0 <0.001
Intellectual enhancement 2.3 2.4 0.91 9.6 <0.001 2.3 2.4 0.94 11.8 <0.001
TABLE 12
Reliability Correlations for Recreation and Leisure Profile:
Leisure Motivational Attitudes Section E
Style
Study 1: N = 60
Adults
Study 2:N = 38
High School Students
Test 1
X
Test 2
X
r
T
P Test 1
X
Test 2
X
r
T
P
Participating/spectating 3.5 3.5 0.98 23.0 <0.001 4.3 4.5 0.89 8.0 <0.001
Myself/group 2.7 2.7 0.85 10.0 <0.001 2.6 2.7 0.98 19.8 <0.001
Competitive/noncompetitive 2.9 2.9 0.91 7.2 <0.001 3.9 3.9 0.97 15.8 <0.001
Nonrisk/risk 3.7 3.6 0.95 13.3 <0.001 2.9 2.9 0.95 12.8 <0.001
TABLE 13
Reliability Correlations for Recreation and Leisure Profile:
Leisure Participation Style Section D
Barriers
Study 1: N = 60
Adults
Study 1: N = 38
High School Students
Test 1
X
Test 2
X
r
T
P Test 1
X
Test 2
X
r
T
P
Lack of:
Time
2.6
2.7
0.80
5.7
<0.001
2.3
2.3
0.96
13.4
<0.001
Money 2.0 2.0 0.82 6.1 <0.001 2.2 2.2 0.92 9.4 <.001
Recreation skills 1.6 1.6 0.89 8.3 <0.001 1.5 1.5 0.85 6.7 <0.001
Transportation 1.1 1.1 0.79 5.5 <0.001 1.6 1.7 0.95 13.1 <0.001
Motivation 1.7 1.7 0.91 9.6 <0.001 1.9 1.8 0.74 11.6 <0.001
Social skills 1.4 1.4 0.90 9.0 <0.001 1.4 1.4 0.83 6.1 <0.001
Decision-making skills 1.5 1.4 0.88 7.8 <0.001 1.7 1.8 0.94 12.2 <0.001
Problem-solving skills 1.4 1.6 0.88 8.0 <0.001 1.4 1.5 0.81 5.7 <0.001
Physical mobility 1.7 1.7 1.0 8.8 <0.001 1.5 1.5 0.93 10.4 <0.001
Fear of failure 1.4 1.5 0.90 9.0 <0.001 1.5 1.6 0.86 7.0 <0.001
TABLE 14
Reliability Correlations for Recreation and Leisure Profile Inventory:
Leisure Barriers Section F
Parameter
QFST
FLSA
r
T
SD M SD M SD
Verbal communication 0.18 0.39 0.18 0.39 1.0 8.0 <0.001
Nonverbal communication 0.18 0.53 0.18 0.53 1.0 8.0 <0.001
Retention span 0.26 0.50 0.26 0.50 1.0 8.0 <0.001
Motor performance 0.29 0.47 0.29 0.47 1.0 8.0 <0.001
Attention span 0.35 0.70 0.38 0.68 0.98 22.0 <0.001
Money management skills 0.06 0.24 0.06 0.24 1.0 8.0 <0.001
Self-esteem l.2 0.97 l.2 0.97 1.0 8.0 <0.001
Frustration tolerance 0.53 0.80 0.53 0.87 0.92 8.7 <0.001
Attention-seeking behavior 0.06 0.24 0.06 0.24 1.0 8.0 <0.001
Motivation 0.65 0.99 0.65 0.99 1.0 8.0 <0.001
Nonproductive behavior 0.06 0.24 0.06 0.24 1.0 8.0 <0.001
Cooperation 0.18 0.53 0.18 0.53 1.0 8.0 <0.001
TABLE 15
A Validity Analysis between the QFST and the FLSA
Rater l Rater 2
r
T
SD Parameter M SD M SD
Verbal communication 0.18 0.39 0.18 0.39 1.0 8.0 <0.001
Nonverbal communication 0.18 0.53 0.12 0.33 0.94 10.9 <0.001
Retention span 0.26 0.50 0.26 0.50 1.0 8.0 <0.001
Motor performance 0.29 0.47 0.29 0.47 1.0 8.0 <0.001
Attention span 0.35 0.70 0.38 0.70 1.0 22.0 <0.001
Money management skills 0.06 0.24 0.06 0.24 1.0 8.0 <0.001
Self-esteem 1.2 0.97 1.2 0.97 1.0 8.0 <0.001
Frustration tolerance 0.53 0.80 0.47 0.71 0.96 12.4 <0.001
Attention-seeking behavior 0.06 0.24 0.06 0.24 1.0 8.0 <0.001
Motivation 0.65 0.79 0.59 0.94 0.97 15.5 <0.001
Nonproductive behavior 0.06 0.24 0.06 0.24 1.0 8.0 <0.001
Cooperation 0.18 0.53 0.18 0.53 1.0 8.0 <0.001
TABLE 16
An Interrater Reliability Analysis of the QFST
Intervention Strategies
Test Retest
rho = 0.99
P < 0.001
X Rank X Rank
Team sports 7.6 5.5 7.6 6.5
Adventure sports 7.73 8 7.73 8
Individual/dual sports 9.73 13.5 9.73 14
Music 9.73 13.5 9.6 13
Art 9.13 11 9.13 12
Music/drama 7.86 9 8.0
9
Table games 7.53 7 7.46 6.5
Solitary games 7.46
5.5
7.40
5
Physical/skill games 6.6 4 6.6 4
Wood/tooling crafts 6.53 3 6.46 3
Clay crafts 6.53 3 6.46 3
Stitchery crafts 5.13 1 5.33 1
Entertainment 8.33 10 8.4 10
Pets 9.2 12 9.06 11
Outdoor recreation 11.33 15 11.33 15
TABLE 17
Rank Order Correlation of the Intervention Strategies
Development of the RPI App
Hands on experience
Please listen closely to the instructions I am about to give you. I will ask you to repeat them when I am finish. For this Activity, I would like you to: (1) select ”Activity Comparisons” from the menu, (2) review each of the activity groups as they appear on the screen, (3) select the one activity picture between the two groups on the screen that best represents your interest, and (4) continue the process until all the activity comparisons are complete. Please listen closely to the instructions I am about to give you. I will ask you to repeat them when I am finish. Now that you have completed your activity selection, I would like you to: (1) add the 3 numbers in the white boxes associated with each area and enter that number in the area yellow box, (2) enter the highest number from the five yellow area boxes in the yellow box associated with “High Score”, (3) enter the lowest number from the five yellow area boxes in the yellow box associated with “Low Score”, and (4) subtract the “Low Score” from the “High Score” and enter that number in the yellow box associated with “Activity Difference”.
Generated report
• How to generate a report• Sample report
Further development – we need your input!
• Update photos to represent activities that serve as good examples for each of the categories -based on different age ranges
First steps….
• Divide in small groups (4-5) based on age• 35 and under
• 35-55
• 55 and over
• Within each group identify a writer
• Get ready as you will have 30 seconds to come up with activities your group thinks of as good examples for the given category
Categories
• Sports - Team
• Games – Table
• Expression – Music
• Crafts – Wood/Tooling
• Community Involvement-Entertainment
• Sports – Adventure
• Games – Solitary
• Expression – Art
• Crafts – Clay
• Community Involvement – Pets
• Sports – Individual/dual
• Games – Physical/Skill
• Expression – Dance
• Crafts – Stitchery
• Community Involvement – Outdoor Recreation
BACK
Recreational Assessment Results
Recreational Inventory Profile / Quick Functional Screening Test Roy H. Olsson Jr., PhD., CTRS, RTCR
Ruthie Kucharewski, PhD., CTRS
Date:
Client:
Client No.:
Assessment
and Plan:
9/8/2016
Randy
1
Cognitive / Communication Behavioral Skills
Attention Seeking Behavior 0
Attention Span 0
Cooperation Behavior 0
Frustration Tolerance 0
Money Management Skills 0
Motivation 0
Motor Performance 0
Non-Productive Behavior 0
Non-Verbal Communication 0
Retention Span (2 passes) N/A
Self-Esteem 0
Verbal Communication 0
O None
1 Mild 2 Moderate
3 Severe Dysfunction
4 to 5 Profound Dysfunction
Recreation Profile Intervention Strategies
Adventure 14
Assessment Indicators
Ability to Follow Directions
Decision Making Ability
Old Learning
No Problem
No Problem
No Problem
Team 13 Outdoor Recreation 12
Entertainment 11
Physical Skill 10
Table 8
Individual/Dual 7
Music 7
Pets 7
Art 6
Dance/Drama 3
Solitary 3
Wood/Tooling 3
Clay 1
Stitchery 0
