+ All Categories
Home > Documents > Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature...

Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature...

Date post: 15-Jan-2020
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
38
Measuring the Impact of Dementia-Friendly Education and Training Sessions: A Toolkit September 2019 Prepared for Erin Long, MSW Administration on Aging Administration for Community Living 330 C Street, SW Washington, DC 20201 Prepared by Heather L. Menne, PhD RTI International 3040 Cornwallis Rd. Research Triangle Park, NC 27709 Lourdes R. Guerrero, EdD, MSW
Transcript
Page 1: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

Measuring the Impact of Dementia-Friendly Education and Training Sessions: A Toolkit

September 2019

Prepared for

Erin Long, MSWAdministration on Aging

Administration for Community Living330 C Street, SW

Washington, DC 20201

Prepared by

Heather L. Menne, PhDRTI International

3040 Cornwallis Rd.Research Triangle Park, NC 27709

Lourdes R. Guerrero, EdD, MSWDavid Geffen School of Medicine at UCLA

10833 Le Conte Ave, 17-348 CHS Los Angeles, CA 90095

Contract # HHSP233201600021IAdministration for Community Living

U.S. Department of Health and Human Services

Page 2: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

Table of ContentsAcknowledgements.....................................................................................................................................1

Background..................................................................................................................................................2

Process for Developing the Recommended Tools.......................................................................................3

Recommended Tools...................................................................................................................................4

Brief Tool for Dementia-Friendly Education and Training Sessions: Individual Trainings............................5

Pre-Workshop Questions.........................................................................................................................5

Post-Workshop Questions.......................................................................................................................6

Brief Tool for Dementia-Friendly Education and Training Sessions: Organizational or Sector Trainings.....7

Pre-Workshop Questions.........................................................................................................................7

Post-Workshop Questions.......................................................................................................................8

Brief Tools for Dementia-Friendly Education and Training Sessions: Instructions.....................................10

Instructions............................................................................................................................................10

Scoring...................................................................................................................................................10

Reporting...............................................................................................................................................16

Brief Tool for Dementia-Friendly Education and Training Sessions: Annotated........................................21

Pre-and Post-Workshop Questions for Individual and Organizational/Sector Tool...............................21

Post-Workshop Question for Individual Tool.........................................................................................21

Pre-Workshop Question for Organizational/Sector Tool.......................................................................22

Post-Workshop Question for Organizational/Sector Tool.....................................................................22

Notes.....................................................................................................................................................22

Page 3: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

1

Acknowledgements

The National Alzheimer’s and Dementia Resource Center gratefully acknowledges

the Dementia-Friendly Evaluation Workgroup.

Co-Chairs

• Heather Menne (National Alzheimer’s and Dementia Resource Center)

• Lourdes Guerrero (University of California, Los Angeles)

Workgroup Members

• Jennifer Carson (University of Nevada, Reno)

• Jennifer Heston (Miami University)

• Suzanne Kunkel (Miami University)

• Christine McKibbin (University of Wyoming)

• Christy Nishita (University of Hawaii)

• Peter Reed (University of Nevada, Reno)

The National Alzheimer’s and Dementia Resource Center also is grateful for the

leadership and review of Erin Long of the Administration on Aging/Administration for

Community Living. This paper was produced under contract with RTI International

through Contract Number HHSP233201600021I with the Administration for Community

Living/U.S. Department of Health and Human Services.

This paper is the work of the National Alzheimer’s and Dementia Resource Center

and does not necessarily express the opinions of the Administration on Aging/

Administration for Community Living, the U.S. Department of Health and Human Services,

or RTI International.

Page 4: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

2

BackgroundIn 2019, the Administration for Community Living (ACL), the National Alzheimer’s

and Dementia Resource Center (NADRC), and a group of evaluators for ACL grants that

involved dementia-friendly activities collaborated to create brief tools to measure the

impact of dementia-friendly training and education efforts. This work is part of the

evolution of dementia-capable states and communities. Encouraging the development of

dementia-friendly communities is one element of a model dementia-capable system.1

The Dementia-Friendly Evaluation Workgroup (hereafter referred to as the

Workgroup) was convened to create the brief tools. The Workgroup included ACL staff

from the Administration on Aging, NADRC staff, and evaluation representatives from five

ACL Alzheimer’s Disease program grantees. It was understood that the resulting tools

would be used for future dementia-friendly activities to address individual- and

organizational/sector-level dementia-friendly training and education. It was acknowledged

that local communities may opt to also collect data specific to their program and that the

brief tools created by the Workgroup would be common measures collected across all

programs. The aim of the Workgroup was to:

Identify a core, limited set of items to measure impact of dementia-friendly training.

The Workgroup used a participatory and consensus approach where all members

were able to contribute, advocate, and discuss the ideas presented. The Workgroup

engaged in rich and robust discussion on varying approaches to states and communities

becoming dementia-friendly, the benefits and challenges of process and outcome

evaluations, data collection tools for measuring impact, and the key outcomes of dementia-

friendly education and training. Early in the discussions, the range of outcomes to consider

included knowledge, attitudes, empathy, awareness, readiness, inclusion, accessibility, and

behavior/practice change. Based on consensus achieved among the group, the final

outcomes to be measured in the brief tools are:

• Knowledge

• Attitudes

• Behavior/Practice Change

1 Gould, E., Menne, H., McCallion, P., Hughes, S. & Shuman, S. (2019, September). Dementia-capable states and communities: Lessons learned from Administration on Aging grantees. Prepared for the U.S. Administration on Aging/Administration for Community Living. Available at https://nadrc.acl.gov/node/93

Page 5: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

3

We expect that there will be an increase in knowledge and attitudes about dementia

after attending a structured dementia-friendly education and training session, and we

expect that session attendees will report intent to make behavior or practice change

related to the dementia-friendly education and training session. The resulting tools are a

result of full consensus on some items and majority approval on other items.

The method for identifying the core items included conference calls and interim

work on the part of the Workgroup. The next section outlines the steps taken to develop

the recommended tools for measuring the impact of dementia-friendly training.

Process for Developing the Recommended Tools

Seven evaluators were active participants for the 4 months of the Workgroup’s

duration, and one of these evaluators served as the lead facilitator for the Workgroup. The

Workgroup convened from April through July 2019, with five conference calls (typically

lasting 90 minutes) and activities to complete between calls. The Workgroup began with a

description of each grantee’s dementia-friendly effort and a sharing of evaluation plans and

related resources.

The Workgroup developed a matrix for key domains, which included questions or

topics within those domains and whether the questions were most relevant at the

individual or organizational/sector level. Over the course of two calls and work between

calls, the Workgroup focused on three outcomes (i.e., knowledge, attitudes, and behavior/

practice change) and identified and reviewed specific questions for each outcome from

existing instruments. As documented in the Brief Tool: Annotated, peer-reviewed literature

of validated measures and evaluations of local dementia-friendly efforts served as

resources in the development of the recommended brief tools. During the last two calls, the

Workgroup discussed and refined the proposed questions for each outcome, including the

response options and nuances of word choice. Between and after these last calls, the

Workgroup shared written comments on the tools. Program staff from grants conducting

dementia-friendly activities provided feedback on the content, understandability, and

burden of a draft tool. Feedback from program staff was critical for the final adjustments

made to these tools.

As outlined above, the brief tools were derived from existing validated measures

and evaluations of local dementia-friendly efforts. We have not conducted interviews with

individuals who are likely to complete these tools in order to know if the questions are

Page 6: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

4

understood as intended or if the terms used are the most accessible, nor have these new

brief tools undergone a validation study. We expect that the use of these tools by local

dementia-friendly programs will inform how feasible they are to use in a range of

dementia-friendly education and training sessions and whether the tools serve as valid

measures of change associated with the education and training sessions.

Recommended Tools

Two brief tools; a set of instructions for the use, scoring, and reporting of the brief

tools; and an annotated version of the tools (documenting the sources of the questions)

were developed based on the input and guidance of the Workgroup. The resulting

documents are included in this toolkit:

• Brief Tool for Dementia-Friendly Education and Training Sessions: Individual

Trainings

• Brief Tool for Dementia-Friendly Education and Training Sessions: Organizational

or Sector Trainings

• Brief Tool for Dementia-Friendly Education and Training Sessions: Instructions

• Brief Tool for Dementia-Friendly Education and Training Sessions: Annotated

Page 7: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

5

Brief Tool for Dementia-Friendly Education and Training Sessions

Individual Trainings

Pre-Workshop Questions

Knowledge QuestionsAfter reading the statements below, please circle the correct answer.

1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect

thinking, communication and everyday tasks.True False

3. People with dementia may express themselves or communicate through actions instead of words.

True False

Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.

1. I am confident interacting with people with dementia.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

52. People with dementia need to

feel respected, just like anyone else.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

3. I can respond to people with dementia with understanding.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

4. I am motivated to get to know people with dementia better.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

Page 8: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

6

Post-Workshop Questions

Knowledge QuestionsAfter reading the statements below, please circle the correct answer.

1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect

thinking, communication and everyday tasks. True False

3. People with dementia may express themselves or communicate through actions instead of words.

True False

4. Did you learn about accessing community resources related to dementia as part of this workshop/training/session?

Yes No

Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.

1. I am confident interacting with people with dementia.

Strongly disagree

1

Disagree 2

Neutral 3

Agree4

Strongly agree

5

2. People with dementia need to feel respected, just like anyone else.

Strongly disagree

1

Disagree 2

Neutral 3

Agree4

Strongly agree

5

3. I can respond to people with dementia with understanding.

Strongly disagree

1

Disagree 2

Neutral 3

Agree4

Strongly agree

5

4. I am motivated to get to know people with dementia better.

Strongly disagree

1

Disagree 2

Neutral 3

Agree4

Strongly agree

5

Behavior Question1. Which of the following actions will you take to create a more dementia friendly and

inclusive community?

Put a check next to each action you will take. Select as many as you like. ✔  Offer support to people with dementia  Offer support to caregivers of people with dementia  Volunteer for an organization that helps people with dementia or their caregivers  Make my home more dementia friendly  Make my workplace more dementia friendly  Make my community more dementia friendly  Encourage my friends to become dementia friendly  Be more patient with people with dementia when out in the community  Are there any other actions you will take? Please list them below:        

Page 9: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

7

Brief Tool for Dementia-Friendly Education and Training Sessions

Organizational or Sector TrainingsPre-Workshop QuestionsWhich category best describes the organization you represent at this training? (Please mark ONLY ONE)

□ Legal Services □ Banks / Financial Services

□ Neighbors / Community Member

Government Agencies

□ Emergency Planning / First Responder

□ Libraries □ Communities of Faith

□ Business / Retail

□ Transportation Services

□ Hospitals / Acute Care Settings

□ Residential Care □ Food service/ Restaurant

□ Other, please specify:      

Knowledge QuestionsAfter reading the statements below, please circle the correct answer.

1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect

thinking, communication and everyday tasks.True False

3. People with dementia may express themselves or communicate through actions instead of words.

True False

Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.

1. I am confident interacting with people with dementia.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

2. People with dementia need to feel respected, just like anyone else.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

3. I can respond to people with dementia with understanding.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

4. I am motivated to get to know people with dementia better.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

Page 10: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

8

Page 11: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

9

Post-Workshop QuestionsKnowledge QuestionsAfter reading the statements below, please circle the correct answer.

1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect

thinking, communication and everyday tasks. True False

3. People with dementia may express themselves or communicate through actions instead of words.

True False

4. Did you learn about accessing community resources related to dementia as part of this workshop/training/session?

Yes No

Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.

1. I am confident interacting with people with dementia.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

52. People with dementia need to

feel respected, just like anyone else.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

3. I can respond to people with dementia with understanding.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

4. I am motivated to get to know people with dementia better.

Strongly disagree

1

Disagree2

Neutral 3

Agree4

Strongly agree

5

Behavior/Practice Change Question1. Which of the following actions will you take to create a more dementia friendly and

inclusive community?

Put a check next to each action you will take. Select as many as you like. ✔  Offer support to people with dementia  Offer support to caregivers of people with dementia  Volunteer for an organization that helps people with dementia or their caregivers  Make my home more dementia friendly  Encourage my friends to become dementia friendly  Be more patient with people with dementia when out in the community  Make sure staff/co-workers are educated about effective communication strategies when interacting with people with dementia

 

Adapt current services or put new services in place for people with dementia  Adapt current services or put new services in place for dementia caregivers  Adopt employee benefits practices that are supportive of family caregivers of persons with dementia

 

Page 12: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

10

Put a check next to each action you will take. Select as many as you like. ✔  Make environmental changes in my organization or public space (e.g., establish places to rest or quiet rooms and spaces; maps/signage; lighting; contrasting surfaces)

 

Are there any other actions you will take? Please list them below:           

Page 13: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

11

Brief Tools for Dementia-Friendly Education and Training Sessions

Instructions

Instructions

These brief tools are designed to measure the impact of dementia-friendly

education and training sessions. Structured dementia-friendly education and training

sessions may be part of programs that aim to build a dementia-friendly community (e.g.,

Dementia Friendly USA, Dementia Friends).

When should these brief tools be used?These brief tools should be used before (items labeled “Pre-Workshop”) and after

(items labeled “Post-Workshop”) structured dementia-friendly education and training

sessions.

When should these brief tools not be used?These brief tools should not be used for dementia-friendly recruitment and

marketing/outreach activities.

How should these brief tools be used?The questions from the brief tools can be printed double-sided and distributed for

completion before (Pre-workshop) and then after (Post-workshop) education and training

sessions.

Alternatively, programs may want to add the questions in these brief tools to other

questions that are important to their specific program. In this case, these items can be

copied and pasted into the format most suitable for the program to collect pre- and post-

workshop data.

Scoring

Programs using the brief tools can understand the impact of their dementia-friendly

education and training sessions by using the scoring process described here. Using these

steps, programs can calculate descriptive information from the pre-workshop and post-

workshop data and calculate the change from pre-workshop to post-workshop for items

Page 14: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

12

asked at both times. The next sections are broken down by one organization item and the

following outcomes: knowledge, attitudes, behavior/practice change.

Organization DescriptionTable 1 contains wording of the organization question in the Organizational/Sector

tool, the coding or values that correspond to the responses, and a description of how to

calculate descriptive scores.

Table 1. Organization Description Questions, Coding, and Scoring CalculationsQuestion* Coding / Values for Responses To calculate descriptive

information Which category best describes the organization you represent at this training?

Legal Services = 1Banks/Financial Services = 2Neighbors/ Community Member = 3Government Agencies = 4Emergency Planning/First Responder = 5Libraries = 6Communities of Faith = 7Business/Retail = 8Transportation Services = 9Hospitals/Acute Care Settings = 10Residential Care = 11Food Service/ Restaurant = 12Other = 13

Count of attendees by categoryFormula: # of all attendees marking a category (repeat for each category)

% of attendees by categoryFormula:% = 100*(# of all attendees marking a category/ # of total attendees)(repeat for each category)

* This question only appears in the Organizational/Sector Tool.

Organization Description ExampleUsing the formulas outlined above, Table 2 contains sample responses to the pre-

workshop organization Description question and the resulting descriptive scores. For

example, one person had a value of 5 (Emergency Planning/First Responder), one person

had an 8 (Business/Retail), one person had a 10 (Hospitals/Acute Care Settings), two

people had 11 (Residential Care), and one person had a 12 (Food Service/Restaurant).

Therefore 16.7% were in Emergency Planning/First Responder (100*[1/6]), 16.7%

Business/ Retail (100*[1/6]), 16.7% Hospitals/Acute Care Settings (100*[1/6]), 33.3%

Residential Care (100*[2/6]), and 16.7% were Food Service/Restaurant.

Table 2. Organization Description Question: Calculation ExampleAttendee Response

1 52 83 124 115 106 11

Note: All numbers are for demonstration purposes only.

Page 15: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

13

KnowledgeTable 3 contains the wording of the knowledge questions, the coding or values that

correspond to the responses, and descriptions of how to calculate descriptive scores and

change scores (when appropriate).

Table 3. Knowledge Questions, Coding, and Scoring CalculationsQuestion Coding /

Values for Responses

To calculate descriptive information for Pre-workshop data (or Post-workshop data)

To calculate change from pre-workshop to post-workshop

Dementia is part of normal aging.

True = 0False = 1 (correct answer)

% of attendees who report “False” Pre-workshop (or Post-workshop)Formula:% = 100*(# of attendees who report “False” Pre-workshop (or Post-workshop)/ # of total attendees)

% change of attendees who report “False” Pre-workshop to attendees who report “False” Post-workshopFormula: % = 100*([# of Post-workshop attendees who report “False” - # of Pre-workshop attendees who report “False”] / # of total attendees)

Dementia is not just about having memory problems. It can affect thinking, communication and everyday tasks.

True = 1 (correct answer)False = 0

% of attendees who report “True” Pre-workshop (or Post-workshop)Formula:% = 100*(# of attendees who report “True” Pre-workshop (or Post-workshop)/ # of total attendees)

% change of attendees who report “True” Pre-workshop to attendees who report “True” Post-workshopFormula: % = 100*([# of Post-workshop attendees who report “True” - # of Pre-workshop attendees who report “True”] / # of total attendees)

People with dementia may express themselves or communicate through actions instead of words.

True = 1 (correct answer)False = 0

% of attendees who report “True” Pre-workshop (or Post-workshop)Formula:% = 100*(# of attendees who report “True” Pre-workshop (or Post-workshop)/ # of total attendees)

% change of attendees who report “True” Pre-workshop to attendees who report “True” Post-workshopFormula: % = 100*([# of Post-workshop attendees who report “True” - # of Pre-workshop attendees who report “True”] / # of total attendees)

Did you learn about accessing community resources related to dementia as part of this workshop/ training/session?

Yes = 1No = 0

% of attendees who report “Yes” Post-workshopFormula:% = 100*(# of attendees who report “Yes” Post-workshop/ # of total attendees)

N/A

Knowledge ExampleUsing the formulas outlined above, Table 4 contains sample responses to the pre-

workshop and post-workshop Knowledge questions and the resulting descriptive and

Page 16: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

14

change calculation scores. For example, for Question 2 (Dementia is not just about having

memory problems. It can affect thinking, communication and everyday tasks.), two people

responded “True” Pre-workshop; therefore, Question 2’s pre-workshop descriptive score

would be 33.3% (100*[2/6]). The change score for Question 2 would be an improvement of

16.7% (100*{[3-2]/6}).

Table 4. Knowledge Questions: Calculation Example

AttendeeKnowledge Questions

Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Post*1 1 1 0 1 1 1 12 1 1 0 0 0 1 03 1 1 1 1 1 1 14 1 1 0 1 0 0 05 0 1 0 0 1 1 16 1 1 1 0 0 1 1

Descriptive Score 83.3% 100% 33.3% 50% 50% 83.3% 66.7%Change Score 16.7% 16.7% 33.3% N/A

Note: All numbers are for demonstration purposes only.*Q4 is not asked pre-workshop.

Attitudes Table 5 contains the attitude questions, the coding or values that correspond to the

responses, and descriptions of how to calculate descriptive scores and change scores

(when appropriate).

Table 5. Attitude Questions, Coding, and Scoring CalculationsQuestion Coding / Values for

ResponsesTo calculate descriptive information for Pre-workshop data (or Post-workshop data)

To calculate change from pre-workshop to post-workshop

I am confident interacting with people with dementia.

Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5

Average responseFormula:Add together the reported values (1-5) for each attendee Pre-workshop (or Post-workshop)/ # of total attendees

Change in average responsePre-workshop average:Add together the reported values (1-5) for each attendee Pre-workshop/ # of total attendees Post-workshop average:Add together the reported values (1-5) for each attendee Post-workshop/ # of total attendees

Change:Difference = Post-workshop average – Pre-workshop average

Page 17: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

15

Question Coding / Values for Responses

To calculate descriptive information for Pre-workshop data (or Post-workshop data)

To calculate change from pre-workshop to post-workshop

People with dementia need to feel respected, just like anyone else.

Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5

Same as above Same as above

I can respond to people with dementia with understanding.

Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5

Same as above Same as above

I am motivated to get to know people with dementia better.

Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5

Same as above Same as above

Attitudes ExampleUsing the formulas outlined above, Table 6 contains sample responses to the pre-

workshop and post-workshop Attitudes questions and the resulting descriptive and change

calculation scores. For example, for Pre-workshop Question 3 (I can respond to people with

dementia with understanding.), one person had value of 1, two people had value of 2, two

people had a value of 3, and one person had a value of 4; therefore, Question 3’s pre-

workshop descriptive score would be 2.50 ({[1*1] + [2*2] + [2*3] + [1*4]}/6]). The change

score for Question 2 would be a change of 1.2 points (3.70-2.50).

Table 6. Attitude Questions: Calculation Example

AttendeeAttitude Questions

Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Pre Q4 Post1 3 3 3 5 2 3 1 22 4 4 3 4 3 4 2 43 2 4 4 4 1 3 3 34 1 3 4 4 4 5 2 35 1 2 3 3 3 4 4 46 3 3 2 4 2 3 2 3

Descriptive Score 2.33 3.17 3.17 4.00 2.50 3.70 2.33 3.17Change Score 0.84 0.83 1.20 0.84

Note: All numbers are for demonstration purposes only.

Behavior/Practice ChangeTable 7 contains the wording of the behavior/practice change questions, the coding

or values that correspond to the responses, and descriptions of how to calculate descriptive

scores and change scores (when appropriate). Some items are asked in both tools, whereas

Page 18: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

16

some items are unique to the Individual Tool and some are unique to the

Organizational/Sector Tool (* indicate differences).

Table 7. Behavior/Practice Change Questions, Coding, and Scoring CalculationsQuestion Coding /

Values for Responses

To calculate descriptive information for or Post-workshop data

Action: Offer support to people with dementia

✔ = 1 % of attendees who report ✔ Formula:% = 100*(# of attendees who report ✔/ # of total attendees)

Action: Offer support to caregivers of people with dementia

✔ = 1 Same as above

Action: Volunteer for an organization that helps people with dementia or their caregivers

✔ = 1 Same as above

Action: Make my home more dementia friendly

✔ = 1 Same as above

Action: Make my workplace more dementia friendly*

✔ = 1 Same as above

Action: Make my community more dementia friendly*

✔ = 1 Same as above

Action: Encourage my friends to become dementia friendly

✔ = 1 Same as above

Action: Be more patient with people with dementia when out in the community

✔ = 1 Same as above

Action: Make sure staff/co-workers are educated about effective communication strategies when interacting with people with dementia**

✔ = 1 Same as above

Action: Adapt current services or put new services in place for people with dementia**

✔ = 1 Same as above

Action: Adapt current services or put new services in place for dementia caregivers**

✔ = 1 Same as above

Action: Adopt employee benefits practices that are supportive of family caregivers of persons with dementia**

✔ = 1 Same as above

Action: Make environmental changes in my organization or public space (e.g., establish places to rest or quiet rooms and spaces; maps/signage; lighting; contrasting surfaces)**

✔ = 1 Same as above

Action: Other specify ✔ = 1 Same as above

Page 19: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

17

Question Coding / Values for Responses

To calculate descriptive information for or Post-workshop data

Action: all   Total Count of ActionsFormula: # of all actions with ✔ by attendee (e.g., offer support, volunteer, be more patient)

Average number of ActionsFormula:# of all actions with ✔ by attendee (e.g., offer support, volunteer, be more patient)/ # of total attendees

Note: Removed the Change Calculation column as it is not applicable for Behavior/Practice Change items.*These items only appear in the Individual Tool. ** These items only appear in the Organizational/Sector Tool.

Behavior/Practice Change ExampleUsing the formulas outlined above, Table 8 contains sample responses to the post-

workshop Behavior/Practice Change questions and the resulting descriptive scores. For

example, for Post-workshop Behavior/Practice Change Question 2, two people had value of

1; therefore, Question 2’s post-workshop descriptive score would be 33.3% (100*[2/6]).

The count of All Actions totaled 16 (2+6+3+2+2+2), and the average of all actions reported

by attendees would be 2.67 (16/6).

Table 8. Behavior/Practice Change Questions: Calculation Example

AttendeeBehavior/Practice Change Questions

  Count of All ActionsQ1 Post Q2 Post Q3 Post Q4 Post Q5 Post

1 1   1       22 1 1 1 1 1   53   1 1   1   34     1   1   25 1   1       26     1   1   2

Descriptive Score (%)

50.0% 33.3% 100.0% 16.7% 66.7% Total 16

Note: All numbers are for demonstration purposes only. Only a few Behavior/Practice Change Questions are shown for ease.

Descriptive Score

(average)

2.67

Reporting2

ACL grants that include the delivery of dementia-friendly education and training can

use these brief tools to measure the impact of dementia-friendly education and training

sessions, or another similar tool approved by ACL.

2 Reporting is only applicable to ACL Alzheimer’s disease grantees delivering dementia-friendly education and training.

Page 20: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

18

Using the formulas outlined earlier in this document, ACL grantees can report on the

impact of their dementia-friendly education and training. ACL grantees should report

cumulative data, and results should be included in a Final Report. For example, if a grantee

has 17 attendees during one performance period and 72 in the second performance period,

the grantee should report the data on all 89 attendees (17+72), regardless of the number of

training sessions, when it submits its reporting to ACL. Organizations collecting data as a

result of ACL grant program funded activities will submit their raw (attendee-reported)

data in an Excel file as part of their final report.

The tables below show how the cumulative data can be reported. These tables are

organized by the question or outcomes outlined earlier: organization description,

knowledge, attitudes, and behavior/practice change. These include the descriptive scores

and change scores (as applicable) but not the unique responses of each attendee. The

blank tables below (Tables R1, R3, R5, and R7) can be used to present cumulative data. The

example tables (Tables R2, R4, R6, and R8) are presented to show the example data used in

the Scoring section.

Table R1. Reporting Organization Description

Total Attendees

Organization Description

Lega

l Ser

vice

s

Ban

ks/

Fin

anci

al

Serv

ices

Nei

ghb

ors/

Co

mm

un

ity

Mem

ber

Gov

t A

gen

cies

Emer

gen

cy

Pla

nn

ing/

Fir

st

Res

pon

der

Lib

rari

es

Com

mu

nit

ies

of

Fait

h

Bu

sin

ess/

Ret

ail

Tra

nsp

orta

tion

Se

rvic

es

Hos

pit

als/

Acu

te

Care

Set

tin

gs

Res

iden

tial

Car

e

Food

Ser

vice

/ R

esta

ura

nt

Oth

er

Descriptive Score (Count)                          Descriptive Score (%)                          

Page 21: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

19

Table R2. Reporting Organization Description: Example

Total Attendees: 6

Organization Description

Lega

l Ser

vice

s

Ban

ks/

Fin

anci

al

Serv

ices

Nei

ghb

ors/

Co

mm

un

ity

Mem

ber

Gov

t A

gen

cies

Emer

gen

cy

Pla

nn

ing/

Firs

t R

esp

ond

er

Lib

rari

es

Com

mu

nit

ies

of

Fait

h

Bu

sin

ess/

Ret

ail

Tra

nsp

orta

tion

Se

rvic

es

Hos

pit

als/

Acu

te

Care

Set

tin

gs

Res

iden

tial

Car

e

Food

Ser

vice

/ R

esta

ura

nt

Oth

er

Descriptive Score (Count)

        1     1   1 2 1  

Descriptive Score (%)         16.7     16.7   16.7 33.3 16.7  

Table R3. Reporting Knowledge Questions

Total Attendees: Knowledge Questions

Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 PostDescriptive Score (%)              Change Score (%)       N/A

Table R4. Reporting Knowledge Questions: Example

Total Attendees: 6Knowledge Questions

Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 PostDescriptive Score (%) 83.3 100.0 33.3 50.0 50.0 83.3 66.7Change Score (%) 16.7 16.7 33.3 N/A

Table R5. Reporting Attitude Questions

Total Attendees:Attitude Questions

Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Pre Q4 PostDescriptive Score                Change Score        

Table R6. Reporting Attitude Questions: Example

Total Attendees: 6Attitude Questions

Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Pre Q4 PostDescriptive Score 2.33 3.17 3.17 4.00 2.50 3.70 2.33 3.17Change Score 0.84 0.83 1.20 0.84

Page 22: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

20

Table R7. Reporting Behavior/Practice Change Questions

Total Attendees:

Behavior/Practice Change Questions

Off

er s

up

por

t to

peo

ple

wit

h d

emen

tia

Off

er s

up

por

t to

care

give

rs o

f peo

ple

wit

h d

emen

tia

Vol

un

teer

for

an o

rgan

izat

ion

th

at h

elp

s p

eop

le w

ith

d

emen

tia

or t

hei

r ca

regi

vers

Mak

e m

y h

ome

mor

e d

emen

tia

frie

nd

ly

Mak

e m

y w

ork

pla

ce m

ore

dem

enti

a fr

ien

dly

Mak

e m

y co

mm

un

ity

mor

e d

emen

tia

frie

nd

ly

Enco

ura

ge m

y fr

ien

ds

to b

ecom

e d

emen

tia

frie

nd

ly

Be

mor

e p

atie

nt w

ith

peo

ple

wit

h d

emen

tia

wh

en o

ut

in th

e co

mm

un

ity

Mak

e su

re s

taff

/co-

wor

ker

s ar

e ed

uca

ted

ab

out

effe

ctiv

e co

mm

un

icat

ion

str

ateg

ies

wh

en in

tera

ctin

g w

ith

peo

ple

wit

h d

emen

tia

Ad

apt c

urr

ent s

ervi

ces

or p

ut n

ew s

ervi

ces

in p

lace

fo

r p

eop

le w

ith

dem

enti

a

Ad

apt c

urr

ent s

ervi

ces

or p

ut n

ew s

ervi

ces

in p

lace

fo

r d

emen

tia

care

give

rs

Ad

opt

emp

loye

e b

enef

its

pra

ctic

es th

at a

re

sup

por

tive

of f

amil

y ca

regi

vers

of p

erso

ns

wit

h

dem

enti

a

Mak

e en

viro

nm

enta

l ch

ange

s in

my

orga

niz

atio

n o

r p

ub

lic

spac

e (e

.g.,

esta

bli

sh p

lace

s to

res

t or

qu

iet

room

s an

d s

pac

es; m

aps/

sign

age;

ligh

tin

g;

con

tras

tin

g su

rfac

es)

Oth

er s

pec

ify

Act

ion

: all

Descriptive Score

(count)                             

Descriptive Score

(average)N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A  

Descriptive Score (%)

                            N/A

Page 23: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

21

Table R8. Reporting Behavior/Practice Change Questions: Example.

Total Attendees: 6

Behavior/Practice Change Questions

Off

er s

up

por

t to

peo

ple

wit

h d

emen

tia

Off

er s

up

por

t to

care

give

rs o

f peo

ple

wit

h d

emen

tia

Vol

un

teer

for

an o

rgan

izat

ion

th

at h

elp

s p

eop

le w

ith

d

emen

tia

or t

hei

r ca

regi

vers

Mak

e m

y h

ome

mor

e d

emen

tia

frie

nd

ly

Mak

e m

y w

ork

pla

ce m

ore

dem

enti

a fr

ien

dly

Mak

e m

y co

mm

un

ity

mor

e d

emen

tia

frie

nd

ly

Enco

ura

ge m

y fr

ien

ds

to b

ecom

e d

emen

tia

frie

nd

ly

Be

mor

e p

atie

nt w

ith

peo

ple

wit

h d

emen

tia

wh

en o

ut

in th

e co

mm

un

ity

Mak

e su

re s

taff

/co-

wor

ker

s ar

e ed

uca

ted

ab

out

effe

ctiv

e co

mm

un

icat

ion

str

ateg

ies

wh

en in

tera

ctin

g w

ith

peo

ple

wit

h d

emen

tia

Ad

apt c

urr

ent s

ervi

ces

or p

ut n

ew s

ervi

ces

in p

lace

for

peo

ple

wit

h d

emen

tia

Ad

apt c

urr

ent s

ervi

ces

or p

ut n

ew s

ervi

ces

in p

lace

for

dem

enti

a ca

regi

vers

Ad

opt

emp

loye

e b

enef

its

pra

ctic

es th

at a

re s

up

por

tive

of

fam

ily

care

give

rs o

f per

son

s w

ith

dem

enti

a

Mak

e en

viro

nm

enta

l ch

ange

s in

my

orga

niz

atio

n o

r p

ub

lic

spac

e (e

.g.,

esta

bli

sh p

lace

s to

res

t or

qu

iet

room

s an

d s

pac

es; m

aps/

sign

age;

ligh

tin

g; c

ontr

asti

ng

surf

aces

)

Oth

er s

pec

ify

Act

ion

: all

Descriptive Score

(count)3 2 6 1 4 0 0 0 0 0 0 0 0 0 16

Descriptive Score

(average)N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 2.67

Descriptive Score (%)

50.0 33.3 100.0 16.7 66.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N/A

Page 24: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

22

Brief Tool for Dementia-Friendly Education and Training Sessions

Annotated

Pre-and Post-Workshop Questions for Individual and Organizational/Sector Tool

Knowledge Questions

1. Dementia is part of normal aging.1 True False2. Dementia is not just about having memory problems. It can affect

thinking, communication and everyday tasks.2 True False

3. People with dementia may express themselves or communicate through actions instead of words.3 True False

Attitude Questions

1. I am confident interacting with people with dementia.3

Strongly disagree

1

Disagree 2

Neutral 3

Agree 4

Strongly agree 5

2. People with dementia need to feel respected, just like anyone else.4

Strongly disagree

1

Disagree 2

Neutral 3

Agree 4

Strongly agree5

3. I can respond to people with dementia with understanding.4

Strongly disagree

1

Disagree 2

Neutral 3

Agree 4

Strongly agree5

4. I am motivated to get to know people with dementia better.5

Strongly disagree

1

Disagree 2

Neutral 3

Agree 4

Strongly agree5

Post-Workshop Question for Individual Tool

Behavior Question1. Which of the following personal actions will you take to create a more dementia-

friendly and inclusive community?Put a check next to each action you will take. Select as many as you like. ✔  Offer support to people with dementia6  Offer support to caregivers of people with dementia6  Volunteer for an organization that helps people with dementia or their caregivers6

 

Make my home more dementia friendly6  Make my workplace more dementia friendly6  Make my community more dementia friendly6  Encourage my friends to become dementia friendly6  Be more patient with people with dementia when out in the community6  Are there any other actions you will take? Please list them below:  

Page 25: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

23

Pre-Workshop Question for Organizational/Sector Tool

Which category best describes the organization you represent at this training? (Please mark ONLY ONE)8

□ Legal Services □ Banks/Financial Services

□ Neighbors / Community Member

□ Government Agencies

□ Emergency Planning / First Responder

□ Libraries □ Communities of Faith

□ Business / Retail

□ Transportation Services □ Hospitals/Acute Care Settings

□ Residential Care □ Food service/ Restaurant

□ Other, please specify:      

Post-Workshop Question for Organizational/Sector Tool

Behavior/Practice Change Question1. Which of the following actions will you take to create a more dementia-friendly and

inclusive community?Put a check next to each action you will take. Select as many as you like. ✔  Offer support to people with dementia6  Offer support to caregivers of people with dementia6  Volunteer for an organization that helps people with dementia or their caregivers6  Make my home more dementia friendly6  Encourage my friends to become dementia friendly6  Be more patient with people with dementia when out in the community6  Make sure staff/co-workers are educated about effective communication strategies when interacting with people with dementia7

 

Adapt current services or put new services in place for people with dementia7  Adapt current services or put new services in place for dementia caregivers7  Adopt employee benefits practices that are supportive of family caregivers of persons with dementia8

 

Make environmental changes in my organization or public space (e.g., establish places to rest or quiet rooms and spaces; maps/signage; lighting; contrasting surfaces)7

 

Are there any other actions you will take? Please list them below:     

Notes1 Adapted question from Alzheimer’s LA “Broken Sentences” worksheet for Dementia Friendly workshops. 2 Adapted question from Alzheimer’s Disease Knowledge Scale: Carpenter, B. D., Balsis, S., Otilingam, P. G., Hanson, P. K., & Gatz, M. (2009). The Alzheimer's Disease Knowledge Scale: Development and psychometric properties. The Gerontologist, 49(2), 236–247.3 Adapted question from Dementia Attitudes Scale: O’Connor, M. L., & McFadden, S. H. (2010). Development and psychometric validation of the Dementia Attitudes Scale. International Journal of Alzheimer’s Disease. 2010. doi:10.4061/2010/4542184 Adapted question from Lintern, T., & Woods, B. (1996). Approaches to dementia questionnaire. University of Wales, Bangor, UK.5 Adapted question from Pittinsky, T. L., Rosenthal, S. A., & Montoya, R. M. (2011). Measuring positive attitudes toward outgroups: Development and validation of the Allophilia Scale. In L. R. Tropp & R. K. Mallett (Eds.), Moving beyond

Page 26: Measuring the Impact of Dementia-Friendly Education and ...  · Web view, peer-reviewed literature of validated measures and evaluations of local dementia-friendly efforts served

24prejudice reduction: Pathways to positive intergroup relations (pp. 41-60). Washington, DC, US: American Psychological Association. http://dx.doi.org/10.1037/12319-002 6 Adapted from Dementia Friends USA “personal action steps.” 7 Adapted from the Dementia Friendly Wyoming Communities Evaluation and Impact Survey.8 Adapted from Dementia Friendly America – Dementia Friendly Community Metrics.


Recommended