+ All Categories
Home > Documents > EdTech 505 Evaluation Report

EdTech 505 Evaluation Report

Date post: 01-Nov-2014
Category:
Upload: vangie-dennler-beaver
View: 605 times
Download: 0 times
Share this document with a friend
Description:
 
Popular Tags:
16
Evaluation Report Boise State University Multicultural Student Services Tunnel of Oppression 2012 Report submitted by Evangeline Dennler-Beaver Faculty Member, University Foundation Program Assistant to the Multicultural Student Services Coordinator Assistant to the Student Diversity and Inclusion Director Graduate Student, Master of Educational Technology Program Boise State University Report submitted to VP Student Affairs, Boise State University
Transcript
Page 1: EdTech 505 Evaluation Report

Evaluation Report Boise State University Multicultural Student Services

Tunnel of Oppression 2012

Report submitted by

Evangeline Dennler-Beaver

Faculty Member, University Foundation Program

Assistant to the Multicultural Student Services Coordinator

Assistant to the Student Diversity and Inclusion Director

Graduate Student, Master of Educational Technology Program

Boise State University

Report submitted to

VP Student Affairs, Boise State University

Page 2: EdTech 505 Evaluation Report

1

Table of Contents

Summary-------------------------------------------------------------------------------------------------

2

Description of the Program Evaluated---------------------------------------------------------------

Program Objectives--------------------------------------------------------------------------------

Program Components------------------------------------------------------------------------------

3

3

3

Evaluation Method--------------------------------------------------------------------------------------

Participants------------------------------------------------------------------------------------------

Procedures-------------------------------------------------------------------------------------------

Data Sources----------------------------------------------------------------------------------------

4

4

4

4

Results---------------------------------------------------------------------------------------------------

Objectives and Activities------------------------------------------------------------------------

Participants' Feedback---------------------------------------------------------------------------

Goal Attainment----------------------------------------------------------------------------------

5

6

7

8

Discussion----------------------------------------------------------------------------------------------

8

Recommendations-------------------------------------------------------------------------------------

9

Project Cost---------------------------------------------------------------------------------------------

10

Appendices----------------------------------------------------------------------------------------------

Appendix A: Campus Update invites participants to register for the

Tunnel of Oppression----------------------------------------------------------------------------

Appendix B: Facebook; MSS invited friends to register for Tunnel---------------------

Appendix C: Participant Information and Informed Consent------------------------------

Appendix C: Pre-Survey to be completed before walking through the Tunnel--------

Appendix D: Post-Survey to be completed after debriefing-------------------------------

11

12

13

14

15

16

Page 3: EdTech 505 Evaluation Report

2

Summary

Boise State University’s Multicultural Student Services, along with co-sponsorship by the

student clubs Boise Filipino American Relations Club and Diversity Association (BARCADA)

and Gamma Beta Phi, presented the eighth Tunnel of Oppression (TOP) on campus this fall.

TOP is an interactive program to highlight oppression and its negative effects.

The university community and the public had the opportunity to learn about issues of oppression

that effect different groups both locally and globally.

The program also highlighted how easily oppression can be perpetuated. For example, when a

racist statement is made and bystanders do nothing and remain silent, oppression continues. In

remaining silent, bystanders contribute to the continuation of aggression, that although small, can

build up and cause damage to people affected by historically-oppressed groups, such as women,

People of Color and the LGBTQ (Lesbian, Gay, Bisexual, Transgender, Queer and Questioning)

community.

Student committees chose the topics: racism, size-ism, transgender issues, global education

issues, and war on women. Each committee developed their own script, props, and scene under

the guidance of the Tunnel Director.

This evaluation is to determine whether the objectives were met, to determine the number of

people registered to go through the Tunnel, and if it was necessary to present the program in two

parts, such as fall and spring. A pre-survey was given to people before they enter the Tunnel and

a post-survey (same as the pre-survey) was given following the debriefing. To determine if

learning outcomes were achieved, participants filled out the questionnaires.

The purpose of this evaluation is to determine different variables and different views of the

campus community and the public, people who may experience oppression or allies who may

recognize situations but cannot articulate. In addition, gathering data is to assess and interpret

outcomes on the impact of the program.

Another purpose of this evaluation is to determine the participants’ challenges, connecting what

they have seen in the Tunnel with personal experiences. Evaluating this program is to examine

the impact of the program on the participants. Therefore, evaluation is essential in any program

or project to justify a request for funding and the importance of the planning process.

This final evaluation aims to describe and understand how oppression moves participants into

action. It contains a description of the program, evaluation procedures, a presentation of

evaluation results, and discussion of the program and its results for future use by others who

want to raise awareness of oppression. This report provides formative and summative data to

help determine the future of TOP and how it presents different types of oppression in our society

and around the world.

The evaluation of the Tunnel of Oppression program was successful in analyzing the data

collected and providing insight into the participants’ knowledge—the evaluation is an important

tool to build and expand this interactive program. The survey and evaluation of the Tunnel of

Oppression revealed results of making a positive impact in people’s lives.

Page 4: EdTech 505 Evaluation Report

3

Description of the Program Evaluated

The Tunnel of Oppression aims to define and understand what oppression is and recognize what

forms it takes to urging participants into action by humanizing the issues of traditionally and

historically-oppressed groups, providing participants an opportunity to distinguish between the

voices of the underrepresented and the voices of the dominant culture. At the end of the

program, participants will be able to:

Program Objectives

1. Determine the number of people that registered to go through the Tunnel.

2. Determine different variables of the campus community and the outside community and

to seek a stream-of-consciousness raising on campus.

3. Determine different views of how participants may experience oppression and how allies

may understand but cannot articulate their views

Program Components

The program included registration to walk through five different theaters: racism, size-ism,

transgender issues, global education, and the war on women. Participants arrived at least 15

minutes early to check in and sign a consent form. The purpose of the pre-survey was to

determine how much knowledge and understanding participants had about oppression, and if

they had the ability to formulate constructive, ethical responses. After the Tunnel experience,

participants attended a debriefing, then a post-survey (same as the pre-survey) was given to

measure if their understanding of oppression had increased.

The program was presented in 9 different sessions in 30-minute blocks, including debriefing.

The debriefing was conducted by faculty and five graduate students in the counseling program,

and two of the debriefers were professional counselors.

Page 5: EdTech 505 Evaluation Report

4

Evaluation Method

Participants

The participants in the program were students, staff/faculty, and community members who

answered pre-survey and post-survey questions, collected data, and who provided feedback for

the improvement of the evaluation process. The school news Update was sent out to invite

students, staff/faculty, and community members to register for a walk-through of the Tunnel.

TOP invitations were also posted on Facebook, inviting participants to register for a walk-

through.

Procedures

The program evaluation was conducted on Nov. 8-10, 2012, looking for goals attained and the

impact of the theater topics on the success of the program. The participants filled out a

questionnaire with answers for strongly agree, moderately agree, neutral, disagree, and strongly

disagree in a check box scale to find out if the learning outcomes were achieved. The post-survey

was completed after debriefing.

Data Sources

Copies of the questionnaires can be found in the Appendices and the monitoring process

identified to meet the stated goal. Surveys given to the participants are to determine different

variables of the campus community and the outside community and to seek a stream-of-

consciousness raising on campus.

The survey also provided information on how participants may experience oppression, and how

allies may understand oppression but cannot articulate their thoughts. The questionnaire was also

used to assess continued personal growth and identity development as well as to promote

staff/faculty awareness which would then be advantageous to both students and the campus

community. Lastly, a critique of Dr. Harris, Vice President of Student Affairs, employed a

critical review of the program, providing useful feedback used to assess the costs for

recommended additional funding.

Page 6: EdTech 505 Evaluation Report

5

Results

Objectives and Activities

Below are the results of the online registration in relation to the program objectives. The

participants completed the online registration to reserve a spot in blocks of 30 minutes.

Objective 1: Determine the number of people registers go through the Tunnel.

All the participants registered and signed the consent form (see Appendix C). There were 954

participants registered to go through the Tunnel. Results appear above, revealing that the

objective was met.

Objective 2: Determine different variables of the campus community and the outside

community to seek a stream-of-consciousness of oppression on campus.

Responses to the pre-survey/post-survey questions dealing with oppression due to racism are

shown below in Figure 1. Eighty-one percent of the participants have experienced oppression at

some time. One percent of the participants strongly agree, eight percent moderately agree, ten

percent Neutral, forty-eight percent disagree, and thirty-three percent strongly disagree that

racism is no longer a problem in today’s society. These numbers indicate that there is a vital role

for a program like Tunnel of Oppression to assist people in understanding the concepts of

struggling with racism.

According to the responses to pre-survey/post survey question six, the Boise State community is

inclusive of all people as shown below in Figure 2. One hundred percent of the participants

recognize that Boise State community is inclusive of all people. These numbers indicate growth

for Boise State being all inclusive.

Page 7: EdTech 505 Evaluation Report

6

Figure 1.

As a result, the assessment is determined that this objective was met.

Figure 2.

As a result, the assessment is determined that this objective was met.

Objective 3: Determine different views of how participants may experience oppression and

of how allies who may understand but cannot articulate.

Questionnaire responses appear below in Figure 3. Ninety-four percent of the participants

concluded that they thought they would be less frustrated if they could recognize unintentional

Page 8: EdTech 505 Evaluation Report

7

bias instead of disregarding the issues in today’s society. In this survey, several participants

recognized micro-aggression and it helped them understand the essence of cultural differences.

Figure 3.

As a result, the assessment determined that this objective was met.

Participants' Feedback

1. I learned to explore my gender socialization and how my circumstances have shaped the

way I identify as a male.

2. Power and oppression affect various dimensions of social life and are situated in history

and culture.

3. Eye opening, interesting, happy to end my ignorance, I wish I was more exposed.

4. What an impact experience, all of the staff and actors for Tunnel are changing our world.

5. As a white male, a sense of control via guilt is implemented on me because of these acts.

6. Tough experience, very worthwhile, wonderful students who participated in acting, great

messages.

7. Amazingly, it was disturbing to see everything and hear other peoples' tales afterwards.

8. Great production, very eye-opening and powerful.

9. The Tunnel really makes you aware of things that you can say “lightheartedly” that really

hurt others.

Page 9: EdTech 505 Evaluation Report

8

Goal Attainment

Overall results: after reviewing all records and examining the activities, the evaluation concludes

that the Tunnel of Oppression program successfully attained all thereof the program objectives.

Discussion

The purpose of the evaluation was to determine how well the TOP fulfills the program

objectives. It was determined that the Tunnel has the potential of offering more options for Boise

State students than is currently available. This evaluation shows that there was a significantly

positive impact in people understanding from experiencing this interactive theater. The findings

of this evaluation have also lead to the continuation of the program.

Objective 1: Determine the number of people register to go through the Tunnel. The data provided by the participants’ registration and there were 954 participants registered go

through the Tunnel. The report reflects a general awareness that shows a high number of people

registered. As a result of these assessments, it is determined that the objective was met.

Objective 2: Determine different variables of the campus community and the outside

community to seek a stream of consciousness raising to campus.

A pre-survey/post-survey participants' responses indicated that power and oppression affects

various dimensions of social life and situated in history and culture. The definition of oppression

and what is formed it takes a little time to process everything. After the debriefing, the

participants were required further discuss Tunnel of Oppression. As a result of these

assessments, it is determined that the objective was met.

Objective 3: Determine different views that participants may experience oppression or

allies that may understand and cannot articulate.

Feedback carried out by the participants and Dr. Harris, Vice President of Student Affairs,

showed that this program was viable to continue for spring 2013. Participants felt that the Tunnel

provided training that raises awareness. The Tunnel also highlights how to dismantle systematic

oppression and help participants identify unconscious bias that creates a more inclusive

environment.

According to the data, the opinions expressed in this interactive program are considered artistic

and political expressions in the best tradition of the participants' first amendment rights.

Participants gain knowledge that allows them to take ownership of their learning. The program

helps participants recognize unintentional biases and participants exposed to the Tunnel play a

significant role in the future for addressing local, national and global issues of oppression.

In conclusion, the analysis result determined that the program objective was met. The evaluation

of the Tunnel of Oppression was successful in analyzing the data collected and providing insight

into participants’ thoughts and feelings. Results are what the program staff expected. However,

there are recommendations that will help the Multicultural Student Services expand their

resources for all students at Boise State University.

Page 10: EdTech 505 Evaluation Report

9

Recommendations

It is essential that the Tunnel of Oppression at Boise State University receive funding to continue

in spring 2013. The operation of the program needs additional resources for future production

because it requires many weeks of planning, training and implementing.

The Tunnel of Oppression is an excellent opportunity for all people to learn about oppression

and how to deal with it appropriately, including prevention. The program brings to light the

campus climate and modern forms of oppression. After reviewing the post-survey data, proposals

for the spring Tunnel 2013 will define expectations and guidelines for scenes, utilize the

University Foundation program faculty, continue the post-discussion group, and the timeline to

promote the registration two months in advance.

Conclusion

The evaluation of the Tunnel of Oppression program was successful in analyzing the data

collected and providing insight into the participants’ knowledge—the evaluation is an important

tool to build and expand this interactive program. The survey and evaluation of the Tunnel of

Oppression revealed results of making a positive impact in people’s lives.

Page 11: EdTech 505 Evaluation Report

10

Project Cost

Beaver Consulting Evaluation Solutions

Services

5803 W. Poplar Dr.

Boise, ID 83704

Phone 208-283-5146 Fax 208-258-3073

INVOICE

INVOICE #[100]

DATE: JANUARY 6, 2013

TO:

Ro Parker, MSS Coordinator

Multicultural Student Services

1910 University Dr.

Boise, ID 83725

208-426-5950

FOR:

Evaluating the Tunnel of Oppression

Make all checks payable to Beaver Consulting Evaluation Solution Services

Total due in 15 days. Overdue accounts subject to a service charge of 1% per month.

DESCRIPTION HOURS/DAYS RATE AMOUNT

Evaluator’s services: 15 days $500.00/day $7,500.00

Creating survey; Data Analysis;

Writing Report

Supplies/Materials:

Printing Services

Office Supplies

$1,000.00

$1,500.00

TOTAL $10,000.00

Thank you for your business!

The evaluator cost of the evaluation is for services rendered. The cost includes reviewing the Tunnel of

Oppression program, creating data collection (pre-survey/post survey questions), data analysis, and

preparation of the final evaluation report. The total time spent is calculated at 15 days at the rate of

$500 per day. Supplies/materials cover printing services and office supplies. To contain expenses,

BCESS will disseminate copies of the final report electronically and mail a hard copy.

Page 12: EdTech 505 Evaluation Report

11

Appendix A: Campus Update invites participants to register for a walk-through of the

Tunnel of Oppression.

STUDENT NEWS

Boise State University Multicultural Student Services Presents Annual “Tunnel of Oppression”

The Tunnel of Oppression will return to Boise State University for its eighth year at 1pm Nov. 8

and 10am on Nov 9 and 10 in the Student Union Simplot Ballroom.

The Tunnel is a visual, theatrical and interactive production that helps raise consciousness about

various forms of oppression. Visitors pass through a series of dramatic vignettes and learn about

the many forms of discrimination. This year's theme is "Are you free when others are

oppressed?"

After each presentation, participants will be able to discuss the program’s content in groups

staffed by student leaders, administrators and counselors. Multicultural Student Services presents

the Tunnel to promote a campuswide commitment to challenging oppression and to help

recognize people and organizations actively committed to social justice. Social justice

organizations will be on hand to discuss ways to get involved with the community.

Registration is available for individuals and groups at mss.boisestate.edu. For more information

or to volunteer, call (208) 426-5950.

Page 13: EdTech 505 Evaluation Report

12

Appendix B: Facebook; MSS invited friends to register for Tunnel

Page 14: EdTech 505 Evaluation Report

13

Appendix C: Participant Information and Informed Consent: To be signed before walk-

through Tunnel.

The Tunnel of Oppression is designed to give participants a very direct and emotional learning experience

around issues of diversity, cultural differences, oppression, and discrimination. This experience may be

upsetting and might leave you with strong feelings of sadness, anger, fear, or other intense emotions.

Most who participate in this program find it beneficial in the long run and are able to manage their

emotions. However, some participants may experience strong negative reactions that may feel

unmanageable.

If at any time you need to exit the Tunnel, please let your guide know and we will make the

necessary arrangements.

If you have a history of direct experience with oppression, violence, or discrimination, this program may

cause you to feel as though you are reliving those experiences, which can be uncomfortable.

Participation in this program is not required. If a faculty member has sent you to the Tunnel, she or

he should have told you this experience is optional. If you are receiving course credit for participation,

you should have been given options of other activities or projects that will earn you the same credit. If

this is the case, please notify the program staff of the course name/number and the name of your

professor, and we will make the necessary arrangements for you to be allowed to participate in an

alternative activity.

You may be asked to go through part of the Tunnel impaired with a disability. If you do not want this,

please let your guide know. You may also be exposed to explicit or graphic language. This is to

authentically recreate the oppression that many marginalized groups face and is solely for the purpose of

raising awareness. You should at no time feel you have to respond to any actors engaging you.

There will be a debriefing room available with staff to help you talk about your reactions and feelings

after you have experienced the Tunnel. However, if you are concerned that you will be strongly,

negatively impacted by participation, please leave before the program gets underway. There will be

no negative judgments of you by faculty or staff leading the program. If you decide to stay, please know

that you will be given a chance to debrief with staff. Please turn off your cell phone!

If at any time after the event you need to discuss your reactions with someone, Boise State students may

contact the staff at Counseling Services at 426-1601, or visit the office located in Taylor Hall, Room

B103. Non-students may call 211 and ask for a counselor referral or maybe referred by on-site counselors.

I have read the information above and agree to participate in this activity.

_____________________________ ___________________________

Printed Name Signature

________________________________________

Signature of Parent (If participant is under 18.)

To improve the Tunnel of Oppression experience in the future, and to better understand how it

may have impacted participants, please provide your email address in the space below. We will

contact you by email within the next two weeks with a link for you to fill out a confidential survey.

Please print clearly.

EMAIL:______________________________________________________________________________

Page 15: EdTech 505 Evaluation Report

14

Appendix C: Pre-Survey to be completed before walking through the Tunnel.

1. What is your gender identification?_______________

2. What is your age?_______________

3. What is your racial identification? ________________

4. What is your relationship with Boise State?

Student Staff/Faculty Community

Please indicate whether you agree with the following questions, if you strongly agree you should circle 5. If you

agree moderately, you should circle number 4, if you neither agree nor disagree, you should circle number 3.

5. Racism is no longer a problem in today’s society.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

6. Boise State community is inclusive of all people.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

7. Women’s bodies are more likely to be controlled by society than men’s.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

8. I am aware of how my actions impact others who are not like me.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

9. Generally, I consider myself more a citizen of the world than a citizen of a country.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

Page 16: EdTech 505 Evaluation Report

15

Appendix D: Post-Survey to be completed after the debriefing.

1. Racism is no longer a problem in today’s society.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

2. Boise State community is inclusive of all people.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

3. Women’s bodies are more likely to be controlled by society than men’s.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

4. I am aware of how my actions impact others who are not like me.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

5. Generally, I consider myself more a citizen of the world than a citizen of a country.

Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree

5 4 3 2 1

6. Comments:


Recommended