Building Data Moments in the Midst of Your Student

Affairs Work

I am Matt W. CummingsPurpose Builder, Civic Leader, Digital Enthusiast

@mattwcummings

Hello!

Why Data?We’re gonna move fast... 1

“Too often, assessment is seen as an afterthought rather than an integral

part of the program or service planning and implementation

process. -Gavin Henning

Where is #SApro field going...

◉ Trending towards a culture of assessment

Where is #SApro field going...

◉ Trending towards a culture of assessment◉ $$$ are we worth it

Where is #SApro field going...

◉ Trending towards a culture of assessment◉ $$$ are we worth it◉ Cash gained through students retained

Leadership ModelDePauw Community Service 2

Data Moments in the DePauw Community Service Leadership Model

Data Moments in the DePauw Community Service Leadership Model

1x1 Advising◉ DCS Coordinators

meet every other week with an advisor.

◉ “Active Mentoring” questions are developed based on SLOs

◉ Conversations Recorded

Data Moments in the DePauw Community Service Leadership Model

1x1 Advising◉ DCS Coordinators

meet every other week with an advisor.

◉ “Active Mentoring” questions are developed based on SLOs

◉ Conversations Recorded

Monthly Meetings◉ Monthly meetings

follow SLOs◉ Guest speakers◉ Qualitative

information gathering

◉ Student Leadership Challenge Assessment

Data Moments in the DePauw Community Service Leadership Model

1x1 Advising◉ DCS Coordinators

meet every other week with an advisor.

◉ “Active Mentoring” questions are developed based on SLOs

◉ Conversations Recorded

Monthly Meetings◉ Monthly meetings

follow SLOs◉ Guest speakers◉ Qualitative

information gathering

◉ Student Leadership Challenge Assessment

EOY Blogs◉ Capture impact on

experience.◉ Skills gained.◉ Ask permission to use

quotes for marketing.

Our Approach

◉ Design quality SLOs. ◉ (Its ok to cheat and use the AACU Value Rubrics)

Our Approach

◉ Design quality SLOs. ◉ (Its ok to cheat and use the AACU Value Rubrics)

◉ Ask “how will students demonstrate learning?”◉ Blogs, Journals, Group Meetings, 1x1s, Conversation, Art, etc..

Our Approach

◉ Design quality SLOs. ◉ (Its ok to cheat and use the AACU Value Rubrics)

◉ Ask “how will students demonstrate learning?”◉ Blogs, Journals, Group Meetings, 1x1s, Conversation, Art, etc..

◉ Discover your results◉ Thematic Analysis, Descriptive Statistics

OUR SLOs

◉ Provides evidence of experience in civic-engagement activities and describes what a person has learned about oneself as it relates to a reinforced and clarified sense of civic identity and continued commitment to public action. (Civic Identity and Commitment)

OUR SLOs

◉ Provides evidence of experience in civic-engagement activities and describes what a person has learned about oneself as it relates to a reinforced and clarified sense of civic identity and continued commitment to public action. (Civic Identity and Commitment)

◉ Demonstrates independent experience and shows initiative in team leadership of complex or multiple civic engagement activities,accompanied by reflective insights or analysis about the aims and accomplishments of one’s actions. (Civic Action and Reflection)

Civic Identity and Commitment 1x1 Questions

◉ Does this experience impact your civic responsibility or social/political responsibility (social understanding)?

◉ Has anything surprised you about your service experience? If so, why?

◉ What are the 5 most important values to you? Why?◉ Have any of your values changed because of your community

service experience? Were any of your values challenged?◉ How did community service become important in your life?

Civic Action and Reflection: 1x1 Questions

◉ What impact does your program have in the community?◉ What population is being served?◉ What more needs to be done to address the needs of the

community?◉ What skills have you utilized? What skills have you developed?◉ Do you think your work has made a positive impact?◉ What have you accomplished? (What are you proud of?)

Group Meetings◉ September-Orientation and Team Building◉ October- TFA, City Year, Peace Corps Panel◉ November-Hubbard Center-Resume Workshop, Summer Grant

Readiness◉ December-End of Semester Celebration◉ February-Orientation Team Building◉ March- Student Leadership Challenge Assessment◉ April- Community Partner◉ May-End of Year Celebration

Thematic Analysis and Qualitative Approaches

Thematic Analysis and Qualitative Approaches

◉ Utilize existing rubrics to assess student writing (AACU Rubics)◉ Thematic Analysis:

◉ Read through responses◉ Notice themes◉ Identify themes with “code words”

Thematic Analysis and Qualitative Approaches

◉ Utilize existing rubrics to assess student writing (AACU Rubics)◉ Thematic Analysis:

◉ Read through responses◉ Notice themes◉ Identify themes with “code words”◉ Example: Most students discuss an ethos of service becoming

important to them through a faith community or honors society.

Assessment vs Evaluation

Assessment: Demonstrates student

learning, more qualitative focus.

Evaluation: Combines assessment with overall effectiveness of the program. Heavier descriptive statistics.

Descriptive StatisticsQuantify Everything 3

Info we collect

◉ All volunteer information◉ Sign-in sheets at sites◉ Analysis:

◉ Race, Gender, Major◉ Frequencies of visits◉ Who volunteers the most

◉ First Year Students- who joins greek organizations

Digital Data

◉ Measure Facebook Growth◉ Impressions/Reach◉ ROI for Marketing/Paid Ads◉ Who opens our emails and frequencies (using Mailchimp)

What do we do with our data?

◉ EOY Reporting◉ Program Evaluation/Assessment◉ Grants. Fundraising. Outside $$$.◉ Presidential Honor Roll, NASPA Lead Certification◉ DePauw Website, Admissions Flyer, Marketing Materials, DePauw

Magazine.

Tips

◉ Avoid Likert Scales◉ Avoid pre/post test◉ Data Building is a multi-year phase. ◉ Learn Excel◉ Ask people for help

Homework Time

◉ What is the data that you collect now and what are you doing with it?

◉ What data would you like to know about your program?◉ What is a path you can take to achieve this outcome?