+ All Categories
Home > Documents > Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees...

Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees...

Date post: 06-Jul-2020
Category:
Upload: others
View: 8 times
Download: 0 times
Share this document with a friend
39
Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment, Trinity College Duke University
Transcript
Page 1: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Developing Learning

Outcomes for Student Employees

Aligning assessment practice with student learning outcomes

Office of Assessment, Trinity College

Duke University

Page 2: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Presentation overview

Background - What are our commitments?

How are our commitments aligned?

Setting up the student employee experience

to support these commitments.

Assessing student employee movement

towards established learning outcomes.

Page 3: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our commitments

To the Trinity College of Arts & Sciences

mission:

Supporting students as they

“learn to communicate persuasively,

bring meaning to information,

discern competing claims, and

develop capacity for reasoning,

analysis, and empathy”.

https://trinity.duke.edu/academic-affairs

Page 4: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

The practice of assessment

The Office of Assessment’s objectives

include

Providing on-going analysis and research on Duke's

undergraduate curriculum to improve student learning.

Consulting with, guiding academic programs to

practice quality assessment locally.

Developing assessment technologies, enterprise

platforms, measuring instruments to support

assessment.

Participating in regional and national dialogue about the practice of assessment

Page 5: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

The practice of assessment

The Office of Assessment’s objectives

include

Providing on-going analysis and research on Duke's

undergraduate curriculum to improve student learning.

Consulting with, guiding academic programs to

practice quality assessment locally.

Developing assessment technologies, enterprise

platforms, measuring instruments to support

assessment.

Participating in regional and national dialogue about the practice of assessment

Page 6: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

High Impact Practices in

Education

Undergraduate Research:

is in-depth, and complements or extends

previous learning

Is conducted under the guidance of

faculty or institutional mentor and typically

integrated into or related to the mentor's

work

asks and addresses relevant questions

using the methodologies of the discipline

Page 7: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Aligning these commitments

Institutional mission

Undergrad. research

[high impact practice]

The practice of assessment

Page 8: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Institutional mission

Undergrad. research

[high impact practice]

The practice of assessment

What student

employment

opportunities

can be

created at this

intersection?

Aligning these commitments

Page 9: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our commitment

Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.

Student Development Through Employment

Page 10: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our commitment

Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.

Student Development Through Employment

Page 11: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our commitment

Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.

Student Development Through Employment

Page 12: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our commitment

Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.

Student Development Through Employment

Page 13: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our commitment

Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.

Student Development Through Employment

Page 14: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our commitment

Bentrim, E., Sousa-Peoples, K., Kachellek, G., and Powers, W. (Mar/Apr 2013). Learning Outcome Domains and Related Skills/Variables. Diagram. About Campus, Vol. 18 Issue 1, p30.

Student Development Through Employment

Page 15: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Institutional mission

Undergrad. research

[high impact practice]

The practice of assessment

What student

employment

opportunities

can be

created at this

intersection?

Aligning these commitments

Page 16: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Guiding principles for the

OATC RA Experience

Exposes undergraduate student researchers to basic research methods in education

Provides structured educational opportunities outside the classroom

Challenges undergraduates to identify learning outcomes important to their intellectual and professional interests, and develop artifacts that demonstrate learning

Page 17: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Guiding principles for the

OATC RA Experience

Promotes understanding of evidence-based

decision-making

Builds awareness and appreciation for the

assessment community in higher education

Intentional

Page 18: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Guiding principles for the

OATC RA Experience

Promotes understanding of evidence-based

decision-making

Builds awareness and appreciation for the

assessment community in higher education

Intentional

Page 19: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Setting up the Experience

1. Learning Objectives

Define big picture concepts and goals for the research assistant and the office

2. Competencies

Clarify the skills research assistants will develop in pursuit of those goals

3. Outcomes

Students will demonstrate those skills in observable and meaningful ways

Page 20: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

1. Defining learning objectives

Examples of objectives defined by Office of

Assessment

• Be able to organize and make sense out of large data

sets

• Be able to use appropriate software packages to

analyze and report on relevant data

Examples of objectives defined by undergraduate

RA

• Develop skills and experiences in data analysis that support future job placement

• Apply knowledge learned in the classroom to answer

real world questions

Page 21: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

2. Clarifying competencies

What skills will the RA demonstrate as a result

of their work with the OATC? Examples:

• the ability to construct surveys using enterprise

survey software (Qualtrics)

• the ability to manage and manipulate large data

sets using Excel and SAS analytic software

• the ability to discuss patterns and trends observed

within the reports they produce

Page 22: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

3. Articulating learning outcomes

Specifically, how will the RA demonstrate movement towards their expected learning objectives and competencies? Examples:

• The RA will accurately update the pre and post program surveys for “Program A”

• The RA will produce a summary of bio-demographic data on “Program A” participants by sorting and merging “Program A” participant roster and aggregate student data files in SAS.

Page 23: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Outcomes aligned with our

commitments

Institutional mission

Undergrad. research

[high impact practice]

The practice of assessment

Page 24: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Organizing the learning

experience

How do we organize, scaffold,

and evaluate the RA learning

experience?

Page 25: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Organizing the learning

experience

Vanderbilt University Center for Teaching

Page 26: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Organizing the learning

experience

https://www.emporia.edu/studentlife/learning-and-assessment/guide/domains.html

Page 27: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Organizing the learning

experience

Outcome Remember Understand Apply Analyze Evaluate Create

Outcome 1End of

trainingEnd of year

1End of year 2

Outcome 2End of

trainingEnd of year

1End of year 2

Outcome 3 End of term 2 End of term 2

Page 28: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Organizing the learning

experience

Project 1 Project 2 Project 3 Project 4

Outcome 1 Remember Understand Analyze Evaluate

Outcome 2 Remember N/A Apply Analyze

Outcome 3 N/A Understand N/A Analyze

Outcome 4 N/A Apply Evaluate N/A

Page 29: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Organizing the learning

experience

Project 1 Project 2 Project 3 Project 4

Outcome 1 Knowledge Application Analysis Synthesis

Outcome 2 Knowledge N/A Comprehension Analysis

Outcome 3 N/A Application N/A Analysis

Outcome 4 N/A Comprehension Synthesis N/A

Using a curriculum map:

1. Encourages alignment of RA

learning outcomes with specific

work opportunities

2. Provides structure for scaffolded

training and support

3. Provides structure for

developmental performance

evaluations

Page 30: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our RA employment model

Mentorship

Hiring and evaluation

Training

Project management

Required resources

Page 31: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our RA employment model

Mentorship

Hiring and evaluation

Training

Project management

Required resources

This is a learning experience –

be ready to discuss

challenges, provide insight,

develop solutions. We:

1. Provide clear descriptions

of work (background,

context, technical

requirements, expected

outcomes)

2. Provide regular,

constructive feedback

3. Expose RA to progressively

more challenging work

opportunities

Page 32: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our RA employment model

Mentorship

Hiring and evaluation

Training

Project management

Required resources

• Advertise at the

beginning of Fall term

• Primarily target 2nd year

students• Encourage 2 year

commitment

• Provide opportunity to

develop marketable skills

and gain specialized work

experience moving into

4th year

• Priority of specific skills and

qualifications may

depend on expected

projects. Majors vary.

Page 33: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our RA employment model

Mentorship

Hiring and evaluation

Training

Project management

Required resources

Develop foundational skills

for our work.

Expect resourcefulness, effective help-seeking,

creative problem-solving.

Develop training modules

and readings for key

applications, including:

• Qualtrics

• SAS

• Excel

Page 34: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our RA employment model

Mentorship

Hiring and evaluation

Training

Project management

Required resources

Start small and prioritize.

Approach supervision as a

teaching/learning

experience (not sink or

swim).

Assign projects and tasks in

an intentional way.

Put projects into context.

Provide follow-up.

Page 35: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Our RA employment model

Mentorship

Hiring and evaluation

Training

Project management

Required resources

Time for quality mentorship

• Project planning

• Effective feedback

Salaries

• $10/hour in year 1

• Possibility of increases over

time as responsibilities

increase

Space

• Dedicated computer and

reasonable office space

Page 36: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Institutional mission

Undergrad. research

[high impact practice]

The practice of assessment

What learning

outcomes can

we develop at

this

intersection?

Our Commitments Aligned

Page 37: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Institutional mission

Undergrad. research

[high impact practice]

The practice of assessment

Sound like a lot

of work! What

benefits do we

see?

Our Commitments Aligned

Page 38: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

Benefits for our office:

InnovationRAs bring a variety of novel skills (e.g., Visual Basic) and

experiences (e.g., social networking platforms) which inform our

work and expand our overall capabilities.

InsightRAs have lent important student-level perspectives to research

design and execution.

Highly skilled workSmart, hard-working, ambitious, autonomous workers and thinkers.

Bottom-line:

We can get more done with fewer full time staff by providing

learning and professional development opportunities for RAs

– for whom our work is a compelling intellectual challenge.

Page 39: Developing Learning Outcomes for Student …...Developing Learning Outcomes for Student Employees Aligning assessment practice with student learning outcomes Office of Assessment,

For discussion:

How might an undergraduate RA or student employment model fit in your office/organization? What challenges might you face?

What 2-3 actionable steps could you take on your campus to promote a similar model?

What are some additional ways to promote the mission and culture of your institution in conjunction with the work you’re currently doing?


Recommended