OUTCOMES OUTCOMES ASSESSMENTASSESSMENT

Developing and Implementing Developing and Implementing an Effective Planan Effective Plan

Principle 1. Outcome Principle 1. Outcome AssessmentAssessment Excellence in sport management Excellence in sport management

education is evaluated through education is evaluated through the assessment of student the assessment of student learning outcomes and learning outcomes and operational outcomes.operational outcomes.

Institution is required to have Institution is required to have developed and fully implemented developed and fully implemented an O/A process.an O/A process.

Creating the Outcomes Creating the Outcomes Assessment Plan Assessment Plan

1. Mission and Broad-Based Goals1. Mission and Broad-Based Goals

2. Student Learning Outcomes2. Student Learning Outcomes

3. Basic Skills Development3. Basic Skills Development

4. Student Personal Development4. Student Personal Development

5. Methods for Measuring 5. Methods for Measuring Effectiveness Effectiveness

Mission and Broad-Based Mission and Broad-Based GoalsGoals

Institution: Institution: Provide your institution’s Provide your institution’s approved mission & broad-based approved mission & broad-based goalsgoals

Sport Management Program: Sport Management Program: Provide Provide the approved broad-based goals for the approved broad-based goals for your sport management programyour sport management program

Measurement: Measurement: State how you will State how you will provide evidence that the goals are provide evidence that the goals are being accomplishedbeing accomplished

Student Learning Student Learning OutcomesOutcomes

What is a learning outcome?What is a learning outcome? Description of what Description of what

your students are your students are able to doable to do

Clear and Clear and measurablemeasurable

Related to the goals Related to the goals of the institution.of the institution.

Identify Identify measurement tools measurement tools you will use/Rubric you will use/Rubric designdesign

Institutional Goals

Program Learning Outcome

Communicate effectively both orally and written.

Comprehension and application of professional written and oral communication business skills.

Measure Attainment of Measure Attainment of Learning OutcomesLearning Outcomes

Identify a minimum of:Identify a minimum of:– two direct measurestwo direct measures– two indirect measurestwo indirect measures

Explain the process for how your Explain the process for how your measures will provide meaningful measures will provide meaningful resultsresults

Provide copies of your Provide copies of your instruments/rubrics in the appendixinstruments/rubrics in the appendix

Determine Measures and Determine Measures and Assessment ToolsAssessment Tools

Types of Measures:Types of Measures: Student Learning Outcomes (Direct)Student Learning Outcomes (Direct) Student Learning Outcomes (Indirect)Student Learning Outcomes (Indirect) Student Satisfaction (Indirect)Student Satisfaction (Indirect) Operational Effectiveness (Indirect)Operational Effectiveness (Indirect)

NoteNote: Two direct and two indirect : Two direct and two indirect measures are required.measures are required.

Direct MeasuresDirect Measures

Direct Measures:Direct Measures:DemonstratesDemonstrates direct evidence of direct evidence of

student learning student learning ExamplesExamples:: Comprehensive exams Comprehensive exams Standardized national exams Standardized national exams Pretest and posttest assessments Pretest and posttest assessments Portfolios Portfolios Capstone assessmentCapstone assessment

Pre/Post TestingPre/Post Testing

Develop test to address course content – Develop test to address course content – relate to CPC areasrelate to CPC areas

AdministrationAdministration– Embed within select courseEmbed within select course

Introduction to sport managementIntroduction to sport management Capstone seminarCapstone seminar

Set benchmarks for expected improvement Set benchmarks for expected improvement

Written & Oral Written & Oral Communication Communication AssessmentAssessmentWrittenWritten FormatFormat MechanicsMechanics GrammarGrammar Content Content OrganizationOrganization StyleStyle

Oral Oral CommunicationCommunication

Use of technologyUse of technology Presentation designPresentation design Speaks clearlySpeaks clearly EnthusiasmEnthusiasm Stays on topicStays on topic ContentContent Professional ImageProfessional Image

College Goals

Program Learning Outcome

Benchmark Measurement Tool

Communicate effectively both orally and written.

Comprehension and application of professional written and oral communication skills.

80% of the students will meet defined proficiency standards in writing skills using the writing rubric

80% of the students will meet defined proficiency standards in presentation skills using the presentation rubric

Written assignments in BU450 evaluated with Rubric

Presentations in BUS 311 evaluated with Rubric

Capstone Assessment Capstone Assessment

Capstone course measurements Capstone course measurements – Foundation courses used as a Foundation courses used as a

basis for instrument basis for instrument developmentdevelopment

Internship PortfolioInternship Portfolio Case studyCase study

Case Assessment - Case Assessment - Selection & Question Selection & Question DevelopmentDevelopment

Direct Measure – link to specific outcomeDirect Measure – link to specific outcome Define clear purposeDefine clear purpose

– What are you trying to measure?What are you trying to measure?– Broad range of outcomes vs. specific Broad range of outcomes vs. specific

areasareas Issues to considerIssues to consider

– Is the case comprehensive enough to Is the case comprehensive enough to address all areas being assessedaddress all areas being assessed

– Case selection for graduate and Case selection for graduate and undergraduate programsundergraduate programs

Case Selection & Question Case Selection & Question Development (cont.)Development (cont.)

Select Specific Learning OutcomeSelect Specific Learning Outcome– Demonstrate knowledge of the Demonstrate knowledge of the

fundamental principles of the sport fundamental principles of the sport management field. management field.

Cases and questions developed to Cases and questions developed to address this outcomeaddress this outcome

Questions tested, reviewed and refinedQuestions tested, reviewed and refined

Development Of Development Of Evaluation RubricEvaluation Rubric

Rubric developmentRubric development– Analysis of core sport management Analysis of core sport management

content areas and relevancy of content areas and relevancy of measurement through selected casemeasurement through selected case

– Evaluation criteria and weightings Evaluation criteria and weightings agreed uponagreed upon

Grading consistencyGrading consistency– TrainingTraining

Indirect MeasuresIndirect Measures

Indirect Measures:Indirect Measures:

Indirect evidence of student learning outcomes Indirect evidence of student learning outcomes (asking versus demonstrating)(asking versus demonstrating)

ExamplesExamples:: Internship evaluationsInternship evaluations National or program-specific student National or program-specific student

satisfaction surveys - NSSEsatisfaction surveys - NSSE Student SWOT analysisStudent SWOT analysis Alumni surveyAlumni survey

Basic Skills Basic Skills DevelopmentDevelopment Prepare a statement on the “Basic Prepare a statement on the “Basic

Skills” development program at your Skills” development program at your institutioninstitution

Describe how this is administered Describe how this is administered within the sport management dept.within the sport management dept.– Programs to help students with writing Programs to help students with writing

deficienciesdeficiencies– Tutoring servicesTutoring services

Personal Development Personal Development of Studentsof Students

Prepare a statement on the “Personal Prepare a statement on the “Personal Development” of students at your Development” of students at your institutioninstitution

Describe how this is administered within Describe how this is administered within your academic unityour academic unit– Special programs focused on personal Special programs focused on personal

development – student leadershipdevelopment – student leadership– First year seminarFirst year seminar

Measuring Program Measuring Program EffectivenessEffectiveness

Explain how you will measure the Explain how you will measure the effectiveness of your sport management effectiveness of your sport management programprogram

– Accomplishment of goals and objectives Accomplishment of goals and objectives in the strategic planin the strategic plan

– Retention dataRetention data– Graduation ratesGraduation rates– Teaching evaluationsTeaching evaluations– SWOTSWOT

Final Step – Action Final Step – Action PlansPlans

College Goals

Student Learning Outcomes

Benchmark Measurement Tool

Results Action Plan

Communicate effectively both orally and written.

Comprehension and application of professional written and oral communication business skills.

80% of the students meet proficiency standards in writing - measured using writing rubric

Written assignments

in BU210

and BU404

85.6% of the student in BU210 & BU404 met the standard

Continue to record scores for writing evaluation the these two courses.

Discuss the possibility of a standardized test in the core courses to meet this competency

Problem AreasProblem Areas

Direct measures – linking Direct measures – linking measure to specific outcomemeasure to specific outcome

Rubric development & data Rubric development & data collectioncollection– Go beyond use course gradesGo beyond use course grades

Role of teaching evaluationsRole of teaching evaluations

Useful ResourcesUseful Resources

http://course1.winona.edu/shatfield/http://course1.winona.edu/shatfield/air/rubrics.htmair/rubrics.htm

http://academic.scranton.edu/http://academic.scranton.edu/department/assessment/ksom/department/assessment/ksom/