04/20/23

Twin Cities Bush GrantPromoting Student Learning in Large

Classes

OMS 2550 Business Statistics

Dr. Steven C. Huchendorf, Jason Liu

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

Background

OMS 2550 - Business Statistics – 4 credit course Class size: 90 students

10-12 sections per year, Sophomore level Multiple formats: Honors, Evening, Day CSOM Undergraduate expansion class size: 120

Class format: Lecture / Discussion Section 1:15 hour Lecture Section T/Th– 90 students 50 minute Friday Discussion Section – 45 students

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

Background

Why Discussion Sections? Wilbert McKeachie – “When I began teaching in

1946…research demonstrated that better learning occurred if students had an opportunity to discuss the material.” (Teaching Tips, 11th edition, 2002, page 226)

Traditional response: Lecture/Discussion Section Led by T.A.s Students ask questions and discuss the material

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

The Challenge

Barriers to Learning Lack of Attendance

Culture of Friday Discussion Sections as “Optional” Hand back Homeworks / Exams

• How am I doing in the class? Quizzes implemented

Lack of consistency across Discussion Sections 6-8 T.A.s leading the discussion sections

Achieve ‘one voice’ between Instructor and T.A. T.A. TAP (Teaching Assistance Program)

• Weekly meetings with T.A. Team• Learning Outcomes provided• Structured activities

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

The Intervention

Course Redesign Eliminate the Discussion Section

• Add 50 minutes to the Lecture– Incorporate Active Learning Techniques / Classroom

Assessment Techniques (ALT-CATs) Recast the role of the T.A.

• Homework Preview ProcessTeam Roles Graduate Assistant – Jason Liu

• Survey Design & Data Analysis Undergraduate Assistant

• Analysis of ALT-CATs

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

The Intervention

Pedagogic Benefits Active lectures

• Incorporate ALTs-CATs in lecture Homework preview process

• Quicker feedback to students Eliminate historic lack of attendance in discussion

sections Greater potential for individualized instruction

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

Evaluation Design

Assess Two Domains

ATTITUDE – How the student feels Pre / Post - Student surveys on

• Usefulness, Confidence, Enjoyment, Motivation

ACHIEVEMENT – Student learning Pre / Post Test Test of Statistic Literacy (TSL)

• Learning and Confidence

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

TSL - Test of Statistics Literacy

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

Evaluation Design

Year 1 and Fall 2005 Experiment with ALT-CATs Pre-Test the Survey Instrument Pre-Test TSL

Spring 2006• Two sections of OMS 2550• Implement Experimental Design

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

TSL Results: Achievement Test of Statistics Literacy (TSL) - 20 Question Multiple-Choice Test

Pre vs. Post Test Results

Sco

re o

n T

SL

out

of 20 P

oin

ts

PostAchPreAch

20

15

10

5

0

17.18

10.09

Achievement: PreTSL vs. PostTSLOut of 20 Possible Points

Summer 2005, n=11

Mean score improvedfrom 50.45% to 85.9%

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

TSL Results: Achievement Test of Statistics Literacy (TSL) - 20 Question Multiple-Choice Test

Pre vs. Post Test Results

Sco

re o

n T

SL

out

of 20 P

oin

ts

PostAchPreAch

20

15

10

5

0

17.18

10.09

Achievement: PreTSL vs. PostTSLOut of 20 Possible Points

Summer 2005, n=11

Mean score improvedfrom 50.45% to 85.9%

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

TSL Results: Confidence

Test of Statistics Literacy (TSL)

Attitude99

% o

f Resp

onse

s

PostAtt99PreAtt99

90

80

70

60

50

40

30

20

10

0

81.1

10

Confidence: PreTSL vs. PostTSL% of Responses: I am 99% Confident of my answer

Summer 2005, n=11

Confidence Improved from10.00% Confident to 81.1%

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

TSL Results: Confidence

Test of Statistics Literacy (TSL)

Attitude99

% o

f Resp

onse

s

PostAtt99PreAtt99

90

80

70

60

50

40

30

20

10

0

81.1

10

Confidence: PreTSL vs. PostTSL% of Responses: I am 99% Confident of my answer

Summer 2005, n=11

Confidence Improved from10.00% Confident to 81.1%

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

ALT-CAT Survey

1 to 7 Likert-scale: 7 Strongly Agree, 1 Strongly Disagree

n = 39 students, Fall 2005

ALT-CAT Survey Question Mean

ALT-CATs are useful for learning the material 6.21

ALT-CATs add more to my learning compared to traditional lecture classes

6.05

ALT-CATs promote the development of a learning community

6.23

I am more confident of the material because of ALT-CATs

5.67

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

ALT-CAT Survey

Helpfulness of ALT-CATs for Learning the Material (Mean=6.2 out of 7)

Likert Scale 1 to 7

% o

f Resp

ondents

Strongly DisagreeDisagreeMildly DisagreeNeutralMildly AgreeAgreeStrongly Agree

18

16

14

12

10

8

6

4

2

0

2.6%

12.8%

41.0%43.6%

"ALT-CATs are helpful for learning the material"

MBA 6120 Fall 2005, n = 39

84% Agree orStrongly Agree

Twin Cities Bush Grant – Promoting Student Learning in Large Classes - Dr. S. Huchendorf, Jason Liu

Supporting Materials

ALT-CAT Examples ALT-CAT Analysis by Undergraduate Assistant ALT-CAT Assessment Survey TSL – Test of Statistics Literacy

Questions?

04/20/23

Twin Cities Bush GrantPromoting Student Learning in Large

Classes

OMS 2550 Business Statistics

Dr. Steven C. Huchendorf, Jason Liu