Thursday, January 12, 2012 1
Implementation of Blended Learning for the Improvement of Student Learning (IBIS)
inPOM 212 Business Statistics course
by
Bharatendra RaiDepartment of Decision and Information Sciences
Charlton College of BusinessUniversity of Massachusetts - Dartmouth
2011 IBIS cohort #2
2
Outline
Overview of POM 212 Business Statistics course
F2F components
Blended components
SLO Assessment plan
SLO measurement
Data collection/analysis of F2F Vs Blended
Results and conclusion
Overview of POM 212 Business Statistics course
Offered both as blended & online courseCore course for business studentsSmall population of students from liberal arts, computer science, electrical engineering, biology, etc.Sophomore and junior11 chapters covered4 tests
3
Overview of POM 212 Business Statistics course
Course descriptionExamines both descriptive and inferential statistics as applied to business. Topics include graphical and tabular methods of data presentation, probability theory and distributions, hypothesis testing, analysis of variance, regression and forecasting. Emphasis is placed on concepts, applications, and the proper use of statistics to collect, analyze, and interpret data. Throughout this course students will use computer software to perform statistical analyses. Students will learn how to make decisions using facts and the techniques of data analysis. Students will also use the internet to supplement classroom learning.
4
Overview of POM 212 Business Statistics course
Course objectivesBe introduced to statistical thinking and the ethical use of statistical methodsBe able to use Microsoft Excel to conduct statistical analysesBe able to work with tables and charts for business and industrial dataUnderstand basic probability and probability distributionsBe able to calculate measures of central tendency and dispersionBe introduced to the methods of regression & correlation analysisUnderstand how to utilize hypothesis-testing techniques to test business assumptionsBe able to apply tests of goodness of fit and independence to dataBe able to apply statistical techniques to real-life applied casesUnderstand how to use the regression model for prediction and forecasting in business.
5
Overview of POM 212 Business Statistics course
SLO identified for assessmentStudents will be able to understand statistical concepts and find solutions to data-based business problems.
6
F2F componentsControllable
lecturein-class team activitiesin-class report preparation and presentation
UncontrollableAbsenteeism
7
Blended components
Controllableonline quiz for each chapter – 3 attempts allowedpractice testarchives of recorded lecturesPowerPoint slides
Uncontrollableself-study by students
8
SLO Assessment planX Pre-course performanceY Performance based on F2F componentsZ Performance based on Blended (includes F2F)Z-Y Performance based on Blended only (excludes F2F)
9
SLO measurement
Data for X Based on a random sample of question from four tests administered during the semester
10
SLO measurement
Data for YFall 2011 class and Test-4 is used. Sample consists of 49 students.Test-4 with higher difficulty level offers better discriminative power.The test is administered online and will be available to students for two hours.Each student would receive 30 questions randomly from 40 which is one combination from over 847 million different combinations. Only F2F components will be used for Test-4 that will be based on chapters 10, 12, and 14.
11
SLO measurement
Data for Z Spring 2011 class for Test-4 will be used. Data already available with a sample of 44 students.
12
Data collection/analysis of F2F Vs Blended
13
X: Spr-2011 Pre-courseAverage = 28.7
X: Fall-2011 Pre-courseAverage = 28.8
Z: Spr 2011 Test-4 (Blended)Average = 79.4
Z: Fall 2011 Test-4 (F2F)Average = 86.9
Data collection/analysis of F2F Vs Blended
14
Spring 2011 Fall 2011
X: Pre-course Z: Blended X: Pre-course Y: F2F
Number of students 44 44 49 49
Average 28.7 79.4 28.8 86.9
Standard Deviation 15.7 13.8 16.6 8.8
95% confidence interval 28.7 + 4.8 79.4 + 4.2 28.8 + 5.0 86.9 + 2.7
Results and conclusion
15
The incoming student quality is assessed by administering a pre-course online quiz.No difference in the incoming student quality observed. (95% confidence interval: Spring 2011 28.7% + 4.8%; Fall 2011 28.8% + 5.0%).No statistical difference in the incoming student quality between two semesters under study makes the comparison between ‘blended’ and F2F valid.95% confidence interval for blended and F2F offering is 79.4% +4.2% and 86.9% + 2.7% respectively.Statistically significant difference in student learning for blended versus F2F is observed.Students offered F2F only scored about 7% higher than blended offering on a comparable test.
Peer-mentor Experience
16
Mentor: Chan DuProvided access to myCourses website for POM 212 course.Class visit by mentor - November 30, 2012.Meetings during IBIS sessions and several informal meetings during Fall 2011.Didn't work well: class visit planned during last week of the semester.