24
Stuart Palmer (@s_palm ) and Dale Holt Deakin University Crossing the divide: Student and staff responses to changing an institutional learning management system
| Date post: | 29-Nov-2014 |
| Category: |
Education |
| Upload: | stuart-palmer |
| View: | 350 times |
| Download: | 0 times |
Stuart Palmer (@s_palm ) and Dale HoltDeakin University
Crossing the divide: Student and staff responses to changing an institutional learning management system
Stuart Palmer (@s_palm ) and Dale HoltDeakin University
… or:Part past part (non-)fiction
WebCT LMS trialled in 2003All content migrated in by 2004D2L selected as replacement in 2010Phased cut-over in 2011New LMS fully online 2012
At Deakin University
Students 2004-20111
58
7
12
1011
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.5 3.0 3.5 4.0 4.5
Impo
rtan
ce
Satisfaction
♦ 2004• 2005 2011
2
6
4
39
13
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.5 3.0 3.5 4.0 4.5
Impo
rtan
ce
Satisfaction
♦ 2004• 2005 2011
1 Accessing unit guide and other unit information 2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources 4 Using the unit calendar5 Contacting teachers via internal unit messaging 6 Contacting students via internal unit messaging7 Reading contributions to online discussions 8 Contributing to online discussions9 Completing online quizzes/tests 10 Submitting assignments11 Receiving feedback on assignments 12 Working collaboratively in a group13 Reviewing unit progress
Staff 2004-2011
1 Accessing unit guide and other unit information 2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources 4 Using the unit calendar5 Contacting teachers via internal unit messaging 6 Contacting students via internal unit messaging7 Reading contributions to online discussions 8 Contributing to online discussions9 Completing online quizzes/tests 10 Submitting assignments11 Receiving feedback on assignments 12 Working collaboratively in a group13 Reviewing unit progress
1
4
37
129
11
1.5
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.0 2.5 3.0 3.5 4.0 4.5
Impo
rtan
ce
Satisfaction
♦ 2004• 2005 2011
2
5
6
810
13
1.5
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.0 2.5 3.0 3.5 4.0 4.5
Impo
rtan
ce
Satisfaction
♦ 2004• 2005 2011
Improving online learning and teachingCompetitive advantage via innovationA new direction for learning and teachingAdoption of open source IT systemsExpiry of current system vendor contractImproving back-office efficiencyConsolidating institutional IT systemsAcquisition of the current vendor by a competitor
The LMS WILL change, b/c
Students 2011-2012 Students 2011 Students 2012 Sample Population Sample PopulationNo. of respondents 1353 22760 1710 24805Response rate 5.95% — 6.89% —Gender Female 67.3% 59.5% 70.5% 59.9%Male 32.7% 40.5% 29.5% 40.1%Faculty Arts and Education 29.8% 30.4% 30.5% 31.3%Business and Law 28.8% 36.9% 26.6% 35.1%Health 22.8% 19.8% 26.3% 20.1%Science & Technology 17.0% 12.9% 15.6% 13.5%Other 1.6% — 1.1% —Campus Burwood 43.7% 50.3% 42.0% 49.8%Waurn Ponds 14.3% 12.1% 14.3% 12.5%Waterfront 7.4% 5.8% 7.3% 6.0%Warrnambool 3.3% 3.2% 4.4% 3.0%Off-campus 31.3% 28.6% 32.1% 28.7%Mean enrolment duration 2.42 years 2.24 years 2.33 years 2.22 years
Staff 2011-2012 Staff 2011 Staff 2012 Sample Population Sample PopulationNo. of respondents 263 2126 330 2291Response rate 12.37% — 14.40% —Gender Female 55.9 % 59.8 % 61.8 % 59.8 %Male 44.1 % 40.2 % 38.2 % 40.2 %Faculty Arts and Education 30.3% — 33.0% 24.3%Business and Law 26.3% — 20.3% 20.6%Health 29.2% — 32.4% 37.8%Science & Technology 12.4% — 13.3% 13.9%Other 1.8% — 0.9% 3.3%Age range <25 3.0% 2.8% 1.5% 2.7%25-29 4.9% 9.1% 7.0% 6.5%30-34 5.7% 14.5% 9.7% 12.2%35-39 13.3% 13.3% 9.4% 13.7%40-44 16.0% 14.8% 15.8% 14.1%45-49 15.6% 14.4% 19.1% 14.5%50-54 17.9% 14.3% 14.5% 14.2%55-59 10.6% 10.0% 11.8% 11.6%60-64 9.1% 6.0% 5.8% 7.5%>64 3.4% 0.9% 5.5% 2.9%Not indicated 0.4% — — —
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
56
7
8
9
10
1112
13
14
15
16
17
18
19
20
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
9
10
16
17
18
19
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Students 2011-20121
2
3
4
5
7
9
10
14
15
16
17
18
19
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
1 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
56
7
8
9
10
1112
13
14
15
16
17
18
19
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
56
7
8
9
10
1112
13
14
15
16
17
18
19
20
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Staff 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection21 Deakin's Learning Repository – Equella22 Respondus online quiz authoring tool
12
3
4
5
6
7
8 9
10
1112
13 14
15
16
17
18
19
20
2122
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.75 3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Staff 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection21 Deakin's Learning Repository – Equella22 Respondus online quiz authoring tool
12
358 911
12
13 14
15
16
17
18
19
2122
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.75 3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Staff 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection21 Deakin's Learning Repository – Equella22 Respondus online quiz authoring tool
12
35
6
7
8 9
10
1112
13 14
15
16
17
18
19
2122
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.75 3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Staff 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection21 Deakin's Learning Repository – Equella22 Respondus online quiz authoring tool
12
3
4
5
6
7
8 9
10
1112
13 14
15
16
17
18
19
20
2122
2.0
2.5
3.0
3.5
4.0
4.5
5.0
2.75 3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
56
7
8
9
10
1112
13
14
15
16
17
18
19
20
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
56
7
8
9
10
1112
13
14
15
16
17
18
19
20
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
56
7
8
9
10
1112
13
14
15
16
17
18
19
20
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Students 2011-20121 Accessing unit guide and other unit information2 Accessing unit lecture, tutorial or lab notes etc.3 Interacting with unit learning resources4 Using the unit calendar5 Reading unit News announcements6 Contacting teachers via internal unit messaging7 Contacting students via internal unit messaging8 Reading contributions to online discussions9 Contributing to online discussions10 Completing online quizzes/tests11 Submitting assignments12 Receiving feedback on assignments13 Working collaboratively in a group14 Reviewing unit progress15 Using the e-portfolio16 eLive synchronous communication session17 iLecture class lecture recording18 Other iLecture recording – podcasts, etc.19 Deakin's social software – MediaWiki, etc20 Turnitin plagiarism detection
12
3
4
56
7
8
9
10
1112
13
14
15
16
17
18
19
20
2.5
3.0
3.5
4.0
4.5
5.0
3.00 3.25 3.50 3.75 4.00 4.25
Impo
rtan
ce
Satisfaction
♦ No Sig. Difference• 2011 2012
Did the new LMS dramatically change the student and staff experience of using the system? To a large extent, the answer is, “No.”
Some observed significant differences were ‘as expected’
Key findings
University LMS users should expect that their current system will be retired at some point
There is a need for on-going monitoring
It can take many years before significant increases in perceptions of LMS value emerge
Other observations
