| Date post: | 30-Jul-2015 |
| Category: |
Education |
| Upload: | martin-ebner |
| View: | 432 times |
| Download: | 0 times |
S C I E N C E P A S S I O N T E C H N O L O G Y
www.tugraz.at
Impacts of Interactions inLearning-Videos:A Subjectiveand Objective AnalysisJosef Wachtler and Martin EbnerIT Services - Unit Social Learning - TU Graz
EDMEDIA 2015
2
Impacts of Interactions in Learning-Videos: A Subjective and Objective Analysis
Content
1. Introduction
2. Subjective User Feedback
3. Objective Evaluation
4. Discussion
5. Outlook & Conclusion
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
3
Impacts of Interactions in Learning-Videos: A Subjective and Objective Analysis
Graz University of Technology
IT Services – Unit Social Learning
Europe, Austria, Graz
http://www.tugraz.at
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
4
Introduction
Motivation
selective attention is the most crucial resource forhuman learning
supporting and managing this attention enhancesboth, behavioral and neuronal performance
attention is heavily influenced by interaction andcommunication in all forms and directions
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
5
Introduction
Why Interactions?
missing interactions are leading to passive learnersand to a much more surficial work
avoid that learners become tired or annoyed
increase the attention and the contribution
feedback for teachers:
Is it possible for the learners to follow the content?Is the speed appropriate?...
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
6
Introduction
Web-Application named LIVE
on-demand video or live-broadcasting
attention analysis
different methods of interaction:
automatically asked questions and captchasasking questions to the lecturerasking text-based questions to the attendeesmultiple-choice questions at pre-defined positions
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
7
Introduction
Interactions during a Video
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
8
Introduction
Research Question
What is the ideal distribution of the interactions over alearning video to reach acceptable results to themultiple-choice questions?
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
9
Subjective User Feedback
Setting
used at several lectures at Graz University ofTechnology
ranging from a large freshman course in computerscience to a course in the last semester of thebachelor program in computer science and a coursein adult education regarding cleanroom technology
students were asked to report their experiences withthe interactions
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
10
Subjective User Feedback
Reported Feedback
questions with a content, which is related to the topicof the video are highly appreciated
general questions are disturbing because they areseeming to be useless
a maximum of ten interactions per hour is acceptable
interactions should be spread evenly across the video
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
11
Objective Evaluation
Setting
used at the lecture “Logic and Computability”beginning with the third video the number of studentswho watched most of the video (more than 75%) isquite high
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
12
Objective Evaluation
Setting
the evaluation of the distribution of the interactionsand their impacts to the multiple-choice questionsshows a very similar outcome at each video
results are shown only for the third video which holdsas a representative for the remaining five ones
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
13
Objective Evaluation
MC-Questions answered
starts decreasing at the fifth questionnot every student watched the full video and due tothat they never reached the later questions
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
14
Objective Evaluation
MC-Questions correct/false
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
15
Objective Evaluation
Issues
three issues could be seen if we consider thedistribution of the questions as the influencing factorof the success rate
Lazy Start: the number of correct answers to thefirst question is not very highCorrect after Question Pause: correct answersare numerous at the third question despite thefact that the timespan since the last question isquite highTight-Placed Errors: if questions are placed verytight the number of correct answers is decreasing
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
16
Objective Evaluation
Occurrence of the Random Interactions
help to explain the issues
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
17
Discussion
Lazy Start
it was not necessary to answer a content relatedquestion until the occurrence of this question
the last random interaction could be happened longago
contradiction: previous research studies alwaysindicate that the attention is decreasing along theduration of the video
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
18
Discussion
Correct after Question Pause
the timespan since the last random question issmaller
randomly occurring general questions are probablyleading to a better performance at the multiple-choicequestions by helping to overcome longer periods ofno interactivity
contradiction to the subjective feedback
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
19
Discussion
Tight-Placed Errors
a placement of the questions with minor space isfollowed by a low performance at the questions
confirmed by the subjective feedback
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
20
Discussion
How to Place Interactions in Learning Videos
max. number of interactions per hour is tencontent related questions are important for thesatisfaction of the studentsgeneral questions seem to be useful to support theattention between content related questions (one pergreen slots)the space between content related questions shouldnot be too small
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
21
Outlook & Conclusion
Outlook
issues are based on observations gathered at sixvideos
it is required to fully prove the accuracy of theseobservations mathematically
videos with different distributions of interactions willbe generated
study will start in August 2015
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
22
Outlook & Conclusion
Conclusion
analysis of the impacts of different forms ofinteractions in learning videosthree issues:
Lazy StartCorrect after Question PauseTight-Placed Errors
some recommendations of how to placemultiple-choice questions in videos based onobserved trendsfurther research is planned to prove the issues andtrends
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
23 Thank you ...
... for your attention!Questions?
Josef Wachtler, [email protected] Ebner, [email protected]
Graz University of TechnologyIT Services – Unit Social LearningMunzgrabenstraße 35A, A-8010 Grazhttp://elearningblog.tugraz.at
Josef Wachtler and Martin Ebner , IT Services - Unit Social Learning - TU GrazEDMEDIA 2015
![Predicting Subjective Workload Ratings: A Comparison and ......perceptions of workload that result from the interactions of both observable and unobservable workload factors [21].](https://static.documents.pub/doc/80x56/5ee0be40ad6a402d666bde0f/predicting-subjective-workload-ratings-a-comparison-and-perceptions-of.jpg)
