Date post: | 26-Jun-2015 |
Category: |
Education |
Upload: | technological-ecosystems-for-enhancing-multiculturality |
View: | 273 times |
Download: | 2 times |
“Developing a framework to evaluate usability in m-learning systems: mapping study and proposal”
Christian NavarroAna I. Molina
Miguel A. RedondoSuperior school of Informatics
Salamanca, España.October 2014
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Introduction
Motivation and general objectives
Systematic mapping study
Framework proposal for evaluations of
m-learning systems
Conclusions and future work
Contents
2
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Introduction
Source: Ericsson mobility report
3
Cell phones are part of our daily live.
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
UNESCO- Mobile devices: platform to facilitate
educational equity throughout the different countries.
Introduction (Cont.)
4
M-learning
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
M-learning definition
- Quinn (2000)◦ “e-learning that takes place with the help of mobile
devices”
- O’Malley (2005)◦ “Learning that takes place when the learner takes
advantage of learning opportunities offered by mobile technologies”.
- Crompton (2013)◦ “learning across multiple contexts, through social and
content interactions, using personal electronic devices”.
Introduction (Cont.)
5
Focussed in the students and their learning process
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Technologies with larger potential in the education area according to the NMC Horizon Report- Mobile devices (tablets)- MOOC (Massively Open Online Courses)- Game-based learning
◦ TechNavio predicts an increase of 15.6% in the period of 2012 to 2016.
Mobile Usability- Is a specialty in the usability field that is currently
emerging.- Mobile devices face big challenges, mostly in the
educational areas.
Motivation
◦Sensorization ◦Connectivity◦Portability
◦Screen size◦ Interaction styles ◦Capacity 6
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Study the current state of m-learning and mobile usability research
Understand the current needs in m-learning
Propose a model/framework to evaluate the usability in m-learning applications
General Objectives
7
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Total of papers found in the initial search (1085)
Systematic Mapping Study
Scopus Science Direct
ACM IEEE Xplore
0
100
200
300
400
500
600
700 623
198194
70
Nu
mb
er
of
pa
pe
rs
IEEE Xplore Scopus Science Direct
ACM
0
5
10
15
20
25 2221
14
11
Nu
mb
er
of
pa
pe
rs
Search Results
Number of relevant papers extracted from each Database (68)
8
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Research question1- What is the current state of m-learning and mobile
usability research? (Considering only papers using mobile devices like Smartphones and Tablets). Is there an increase in the number of publications during the last years?
Systematic Mapping Study
2006 2007 2008 2009 2010 2011 2012 2013
21
5
2
9
16
23
10
Nu
mb
er
of
pap
ers
Papers according to the date of publication9
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Systematic Mapping Study
10
Research question 2
- What are the different approaches for publications in the areas of m-learning
and usability?
- What type of mobile devices and operative systems are the most common according to these papers?
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
M-learning applications◦ The 40% are game-based applications ◦ Only 57% include usability tests
◦ 35% use heuristics or expert reviews
Systematic Mapping Study
11
Elementary27%
Junior High10%
High school
3%
University43%
Master3%
Special educa-
tion7%
Adults7%
M-learning applications according to
the academic level
Types of mobile devices in m-learning.
Iphone31%
Ipad6%
Android Smartphone 47%
Android Tablet
3%
Win-dows Smar-
tphone6%
Tablet PC3% Java Cell phones
3%
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Research question 2
- What are the different approaches for publications in the areas of m-learning
and usability?
Systematic Mapping Study
12
Clasification 4
(papers that consider both m-learning and
usability)
Clasification 3
(different areas of development and evaluation)
Clasification 2
(Types of Guidelines and Frameworks)
Clasification 1
(different approaches)
Analyzed papers(68)
M-learning applications (30)
Guidelines and Frameworks (25)
Development Guidelines and
Frameworks (16)
- M- learning pps (5)
- M-learning
environments (4)
- MLMS (3)
- M-learning contents
(2)
- Mobile devices
contents (1)
- Mobile environments
(1)
- M- learning
environments (4)
- M-learning
applications(3)
- MLMS (3)
- M-learning
contents(2)
Evaluation Guidelines
and Frameworks
(9)
- Mobile applications (3)
- M-learning pplications
(2)
- Comercial m-learning
applications(1)
- Usability contents (1)
- M-learning devices(1)
- Mobile environments
(1)
- Mobile devices
evaluation(1)
Specific aspects of m-learning (9)
Analysis and tendencies of m-
learning (4)
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Results and general conclusions
- There is a lack of evaluation tools for m-learning applications
Systematic Mapping Study
The creation of an evaluation framework for m-learning applications, considering pedagogical usability and user interface usability.
Research proposal
13
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Evaluation Framework Proposal
14
The framework is divided in two factors
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
15
Evaluation Framework Proposal The framework is divided in two factors
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
16
Evaluation Framework Proposal The framework is divided in two factors
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Analysis - Recent growth in the m-learning research area- Lack of usability evaluation frameworks in m-
learning
We propose a m-learning framework- Based in
◦ Pedagogical aspects◦ UI Usability
- To be used for ◦ evaluation and development
Conclusions
17
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Definition and validation of the evaluation Framework
Development of a software tool that will facilitate the evaluation
Propose this framework to be applied along with other methodologies for development
◦ Specifically for e-learning or m-learning
Future Work
18
Developing a framework to evaluate usability in m-learning systems: mapping study and proposal
Contact
Christian X. [email protected]
Developing a framework to evaluate usability in m-learning systems:
mapping Study and proposal
19