University of Piraeus Department of Technology Education and Digital Systems Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.) N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 2004 1 A Multi-criteria Model to A Multi-criteria Model to Support Automatic Support Automatic Recommendation of e-Learning Recommendation of e-Learning Quality Approaches Quality Approaches Nikos Manouselis, Demetrios G. Sampson e-mail:{nikosm,sampson}@iti.gr
Transcript
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20041
A Multi-criteria Model to Support A Multi-criteria Model to Support Automatic Recommendation of e-Automatic Recommendation of e-
European Quality Observatory (EQO)Model for describing e-learning quality approachesOnline repository with quality approachesRecommendation mechanismExample scenario
conclusions - future directions
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20043
Quality in e-learningQuality in e-learningQuality: an issue of increasing importance
in e-learningSeveral approaches developed worldwide
They address quality control, assurance, and assessment dimensions of quality in e-learning
A variety of available methods, criteria, processes, instruments etc.
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20044
Variety of approachesVariety of approaches The various approaches have different priorities,
focusing on different e-learning quality aspects How can e-learning researchers and
practitioners identify and select interesting or appropriate approaches for their application scenarios?
Issues: Collection / Categorization of quality approachesRecommendation of quality approaches
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20045
Variety of approachesVariety of approaches The various approaches have different priorities,
focusing on different e-learning quality aspects How can e-learning researchers and
practitioners identify and select interesting or appropriate approaches for their application scenarios?
Issues: Collection / Categorization of quality approachesRecommendation of quality approaches
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20046
Recommender systemsRecommender systems “Any system that produces individualized
recommendations as output or has the effect of guiding the user in a personalized way to interesting or useful items in a large space of possible options” [Burke, 2002]
They help individuals in a community of users to identify items of interest from a potentially overwhelming set of choices [Resnick & Varian, 1997]
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20047
Recommendation tasksRecommendation tasks
Recommendation broadly used to support two main user tasks [Herlocker et al., 2004]:“Find Good Items”: providing users with ranked
lists of recommended items based on generated predictions
“Annotation in Context”: generating predictions for an item that the user is currently viewing
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20048
Recognizing commonalities between users on the basis of commonly rated items
Demographic recommendation Based on demographic classes of users
Content-based recommendation Matching descriptions of items with user profiles
Utility-based recommendation Based on a utility function for each user
Knowledge-based recommendation Using knowledge structures for reasoning
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 20049
European Quality ObservatoryEuropean Quality Observatory European Quality Observatory (EQO) initiative
Funded by the EC eLearning ProgrammeOne of the four initiatives specifically focusing on e-learning
quality Aims:
To develop a metadata model for describing and categorizing quality approaches
To collect quality approaches and store them in an online repository
To support e-learning researchers and practitioners in identifying quality approaches suitable for their application needs
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200410
EQO ModelEQO Model Metadata Model for the description and
categorization of quality approaches for e-learning
Extending an initial model of the CEN/ISSS Learning Technologies Workshop (LTW) Quality Assurance GroupExpanding description and categorization capabilities of
initial CEN/ISSS modelAllowing for the description and assessment of a quality
approach application
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200411
Structure of ModelStructure of ModelEQO Model v.1.2Four main
categories of elements
(available from
http://www.eqo.info)
GENERAL
CONTEXT
METHOD
EXPERIENCE
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200412
EQO web portalEQO web portal Provides access to
the online repository Users can
search/contribute descriptions of quality approaches
Users can search/contribute experiences from quality approaches
http://www.eqo.info
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200413
EQO Recommendation ModuleEQO Recommendation Module Provides recommendations to the users of the EQO
web portal when searching for quality approaches in the repository
Utility-based recommender, calculating the suitability of a quality approach (QA) for given application context prioritiesMultiple criteria engagedRanking available quality approaches (Find Good Item
task)
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200414
User contributing Experience from the Quality Approach to
EQO repository
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200420
Criteria for calculating suitabilityCriteria for calculating suitability Expressing the focus of a quality approach upon several
criteria In our case, adopted from [Frydenberg, 2002] the following:
1. Focus on Institutional & executive organization / commitment
2. Focus on Technological infrastructure3. Focus on Student services4. Focus on Instructional design and course development5. Focus on Instruction and instructors6. Focus on Program delivery7. Focus on Financial management8. Focus on Regulatory and legal compliance9. Focus on Evaluation and assessment procedures
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200421
The recommendation module seems to be providing useful hints to the users of the EQO portal evaluation from EQO users is required
A utility-based recommender technique seems appropriate for cases similar to the EQO case study where multiple criteria are required to describe items other techniques could be also examined
The criteria for calculating suitability could be furthermore elaborated and validated from the users explore the effect of user role in the definition of criteria validation of criteria through user survey
University of PiraeusDepartment of Technology Education and Digital Systems
Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics Institute (I.T.I.)
N. Manouselis & D.G. Sampson EDMEDIA’04, Lugano, Switzerland, 24th June 200427
