54
From findability to awareness: a short overview and future vision Katrien Verbert WISE research group Department of Computer Science [email protected] inaugurale les
| Date post: | 15-Jan-2015 |
| Category: |
Education |
| Upload: | katrien-verbert |
| View: | 1,109 times |
| Download: | 5 times |
From findability to awareness: a short overview and future vision
Katrien Verbert WISE research group Department of Computer Science [email protected]
inaugurale les
Human-Computer Interaction HCI group
prof. Erik Duval
PhD. researcher Oct. 2003 – Feb. 2008 Post-doc Feb. 2008 – Dec. 2012
Web engineering group
Assistant Professor Jan. 2013 – Dec 2013
2
WISE Assistant Professor Jan. 2014 – …
3
Julie Lagaisse 26-07-2013
Overview research topics
4
Flexible reuse of content components • Content models • Metadata • Repositories
Semi-automatic content assembly • Recommendation • Visualisation
Interaction with RecSys
Recommendation
+ Visualisation
2003 | 2004 | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | 2011 | 2012 | 2013| 2014
Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare
Overview research topics
5
Flexible reuse of content components • Content models • Metadata • Repositories
Semi-automatic content assembly • Recommendation • Visualisation
Interaction with RecSys
Recommendation
+ Visualisation
2003 | 2004 | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 | 2014
Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare
6
7
8 src: http://www.sh3.com/content-reuse-reduces-technical-translation-cost/
That easy? Typical workflow example…
9
10
Shared content often coarse-grained
Time consuming
11
Tedious and error-prone
Authoring-by-aggregation
• Decompose existing content into reusable components • Integrate support for reusing components in existing authoring tools
12
13
MS PowerPoint plug-in
14
User Evaluation
20 participants
Created 2 presentations:
1. without alocom support
2. with alocom support
Measured characteristics:
1. Time
2. Manual versus semi-automatic reuse
3. Granularity
4. User satisfaction
without-alocom
with-alocom
Significance (2-tailed)
Total time (in minutes) 20.03 17.79 0.147
Time normalized by number of slides
3.32 2.2 0.001
Time normalized by number of subtopics
4.5 2.9 0.016
15
Quality evaluation
19 reviewers
4 quality parameters:
1. Completeness
2. Conciseness
3. Relevancy
4. Accuracy
16
17
RAMLET
¤ Resource Aggregation Model for Learning, Education and Training
¤ Defines common nomenclature and conceptual model ¤ to represent structural aspects in a uniform way
¤ covers:
¤ MPEG-21 DID
¤ Atom
¤ OAI-ORE
¤ IMS CP
¤ METS
18
Overview research topics
19
Flexible reuse of content components • Content models • Metadata • Repositories
Semi-automatic content assembly • Recommendation • Visualisation
Interaction with RecSys
Recommendation
+ Visualisation
2003 | 2004 | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 | 2014
Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare
Semi-automatic assembly of content
Research visit
¤ host: Brigham Young University (US)
¤ supervisor: prof. David Wiley
¤ period: Jan 2009 – April 2009 (3 months)
Post-doctoral fellowship
¤ host university: KU Leuven, Belgium
¤ supervisor: prof. Erik Duval
¤ period: Oct 2009 – Sept 2012
20
Tracking traces to support recommendation and visualisation
21
www.role-project.eu
Recommender systems
22
23
Recommender systems
RecSysTEL workshop 2010, 2012 at RecSys and EC-TEL workshop co-chair
Stellar Alpine Rendez-Vous 2009, 2011 workshop co-chair
RecSysChallenge at RecSys 2012 track co-chair
24
LAK 2013: Int. conference on Learning Analytics and Knowledge program co-chair
http://bit.ly/acBKsp
25
Verbert, Katrien; Manouselis, Nikos; Ochoa, Xavier ; Wolpers, Martin; Drachsler, Hendrik; Bosnic, Ivana; Duval, Erik. Context-aware recommender systems for learning: a survey and future challenges, IEEE Trans. on Learning Technologies, 18 p. (2012)
26
Visualization to support self-awareness and reflection
Co-supervision 2 PhD students: ¤ Sten Govaerts (currently at EPFL)
¤ Jose Luis Santos (KU Leuven)
www.role-project.eu
27
Student Activity Meter (SAM)
28
Govaerts, S., Verbert, K., Duval, E., & Pardo, A. (2012, May). The student activity meter for awareness and self-reflection. In CHI'12 EA (pp. 869-884). ACM.
Overview research topics
29
Flexible reuse of content components • Content models • Metadata • Repositories
Semi-automatic content assembly • Recommendation • Visualisation
Interaction with RecSys
Recommendation
+ Visualisation
2003 | 2004 | 2005 | 2006 | 2007 | 2008 | 2009 | 2010 | 2011 | 2012 | 2013 | 2014
Technology Enhanced Learning (TEL) – Music – Research Information Systems - Healthcare
Flexible interaction with RS
Research visit
¤ Host: Carnegie Mellon University & University of Pittsburg
¤ Collaboration: John Stamper, Peter Brusilovsky
¤ Period: April 2012 – June 2012 (3 months)
Second post-doctoral fellowship FWO
¤ host university: KU Leuven, Belgium
¤ supervisor: Erik Duval
¤ period: Oct 2012 – Sept 2015
30
Problem statement
¤ Complexity prevents users from comprehending results ¤ Trust issues when recommendations fail
¤ Aggravated with contextual recommendation
¤ The black box nature of RS prevents users from providing feedback
¤ Algorithms typically hard-wired in the system code ¤ generate a list of top-N recommendations
¤ little research has been done to study more flexible approaches
31
Conference Navigator
32
Interrelations agents – users - tags
33
Interrelations agents – users
34
Interrelations agents - tags
35
TalkExplorer
36
effectiveness
How frequently a specific combination type produced a display that was used to bookmark at least one interesting item
Dimensions of relevance are not equal
The more aspects of relevance are used, the more effective it is
Especially effective are fusions across relevance dimensions
37
Summary results
38
39
information visualisation - information retrieval - information (data) mining
40 http://www.youtube.com/watch?v=9LwSx1V6Yxk
Vision for future research
41
Combining information mining and visualization
Core objectives: • make mining results comprehensible for users • enable users to steer the information mining process
Research questions
¤ RQ1: How can information visualization techniques enable users to gain insight into the rationale of intelligent systems?
¤ RQ2: How can users explore these visualizations and steer the analysis process through input and feedback?
¤ RQ3: How can analysis techniques integrate input from users and automatic methods for acquiring contextual variables, while allowing for the continuous dynamic adaption depending on changing user interests and context?
43
44
Text mining Flexible interactive Interfaces
Context-aware applications Learning analytics
45
Anthony Don, Elena Zheleva, Machon Gregory, Sureyya Tarkan, Loretta Auvil, Tanya Clement, Ben Shneiderman, and Catherine Plaisant. 2007. Discovering interesting usage patterns in text collections: integrating text mining with visualization. In CIKM '07
Context-aware applications
46
Learning analytics
47
Learning analytics
49
Source: Mathieu Plourde
http://lakconference.org/
51
http://www.nmc.org/pdf/2014-nmc-horizon-report-he-EN.pdf
Slide source: Erik Duval
Collaborations
52
Xavier Ochoa ESPOL, Ecuador
David Wiley BYU
Univ. of Pittsburgh (P. Brusilovsky) , Carnegie Mellon University Dan Suthers
University of Hawaii
Erik Isaksson, Matthias Palmer Uppsala University Effie Law, Univ.
of Leicester, UK
Univ. Paul Sabatier
Abelardo Pardo University of Sydney
Nikos Manouselis, Agro-know Alexander Nussbaumer, TU Graz
UC3M
TU Eindhoven, RWTH Aachen, FIT
EPFL
Denis Parra PUC, Chile research stays
Key publications ¤ Verbert, K., Parra, D., Brusilovsky, P. and Duval, E. (2013). Visualizing
recommendations to support exploration, transparency and controllability. In Proceedings of the 17th International Conference on Intelligent User Interfaces (IUI’13), IUI’13, pages 1-12, New York, NY, USA, 2013. ACM.
¤ Verbert, K., Govaerts, S., Duval, E., Santos, J.L., Van Assche, F., Parra, G., Klerkx, J. (2013). Learning Dashboards: an Overview and Future Research Opportunities. Personal and Ubiquitous Computing (PUC) Journal, 16 pages, Springer.
¤ Verbert, K., Manouselis, N., Ochoa, X., Wolpers, W., Drachsler, H., Bosnic, I., and Duval, E. (2012) Context-aware recommender systems for learning: A survey and future challenges. IEEE Transactions on Learning Technologies, 5(4):318-335, 2012.
¤ Verbert, K., Ochoa, X., Derntl, M., Wolpers, M., Duval, E. (2012). Semi-automatic assembly of learning resources. Computers and Education, 59(4), 1257-1272.
¤ Verbert, K. and Duval, E. (2008). ALOCOM: A Generic Content Model for Learning Objects. International Journal on Digital Libraries, 9(1), pp. 41-63, 2008.
53
