Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-1
CUELC
Ralf Klamma1, Marc Spaniol2, Matthias Jarke1
1RWTH Aachen University, Germany &2Max Planck Institute for Computer Science
ACM Multimedia WS Multimedia Technologies for Distant Learning MTDL 2009,
Beijing, China, October 23, 2009
Knowledge Multimedia Processes in Technology Enhanced Learning
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-2
CUELC
Agenda
Theoretical background– Cross-media theory of transcription– SECI model by Nonaka
Knowledge Multimedia Processes– Transcriptions– Practiced/Formalized Localizations– Addressing
Evaluations Conclusions & Outlook
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-3
CUELC
Cross-Media Theoryof Transcription
Jäger, Stanitzek: Transkribieren - Medien/Lektüre 2002
Strategies of transcriptivity Collection of learning materials are re-structured by new media Design is specific for media and learning communities by default
Strategies of addressing Social Software promotes the globalization of address spaces Personalization is mission critical for learning communities
Strategies of localisation Re-organization of local practices is stimulated by new media Need to model learning practice explicitly
TranscriptTranscriptPre-Texts
Addressee-based Transcription
Selection of Pre-Texts
Integration into the cultural Archive
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-4
CUELC
Multimedia Knowledge Managementfor Technology Enhanced Learning
Synthesis: Transcriptivity / SECI Model / Communities of PracticeGoal: Media theoretic focus on technology enhanced learning
EC-TEL 2007 [Spaniol et al.]
Combination:formalized Localization
Externalization:Transcription
Socialization:practiced Localization
Internalization:Addressing
TranscriptTranscriptPre-Texts
Transcript&
Context
Transcript&
Context
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-5
CUELC
Transcription: an IS view
Examples and Requirements on IS :– Creation and maintenance of multimedia metadata– Representation of multimedia relationships (hypermedia)– Extension of archiv for multimedia content
⇒ Implications for the management of multimedia:1. Deskriptors for multimedia2. Multimedia graph representation3. Extensibility of schemata and descriptors
Pre-Texts Inter- & intra-media transcription Transcript
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-6
CUELC
Transkription0 n {P}, }M,M,M,{M M n
„Video“„Audio“„Image“„Text“ N∈∪∈
P \M
Media:
Media in IS:
Transcripts:
Transcription:
Meta-transcription(manual):
Meta-transcription(in IS ):
(p)) (p), (p),( : tp ιµτ=
P \M P : →τ
∅∪→ M P : „Text“µ
„Text“M P : →ι
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-7
CUELC
Formalized Localization: an IS view
Examples and Requirements on IS:– Individual categorization of media– Creation and Maintenance of reference collections– Fine granular management of access rights
⇒ Implications for the management of metadata:1. Schemata for classification and vocabularies2. Variation sets of multimedia3. Digital rights management
Pre-Texts Inter- & intra-media transcription Transcript
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-8
CUELC
Formalized Localization:Keyword Index/ Category System
Keyword index:
Access relation:
Category index:
(Tree)-Order:
Access relation :
OKk1
k3
k2
kc
root
κro
ot,1 M
m1
m3
m2
md
λ c,1
λ 1,2λ 3,2
λ 1,d
κro
ot,2
κ1,
3κ
2,c
Ss1
s3
s2
sc
m1
m3
m2
md
λ c,1
λ 1,2λ 3,2
λ 1,d
{s} : S =
(M) S : i P→λ
{k} :K =
))k',(k,k'(k, : o ididκ=
s)(id, : k =
(M) ID : IDk P→λ
M
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-9
CUELC
Formalized Localization :Local Access Relation
Global access relation:
Local access relation:
Opeations in category schemata :
- Insert- Delete- Rename
Operations in media relations:
- Insert- Delete
OKk1
k3
k2
kc
root
κro
ot,1 M
m1
m3
m2
md
λ c,1
λ 1,2λ 3,2
λ 1,dκ
root
,2
κ1,
3κ
2,c
OKk1
k3
k2
kc
root
κro
ot,1
κro
ot,2
κ1,
3κ
2,c
OKk1
kη
kc
k2
root
κro
ot,1
κro
ot,c
κ1,η
κc,
2
κη ,
3
k3
delete kη
insert kη
rename k2and kc
λ 2,3
delete λ 2,3
insert λ 2,3
},O,{K : l lodallodallocallocal λ=
},O,{K : l globalglobalglobalglobal λ=
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-10
CUELC
Adressing:an IS View
Examples and Requirements on IS :– Representations of multimedia content in context– Options for legitimate peripheral participation– (asynchronous) cooperation support
⇒ Implications for the management of metadata:1. Metadata driven adaption of devices2. Profiles3. User preferences and usage histories
represent & discuss in context Transcriptin
context
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-11
CUELC
AdressingDiscussions:
Hypermedia documents:
Discussions on hypermedia documents:
Context-aware adressingof multimedia content:
))(t,(t : d pptpδ=
„Text“t M T : →δ
)h,d,l,(t : h wt
vupdl,t, p
)(= µ 0 w v,u, N∈
))(h,(h : d dl,t,hdl,t,h dl,t,δ=
I T : l →α
„Text“h M H →:δ
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-12
CUELC
Validation of the Concept
Klamma, Spaniol, Cao: MPEG-7 Compliant Community Hosting, JUKM, Springer 2006
CESE: Hypertext Environment for Talmud tractatesMARS: Transcription of electro-acoustic musicSOCRATES: Chat for Communities of AphasicsMECCA: Collaborative Screening of MoviesVEL 2.0: Virtual Entrepreneurship Lab
NMV & MEDINA: Dublin Core & MPEG-7 based Media TaggingACIS: GIS-Multimedia Management for Cultural HeritageMIST: Non-linear Story-Telling PROLEARN Academy, GRAECULUS, Multimedia Metadata, CUELC, Bamyian Valley: Community Portals
Collaborative adaptivelearning platforms
Self-observation toolsfor Communities
Measure, Analyses,Simulate
Socio-technicalinformation system
Development
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-13
CUELC
MIST – Multimedia Management• Creation and management:
- Media collections- Metadata- Media variations
• Collaborative indexing based on:- Free text annotations (à la Flickr)- Semantic MPEG-7 basetypes
Agent Event Concept Object Place Time State
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-14
CUELC
MIST – Story Creation
Illustration of episodic knowledge– Modeling of non-linear stories based on Movement Oriented Design (MOD)
[Sharda 2005]; Cooperation with Victoria University Melbourne, Australia– Decomposition of stories according to a problem hierarchy– Recall of semantic high-quality metadata on multimedia artifacts
Structure of Begin-Middle-End-Sequences
“Mapping“ of (sub)-problems to multimedia artifacts
Structured access to contents of the multimedia archive
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-15
CUELC
MIST – Story Consumption
Non-linear access sequences in multimedia stories, i.e. “success vs. failure“ depending on access sequenceContext information via multimedia annotations
Currently selected artifact
Optional successor-sequences
Free text annotations
MPEG-7 based annotations
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-16
CUELC
<e-Adventure> EditorAuthoring environment
for point and clickadventure games
Refinement of the raw educational game derived from the non-linear story
Specification of items and character references
Definition of dialogs⇒ Fully featured adventure game for vocational training
M. Spaniol, Y. Cao, R. Klamma, P. Moreno-Ger, B. Fernández Manjón, J. Luis Sierra, G. Toubekis :From Story-Telling to Educational Gaming: The Bamiyan Valley Case , in F. Li, J. Zhao, T. K. Shih R. Lau, Q. Li, D. McLeod (Eds.) Advances in Web Based Learning - ICWL 2008,
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-17
CUELC
Conclusions & Outlook Cross mediality for collaborative learning platforms supports
– Evolutinary development of multimedia learning services– Configuration and maintenance of multimedia learning repositories
Semantic self organization of learning communities supported by– Flexible semantic enrichment of complex processes based on
multimedia artifacts– Re-contextualization of multimedia knowledge in stories & games
Ongoing and future work– Mobile Storytelling based on a simplified mobile user interface– Use of templates for supporting inexperienced storytellers– Mashing up different stories to create and share innovative
knowledge
Lehrstuhl Informatik 5(Informationssysteme)
Prof. Dr. M. JarkeI5-RK-0909-18
CUELC
Join us!
http://www.role-project.eu/ LinkedIn
http://www.linkedin.com/groupInvitation?gid=1590487