Date post: | 06-May-2015 |
Category: |
Technology |
Upload: | dejan-kovachev |
View: | 408 times |
Download: | 4 times |
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-1
Mobile Multimedia Cloud Computing
and the Web
September 8th, 2011
Informatik 5 (Information Systems), RWTH Aachen University
&
Bonn-Aachen International Center for Applied Information Technology
Graz, Austria
Dejan Kovachev, Yiwei Cao & Ralf Klamma
MMC Workshop on
Multimedia on the Web
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-2
Motivation
“By 2013, mobile phones will surpass PCs as the way most
people hop onto the Web” [Gartner report 2010]
“…two-thirds of the world's mobile data traffic will be video
by 2015” [Cisco Visual Networking Index 2010]
Mobile and web networks converge
– Asymmetry in multimedia material production and consumption
User/Community/Social Computing
– Movement from business-oriented to user/community-centric
applications
Increased exploration of the potential of cloud computing by
organizations and individuals
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-3
Agenda
Motivation
Experiences from previous works
Perspectives on mobile multimedia cloud computing
– Technology
– Mobile multimedia
– User and community perspective
I5 Multimedia cloud architecture
Use cases
Discussion and future work
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-4
Lightweight Application Server (LAS) [Spaniol et al. 2006]
– Community Middleware
– Platform for (Web-)Services
– Currently: ~30 Services
– E.g.: Usermanager, MPEG-7 Services
Applications using LAS:
– YouTell (Web)
– SeViAnno (Web)
– AnViAnno (Android)
– Mobile Campfire (iPhone)
– NMV (Desktop)
More recently: LAS XMPP Extension
Previous works:
LAS Server & Applications
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-5
Previous works:
SeViAnno
Interactive semantic annotation of videos [Cao et al. 2010]
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-6
Experiences from Building
Multimedia Web Applications
Design and implementation of alternative architecture
Factors Next-generation Mobile Web Services
Performance Low response time independent of requests
Scalability Scalable and distributed access to services
Development cost Enabling of a single person to design and run web-scale
multimedia applications
Availability Available services from anywhere at anytime
Interoperability Various mobile platforms
Protocols and
standards
Cloud-based multimedia framework using emerging protocols
and standards like XMPP and HTML5
Reduced data
communication
Improved mobile multimedia service quality
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-7
Mobile Multimedia Cloud Computing:
Technology Perspective
Data management
– Big data and NoSQL cloud storage for multimedia artifacts
– Amazon S3, Google BigTable, Hadoop HBase
– Traditional relational DBMS for metadata storage
Communication
– The mobile broadband Internet offers improved QoE,
more interactive applications
– Protocols like XMPP or SIP offer integrated social structures application-level
routing, resource discovery, extensibility, etc.
Computation
– Client server model and Web Services
– Automatic offloading of computation tasks into the cloud
or using nearby resources (home servers, base stations, kiosks)
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-8
Mobile Multimedia Perspective
Multimedia formats and transcoding
– Interoperability and adaptation via transcoding
services for different platforms
Multimedia semantics
– Analysis of low-level features
Multimedia modeling
– Multimedia context
(coming from the multimedia semantics)
– Mobile context inferred using sensors on devices
– Metadata standards and ontologies for knowledge
representation and processing
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-9
User and Community Perspective
Sharing and collaboration
– Driving force for mobile devices improvement
Ubiquitous multimedia services
– Accessibility on heterogeneous mobile
and desktop devices
– Seamless multimedia experience
Privacy and security
– Holistic trust models of devices, applications,
communication channels and cloud service providers
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-10
I5 Multimedia Cloud Architecture
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-11
I5 Cloud Resource Usage Monitoring
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-12
Use Case: Collaborative Metadata
Management and Multimedia Sharing
Historian
Architecture
Expert Local
Workforce
Third party Metadata Repository
Documentation
Expert
1- images and videos
Collaborative
Multimedia Cloud
2- tag basic metadata
XMPP is the main communication protocol to
support real-time collaboration
Captured time
Taken location Creation
time Provenance
….
Metadata
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-13
Use Case:
Mobile and Web Video Integration
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-14
Use Case: Improving UX of Mobile
Video Media Using Cloud Services
Improving user experience for mobile video by intelligent and fast video
processing cloud services
Mobile video browsing tedious
- Only time point as position clue
- Takes long time until preview image
available
Improvement of mobile
video browsing
- Segment-dependent
- Metadata-dependent
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-15
Discussion
Mobile networks are part of the Web now
Augmentation of resource-poor mobile devices through cloud services
Perspective Use cases’ features
Technology XMPP, Video streaming, Deltacloud API
Mobile multimedia Multi-platform video transcoding, MPEG-7 based metadata,
intelligent video adaptation
User/Community Enhanced mobile video UX, collaborative multimedia services via
metadata creation and sharing in real-time
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-16
Future Work
The XMPP protocol for metadata synchronization as XEP
extension
– Real-time collaboration and sharing of XML documents (i.e.
metadata documents)
Interoperability between MPEG-7 and other metadata
standards
– W3C Media Annotations Ontology and API
Three-tier cyber-foraging using offloading to nearby
(cloudlet) and remote resources (cloud)
– Reduced latency – better interactivity
– Goal-Cost-Metrics based model for resources scheduling
Lehrstuhl Informatik 5
(Informationssysteme)
Prof. Dr. M. Jarke
I5-KCKl-0911-17
Feedback? Questions?
Thank You!
@dkovachev