“Zap und Shake auf dem Screen” Multiscreen: Drivers and Enabling Technologies

Fraunhofer FOKUS / Future Applications and Media Dr. Stefan Arbanowski

Fraunhofer in Germany and Worldwide

At present Fraunhofer Germany maintains §  60 Fraunhofer institutes §  with a staff of 20.000 scientists &

engineers §  2 billion € annual budget

Worldwide §  2009: Fraunhofer Portugal, Austria §  2009: Fraunhofer is founding member of

the eCAESAR Association in Romania §  Fraunhofer USA, Inc. maintains 7 cen-

ters next to the headquarters in Ply-mouth, MI

§  Fraunhofer Chile §  In Asia, Fraunhofer offices are located in

China, Indonesia, Korea and Japan

FAME@FOKUS – Future Applications and Media Intelligent services & applications: interactive, personalized, everywhere

3

Introduction – Key factors for interactive multiscreen

•  IPTV, HybridTV and WebTV is nothing new, started many years ago.

•  What has changed ? Why now? What is next?

•  Broadband widely available in households •  sufficient bandwidth, affordable •  Internet services are commodity

•  Devices •  more powerful, ubiquitous computing, hybrid

•  Evolved Web Standards & Tools

Introduction – Services

What is the Angry Birds for TVs ?

•  Mobile apps cannot be ported onto TV: •  Remote control •  Viewing distance •  Lean-back mentality / passive consumption •  Shared viewing experience

Angry Birds exploits the features of smartphone devices!

Source:hothardware

Introduction – Services

Video is !

Introduction – Some numbers

•  Average of 242 minutes TV consumption in Germany. Source: ARD/ZDF OnlineStudie

•  Germany ranks as the leader in online video viewing, with 45 million unique viewers watching an average of 187 videos for 19.6 hours per viewer in April (2011) Source:Comcast

•  Internet-connected televisions are set to become a standard

feature of European living rooms according to German trade association Source:Bitkom

•  Press release: Connected TVs to outsell games consoles for first time in 2011. Source:Informa Telecoms & Media

Introduction – Key Players*

*not mentioning content owners, broadcasters, service providers, ...

Standards – Hybrid TV + Web Standards

§  As content providers are diversifying their target audience…

–  common authoring basis to address those different devices (Internet,TV, tablets, mobiles)

–  faster authoring time for simple applications or reuse of existing

solutions (e.g. reuse of backend and only frontend adaptations) –  benefit from the WWW community and capitalize on existing

content of the Web.

–  Browser as common denominator

App platforms

§ TV app platforms are different –  Samsung has 1000 apps available and ten

million downloads

–  LG, Sharp and Philips to define common platform (HTML/HbbTV-based)

–  Google TV based on Android and partnering with Sony

⇒ Expensive for content providers to deploy one service to all TV platforms

⇒ BUT, common basis is (CE-) HTML+JavaScript

Standards – Hybrid TV / HbbTV

Illgner Fehns – HybridTV @ MWS 2010

Standards – HbbTV

•  Broadcast-related vs. Broadcast-independent

–  Broadcast-independent application §  not associated with any broadcast service §  downloaded via broadband and accesses all of its associated data via

broadband

–  Broadcast-related application §  associated with one or more broadcast services or one or more broadcast

events within a service §  may be launched automatically ("autostart") or explicitly upon user request. §  may be downloaded broadband or broadcast and may access its data via

either

Standards – HbbTV German - HbbTV/CE-HTML Offers

•  ZDF Mediathek •  Das Erste Mediathek •  Das Erste EPG •  Einsfestival Mediathek •  ARTE TV •  ARTE Live Web •  Tagesschau •  BR Rundschau

•  RTL digitaltext •  Germany's next Topmodel •  Welt der Wunder

Mediathek •  ProSieben Videocenter •  SAT.1 Videocenter

•  Pro 7 Startleiste •  Sat 1 Startleiste •  MyVideo.de •  Welt Online

•  BR Klassik •  Radio Bremen Mediathek •  RadioTime

•  Volkswagen TV •  Mercedes-Benz TV •  SWR Mediathek

•  VideoWeb Internetportal •  Humax Portal

•  IRT Portal •  Inverto Portal

•  Youtube for HBB by madsolutions

•  Putpat •  Q-Tom •  Picasa •  eBay (via Jaast) •  Spox

•  Maxdome •  MediaMakrt •  Mediencenter Telekom

Standards – HbbTV Further German HbbTV/CE-HTML Offers

•  NUNA.tv •  TV-ID •  CineTrailer.tv •  smartPortal •  FIFA Frauen WM 2011 •  tennislive.tv •  smartPORTAL •  Nigel and Victoria •  spobox.tv •  Krone.at •  Virgile EPG •  France.tv Roland Garros

2011 •  Panoramabilder Alpen •  MySpass.de

•  PotsdamTV •  Hamburg 1 Fernsehen •  München Live TV •  Telecinco.es •  portalZINE TV •  Wikipedia •  Tuneln Radio •  Liverservice.de •  Viewster.tv Kino •  yellowmap.de •  aupeo! Musikportal •  DrDish HbbTV •  TV Movie •  MeteoConsult Wetter •  Funspot.tv Spiele

•  Kicker Online •  RAN Liveticker •  Mikestar Online Karaoke •  Heute 100 sec •  NiederschlagsRadar.de •  golfdigital.tv •  shralp! •  Freshmilk TV •  TV-ID •  AutoBILD.de •  Das Telefonbuch •  Dailymotion •  Anixe iTV News •  TV Movie •  Sport 1 •  Ticketmaster (by APS) •  Home Shopping Europe 24

Outlook Next Gen TV Technologies

•  HTML5: for more powerful apps •  HTTP Adaptive Streaming: MPEG-DASH •  Content Protection/DRM in web browser: CENC/CFF •  New remote controls and input devices: companion

Outlook Next Gen TV Technologies

•  Today browsers are more than just HTML interpreter and render. •  HTML, CSS, and JavaScript, A/V Codec •  Plugins (Flash, Silverlight, ...)

•  HTML5 hype - Advantages of native- compared to Web-applications decreases

•  Geolocation API •  Video element •  Canvas (drawing images) •  Web Workers: spawn background workers running scripts in parallel •  Contacts API: provides access to a user's unified address book. •  Websockets •  Hardware acceleration (WebGL…)

•  HbbTV 2.0 •  ....

Adaptive Streaming

§  Two primary components –  A media format delivered over HTTP as file “segments” –  A presentation description file (“manifest”) to provide information to a

player about the media available

§  Uses HTTP and existing content delivery infrastructure –  Video passes through firewalls, NATs etc. same as web pages

§  Client selects from video files encoded at different bitrates –  Adapts to changing network conditions and throughput –  Maintains continuous playback at the highest quality the network can

currently support

§  Dynamic Adaptive Streaming over HTTP (DASH)

17

Common encryption / common file format

§  A single file format for: –  Multiple media/device profiles

§  Personal Devices §  Standard Def Devices §  High Def Devices

–  Multiple DRMs §  Support for many DRM products, but with §  Common Encryption

–  Multiple delivery systems §  Internet File Download §  Progressive (stream-like) Download §  Broadcast

–  Based on industry standards

Zap‘n‘shake

Service examples and demos

Demos HbbTV Car Configurator

Demos TV Predictor – your personal TV experience

•  HbbTV based personalized Recommender for TV Programs

•  Approaches

•  Content-based Filtering

•  User Similarity

•  Rating Prediction

•  Clustering

•  Training of User Interests

•  Association Rules

•  Combines Item-Recommendations

and Advertisements

Demos HeliView on SmartTVs -Interactive TV with interactive video

THANK YOU FOR YOUR ATTENTION

Q&A

Media Web Symposium 2011 Tutorial 2: Application Development for 3 Screens

Fraunhofer Institute for Open Communication Systems

Kaiserin-Augusta-Allee 31 10589 Berlin, Germany

www.fokus.fraunhofer.de