Video Processing in an Open Source Environment

Brian Peebles

Chief Technology Officer

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 2

Extends Mobile VAS Segment Leadership

Video Algorithmic and Analytics Leadership

Extends Technology Enabling MSS Leadership− Fax Segment MSS Leadership

Converged Communications Technology Enabling Market Segment Share Leadership− Dialogic “pioneer” history, relationships and patent portfolio− Enterprise Gateway

Established SS7 / Signaling Part of Business

Established HMP as core to Dialogic customer value proposition

Deeper Service Provider Segment Products / Customers− Service Provider gateway and IP media server

Extends Technology Enabling MSS Leadership

TDM to IP Transition Leadership Extend into Web communication and

open source ISV innovators Enabling Video IP Streaming Value Added

Services

2006 2007 2008

“VIDEO IS THE NEW VOICE”™

Dialogic Evolution

“VIDEO IS THE NEW VOICE”™

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 3

Video-Enablement of Traditional VAS Services

Video Enabled LBS

Video Mail

IVVR

Video SMS

Video Conferencing

VRT

Location Based Service

Voice Mail

IVR

SMS

Conferencing

CRBT

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 4

Dialogic has an extensive history in Video

Already many 10s of thousands of ports of video applications built on Dialogic

First system shipped in early 2005 Currently there are dozens of active deployments of

Dialogic Video Solutions involving – Video Telephony, – Video Enhanced Services– Mobile Video.– all Geos – NAR, APAC, CALA, EMEA, BRIC

We are now setting the pace for advanced techniques

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 5

Case Study – Video Chat – Description

Australia New Market – 3G Video Premium Rate for the largest

provider of both local and long distance telephone services, mobile

services, dialup, wireless, DSL and cable internet access in

Australia.

Service and Development provided by a local Dialogic Partner as a

Video Hosting Bureau (ASP)

Overview

Live Operator Chat & Video Portal

3G to SIP Softphone (High Quality) (and 3G)

H.264/MPEG4 & AMR

Billing - Premium Rate & Credit Card

SMS Subscription Notification

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 6

Dialogic MMA

Case Study – Video Chat - Architecture

Customer Platform

3G VideoHandset

Media

2/2.5 G Mobile

TDM

App Server

VoiceXML

TSL

SS7 & INCAMEL/

INAP

IP

SCP

StreamingServer

IP SoftPhone

Web/IP

IP VideoPhone

ISDN/CASISUP

RTSP

LandlinePhone

GSMHandset

IP Handset

Speech/TTS

MRCP

Speech

BusinessSystems

XML/SOAPWeb Services

Lawful InterceptionTransaction Recording

ETSI ES201 671IP/SEC

VOIP

Media Server

Video Chat Platform

Dialogic Media Engine

3G Video Gateway

Dialogic DNI

Dialogic Media Engine

3G Mobile

3G-H.324M

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 7

Note on Video Clips

Due to Codec and Copyright limitations, the video clips used during the live presentation at ClueCon have NOT been included in this posted version.

Please contact jeff.dworkin@dialogic.com for more information.

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 8

Innovation At Work

Video Telephony– Interactive Video Respons

e– Video Security– On Line Banking

Video IP Streaming– Lets go to the mobile

device

7-9 months development cycle

On Line Banking

Video Security

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 9

“Love Meter”

Application: Real-time voice analysis for mobile users– Detects range of emotions during session– Updates caller with current “love level”– Premium features: recording function– Final session analysis by SMS/MMS or Web

Developer & Host: EGTEK/Maxis Platform:

– EGTEK 3G Video Solution Suite– Based on Dialogic® HMP Software

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 10

Video Challenges

Handset Compatibility and Interoperability Maintaining Quality

– Video Compression Techniques– Capture/Transcode Quality – Rate Control

Video Analytics for Advertising and Security– Pattern Matching

• Logo Detection – Image Analysis

• Digital Watermarking• Video Forensics

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 11

Why do we need Video Compression?

Standard Definition (SD) Video: 720x480 @ 30 frames/second (fps) requires:

720 x 480 pixels 30 frames 3 colors 8 bits ---------------------- x -------------- x ------------ x -------- = ~250 Megabits/sec (Mbps) frame sec pixel color

H.264 is leading default with similar quality at half the bit rate of H.263 or MPEG-2

Typical video delivery pipes Compression Factor Required

Dialup Modem: 48 Kbps ~5000

ISDN: 128 Kbps: ~1900

T1: 1.5 Mbps: ~160

T3: 45 Mbps: ~5

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 12

H.264 Codec Optimization: Subjective Comparison

Quality degradation throughout the video frameNoise and artifacts impair video frame quality

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 13

H.264 Codec Optimization: Subjective Comparison

Stefan, CIF 30fps

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 14

Advanced Algorithms: Bit Rate Control

To be incorporated in Dialogic® Host Media Processing Software Release 4.1

First Dialogic® product release using Dialogic® Media Labs technology

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 15

Bit Rate Control

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 16

Advanced Algorithms: Error concealment

Artifacts are concealed using motion vector estimation techniques

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 17

Advanced Algorithms: Perceptual Quantization

Original Perceptual Quantization Normal Quantization

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 18

Measuring / Monitoring Video Quality

Target use case• Ensuring content is “advertiser-friendly”Goal• Measure quality and quantify result• Compare “score” against parameters• If quality is in the “good” range, then video is useful for advertisersAnalyzes the video content itself• Not the “protocol”• Not the “network”• Measurement of the user experience

Video Bit Stream User Definable Classification

Good

Unsure

Bad

User Definable Classification

Good

Unsure

Bad

Video CaptureQuality

Video CodingQuality

Parameters:• Motion Blur• Shakiness• Inconsistency• Contrast

Parameters:• Blockiness• Blur• Ringing

Assessment

score

Video CaptureQuality

Video CodingQuality

Parameters:• Motion Blur• Shakiness• Inconsistency• Contrast

Parameters:• Blockiness• Blur• Ringing

Assessment

score

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 19

Video with Good Capture Quality

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 20

Video with Bad Capture Quality

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 21

Pattern Matching and Image Analysis

Identifying objects within the stream– Advertising applications– Identifying persons of interest– Medical imaging/diagnosis– Video search applications

Views = 10 Eyeball seconds = 4.09

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 22

Logo Detection / Tracking

Demonstration identifies the Dialogic logo within our corporate video Two-step process:

– Identify the logo (in different sizes, even if partially hidden)– Track the duration of time the logo is visible

Highlight the logo when it is recognized… … and keep track of number/duration of appearance

In some cases (quick appearance, hidden) we will not recognize/track the logo (not a useful appearance for advertising)

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 23

Dialogic Corporate Video Logo Tracking Demo

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 24

Digital Watermarking

Most obvious application is to reduce piracy Also has applications in the enterprise space

– Ensuring authenticity of video delivery to your customers– Tracking receipt of sensitive material to the intended audience

Additional consumer applications– Tracking what videos are being watched by a consumer– Useful for rating services (what people have watched)– Ad insertion/tracking (what advertising did people see?)

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 25

Top: Forgery picture

Bottom: Two original pictures

Los Angeles Times on March 31, 2003

Video Forensics: Is seeing believing?

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 26

Project DiaStar™

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 27

DiaStar Messaging

Solution for the high-end of the open source Market– Creates a Client/Server Architecture that allows

Asterisk/FreeSWITCH/Other developers to continue to work in their native environment but still get access to the feature set provided by Dialogic.

– Companies that are using open source but are not happy with the scalability, redundancy and reliability or those that would try open source except for concerns about those same issues.

– Companies are using or would use open source except for missing features that we can provide via DiaStar• First Available Feature: Dialogic Perfect Call Progress Analysis

and Answering Machine Detection • Next Feature: Video Support

www.dialogic.com

Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.

Slide 28

Dialogic, Dialogic Pro, Brooktrout, Diva, Cantata, SnowShore, Eicon, Eicon Networks, NMS Communications, NMS (stylized), Eiconcard, SIPcontrol, Diva ISDN, TruFax, Exnet, EXS, SwitchKit, N20, Making Innovation Thrive, Connecting to Growth, Video is the New Voice, Fusion, Vision, PacketMedia, NaturalAccess, NaturalCallControl, NaturalConference, NaturalFax and Shiva, among others as well as related logos, are either registered trademarks or trademarks of Dialogic Corporation or its subsidiaries (“Dialogic”). The names of actual companies and products mentioned herein are the trademarks of their respective owners. Dialogic encourages all users of its products to procure all necessary intellectual property licenses required to implement their concepts or applications, which licenses may vary from country to country. Dialogic may make changes to specifications, product descriptions, and plans at any time, without notice.

USE CASE(S)Any use case(s) shown and/or described herein represent one or more examples of the various ways, scenarios or environments in which Dialogic products can be used.  Such use case(s) are non-limiting and do not represent recommendations of Dialogic as to whether or how to use Dialogic products.

2/09

www.dialogic.com