Surf Proprietary Information 1

Technology focus on

Multimedia Applications and services

Market-provenMarket-provensince 1996since 1996

Alex Shtein

Surf Proprietary Information

2www.surf-com.comSurf Proprietary Information

2

Topics for this presentationTopics for this presentation

» Indentify the main multi-media applications in the fixed-line and mobile telecom market

» Provide a description of the main media-processing related challenges for each of the above applications

Surf Proprietary Information

3www.surf-com.comSurf Proprietary Information

3

Target Markets & applications Target Markets & applications

» Target markets and applications are divided into 4 Segments:

Segment 1: Telecom multi-media applications and services in IMS/NGN

Segment 2: IMS/NGN infrastructure

Segment 3: Enterprise Telephony

Segment 4: Over-the-top (OTT) rich content adaptation and streaming

Surf Proprietary Information

4www.surf-com.comSurf Proprietary Information

4

Segment 1: Telecom Multi-media applications

Segment 1: Telecom Multi-media applications

» There are 4 main applications in the telecom space

» All 4 are relevant for fixed and mobile telephony

Interactive voice and video response (IVVR), implementing:

» Mobile banking, Video dating, Adult entertainment, etc.

Wide band telephony

Video/voice conferencing bridge

Video mail/messaging

Surf Proprietary Information

5www.surf-com.com

IVVRIVVR Main challenges

Various video content in different formats: requires transcoding

» from any to any codec

» Support for H.263, MPEG4

» H.264 is becoming dominant

» Handle resolutions of up to VGA/D1 in the input (720*576)

Video quality, interoperability and robustness

» Need to be able to optimize video quality especially at low bitrates

» Support for in-band I-frame requests (relevant RFC’s)

» Interoperability with hundreds of mobile and fixed phones

Low latency from key stroke till change of appearance on the phone

» Running 3G-324M layer and transcoding layer on the same sub-system

» Fast switching of video contents without waiting for I-frames

Support fixed IP and mobile 3G-324M on the same platform

» In ATCA, need to support iTDM for TDM transfer

Support for advanced video features:

» Scrolling text, multiple overlays at multiple languages

» Logos, bitmaps, lines insertions with transparency (Alpha blending)

3G-324M over an IP transport for easy interface with IP based MSC

» Using transparent RTP

» Using 3GPP IUuP/Nb-UP

SurfExpress PCI/e

Server

3G-324M orRTP

Storage

Prompts in various formats

Play prompt information

Receive DTMF

• Mobile banking

• video dating

• Video search

• Mobile TV

• Video blog

Surf Proprietary Information

6www.surf-com.com

Wideband TelephonyWideband Telephony

Main challenges

» High density transcoding for wideband codecs

For example, AAC-LC needs 10 time more resources then G.729

» Wideband codec support

G.722.2 (WB-AMR), AAC-LC

G.711.1 will become important

» Wideband conferencing: optimize voice quality

Voice mixer needs to handle wideband inputs at various sampling ratesy

» Interoperability and interworking between wideband devices and narrow band devices

• Conference bridge

• Announcement server

• Transcoder

IP

RTP/G711.1 RTP/AAC

IP phone

WB-AMR (G.722.2)

Surf Proprietary Information

7www.surf-com.com

Video ConferencingVideo ConferencingMain challenges

» Bridge between various types of endpoints (soft clients, desktop, Mobile phones, MS Messenger, Skype..) with diverse codecs and resolutions

Resolutions from SQCIF to VGA

Resizing from any device to any device

» Support various transport layers (RTP, 3G-324M) 3G phones and fixed (RTP) connected to the same bridge

» Split screens, multiple layouts from the same conference Different participants will view different layouts in same

conference

Layouts change based on dominant speaker change

» Rich layout support: Backgrounds and foregrounds

Drawing lines

Text overlays for participant identification

» Large amount of participants per conference Need to decode dozens of video sources distributed

conference Video Phone (Desktop phone)

SurfExpress PCI/e IP

Video Phone (Soft phone)

H.264/VGA

Video Phone (LCD, TV)

MPEG4/D1

H.264/CIF

3G-324M/MPEG4/QCIF

Surf Proprietary Information

8www.surf-com.com

Video MailVideo Mail

Fixed Video Phone

SurfExpress PCI/e

IP

Storage

Video Phone (Soft Client)

Server

3G-324M/H.263 QCIF

Leave message

RTP/H.263/CIFRTP/H.264/VGA

Play message in adifferent formatMain challenges

» Record in one format, play in another format (transcoding)

» Resolution adjustment, transport adjustment (3G-324MRTP)

» Generate I-frames so that recorded message starts with an I-frame

» Diverse resolutions and codecs (from VGA/D1 to QCIF phones) high quality rescaling

» Audio-video synchronization

Surf Proprietary Information

9www.surf-com.comSurf Proprietary Information

9

Segment 2: IMS/NGN infrastructure Segment 2: IMS/NGN infrastructure

» There are 3 main IMS/NGN components that are involving multi-media processing

Media gateway (MGW)

» 3G to IP video gateway

» Voice gateway

Session Boarder Controller (SBC)

Media server – Media resource function (MRF/MRFP)

Surf Proprietary Information

10www.surf-com.com

IMS Infrastructure: Media GatewayIMS Infrastructure: Media Gateway

IP/NGN

Media Gateway PSTN

SurfRider/AMC

3G-324m/H.263

SIP IP phone

SIP Video phone

RTP/SIP

H.264

RTP/SIP

Main challenges

» Field hardened:

With top class echo canceller, T.38, interoperable

Voice quality at harsh network conditions

» High density

Need iTDM for ATCA, uTCA

Low power and low footpring per port

» Rich codec support

Fixed and mobile codecs

Narrowband and wideband codecs

» Simultaneous voice and video support

Voice: TDMRTP

Video: 3G-324MRTP

Surf Proprietary Information

11www.surf-com.com

IMS Infrastructure: SBCIMS Infrastructure: SBC

IP Operator A

SBC

SurfRider/AMC

SIP IP phone

G.729/SRTP

IP Operator B

IPv6 G.711/RTP IPv4

Main challenges

» Packet to packet architecture (not the TDMIP based architecture of legacy telephony boards)

» Voice/video transcoding

Codec A codec B

RTP framesize A framesize B

IPv4 IPv6

Wideband codec narrowband codec

» High density:

Number of concurrent sessions

Number of new calls per second (CPS)

» Security:

SRTP/AES

» Use the same box for other IMS infrastructure (MRF, MGW)

Surf Proprietary Information

12www.surf-com.com

IMS Infrastructure: MRF/MRFPIMS Infrastructure: MRF/MRFP

Main challenges

» High density and bottleneck-free architecture (move away from the TDM based architecture of legacy boards)

» High call-per-second (CPS) score. At least 100 per board for a 10 second call duration.

» Multiple services including voice/video, streaming, conferencing

» Support for distributed conferencing – at least 1000 voice participants on the same bridge

IP/NGN

RTP/G.729

IP phone

DTMF

IP phone

RTP/G.729

AnnouncementServer

Prompts in G.711

(example)

SurfExpress PCI/e

StorageServers

Surf Proprietary Information

13www.surf-com.comSurf Proprietary Information

13

Segment 3: Enterprise telephony Segment 3: Enterprise telephony

» Next generation IP-PBX

First generation PBX supported PSTN

Second generation PBX integrated an external VoIP gateway to the PBX

Third generation PBX was an integration of the VoIP and PSTN in one box (IP-PBX)

Forth generation PBX is an integration of all multi-media services into the IP-PBX, including

» Video IVVR

» Video conferencing

» Video mail

Surf Proprietary Information

14www.surf-com.com

Multi-Media IP-PBXMulti-Media IP-PBX

PSTNIP

Surf DSP chip

PSTN Phone

Fax

Modem

PBX

IP Phone

Printer

• VoIP GW

• Conference bridge

• Fax server

• Modem backup connection

• Codec transcoder

Main challenges

» Low cost per port / high functionality

» Integration of VoIP services:

VoIP gateway,

Fax server, Internet aware fax

Conferencing bridge,

Analog modem backup connection,

Voice mail

» Integration of Multi-media services:

Video mail

Video conferencing bridge

Video IVR (IVVR)

Surf Proprietary Information

15www.surf-com.comSurf Proprietary Information

15

Segment 4: Over The Top (OTT) rich content adaptation and streaming

Segment 4: Over The Top (OTT) rich content adaptation and streaming

» Focused around rich content (video) IP streaming to mobile phones and PCs connected to mobile internet

» Various applications, including:

LiveTV to mobile

Mobile Video on demand (VoD)

Streaming of web content to the mobile (web-to-mobile)

Streaming of web content to mobile internet (web-to-web)

Video Advertisements injection

Surf Proprietary Information

16www.surf-com.com

Mobile TV & Other Streaming Video Services

Mobile TV & Other Streaming Video Services

SurfExpress PCI/e

Web

Ad Server

Live feed

StorageServers

StreamingServer

3GPP

flv

RTP

HTTP

RTP/UDP/IP(unicast)

RTCP

Main challenges

» Optimize Video quality, and quality of experience (QoE):

Video streaming with on-the-fly bitrate adaptation adapt to each device’s variable network connection quality

» Transcoding/repurposing content from web to mobile:

Flash(FLV), H.264 & older codecs (VP6, Sorenson)

RTSP streaming and progressing download

» Enable service personalization:

Advertisement injection

Logo, scrolling text, transparency (Alpha blending)

» Support high resolutions in the Input

For example YouTube stores content at high quality (VGA, D1)

» Support high resolutions in the Output

Relevant when streaming to laptops connected to mobile Internet.

Requires support for resolutions up to VGA in the output

» Cable to mobile:

Support for Mpeg2 Transport stream (MP2TS)

Support for AAC codec

Surf Proprietary Information

17www.surf-com.com

Thank YouThank You