+ All Categories
Home > Documents > Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

Date post: 25-Dec-2015
Category:
Upload: erick-golden
View: 217 times
Download: 0 times
Share this document with a friend
Popular Tags:
18
Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL
Transcript
Page 1: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

Paul Greenfield, CEO

High Definition

Video Transcoding

for Consumer Markets

CONFIDENTIAL

Page 2: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

2©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Product Roadmap

Linedancer 1130nm NXP

Production

ASProCoreV6

• High Performance Extreme Processor

• PC-based Professional Image Processing

Linedancer HD130nm NXP/UMC

Sampling

ASProCoreV7

• High Performance Extreme Processor

• Embedded Professional Image Processing

"Q"Mobile

• Low cost/power ASSP

• High quality 720p encode/decode

• Camera/phone market

• General Purpose architecture forhigh performanceimageprocessing

Accelera2xxx/3xxx

• PCI-X / PCIe Plug-In-Card

• Realtime / Offline HD Video Compression

• Studio Quality H.264 / VC-1* / MPEG-2

Production

Accelera5xxx

• PCIe Plug-In-Card

• Realtime HD Video Compression

• Studio Quality H.264 / VC-1* / MPEG-2

Sampling

IP license• Customer ASICs

ProfessionalMarkets

* porting subject to customer demand

ASProCoreV8

• New Architecture optimisedfor advanced videoencoding/decoding

“Q” Transcoder65nm Toshiba

Page 3: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

3©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

"Q" Transcoder

Realtime HD encoding (1920x1080p30/i60) 4x SD encoding (720x480i30 / 576i25) H.264/AVC: Baseline/Main/High Profiles VC-1/WM9: Simple/Main/Advanced Profiles MPEG-2: Main/High Profiles All resolutions up to 1920x1080i60

Optional Video Decode Engine for transcoding Audio encoding/transcoding for all

major standards (AAC, HE-AAC, AC-3, WMA) Customer-programmable stream processor for

application-specific mux/output formats & DRM

System StreamProcessor (RISC)

MUX, DRM, Output, System Control

Customer programmable, standard RTOS

10/100/1G MAC

USB 2.0

Memory Card

PCI Express

Audio DSP

System DRAM

Flash

Video Preprocessor Scaling, Color Space Conversion,

De-interlacing, Noise reduction,Watermarking, Logo insertion

HD Compression Engine

Motion Estimation

Intra Mode Prediction

MacroblockEngine:

TransformQuantize

RDO

EntropyCoding

&Stream

Generation

Rate Control

VideoDRAM

Unc

ompr

esse

d A

/V in

Com

pres

sed

A/V

out

put

VideoDecodeEngine

Secure OTP

AES / 3DES

GPIO / TSDVI / HDMI

8/10 bit ITU-656RGB/YUV

1 x HD / 4 x SD

I2S Audio x 4

HDCP Keystore

Page 4: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

4©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Scalable to meet any price / performance point

System Control CPU(ARM, MIPS, DSP, etc)

Macroblock Processing

Unit

MacroblockProcessing

Unit

MacroblockProcessing

Unit

SADAccelerator

SADAccelerator

EntropyCoding

Accelerator

MacroblockProcessing

Unit

SIMD Instruction bus

ControlUnit

AMBA AHB Interface

Scalable number of Macroblock SIMD PUs (Decides performance)

Scalable number of SAD Motion Estimation

accelerators(Decides Quality)

ApplicationVideosize

Profile & Level

CTRL ECA SADMB PUs

Engine size (65nm/500MHz)

Power(65 nm)

HD H.264 compression1920 x 1080i60

High Profile, Level 4.1 1 1 2 16 ~4.1 mm2 ~300 mW

Wireless HDMI1920 x 1080

p60 4:4:4

High 4:4:4 Intra Profile 1 1 0 11 ~1.5 mm2 ~200 mW

Mobile HD cellphone 1280 x 720p30

Baseline profile 1 1 1 5 ~2.2 mm2 ~150 mW

SD H.264 compression 720 x 480i60

Main Profile Level 3 1 1 1 5 ~2.2 mm2 ~150 mW

Page 5: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

5©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Market for HD Video Encoding Devices (IN-STAT 2007)

(In Thousands of Units) 2005 2006 2007 2008 2009 2010 201107-11 CAGR

ASTB/Home Gateway/PVRs 3,651 7,746 8,616 11,041 13,354 16,410 18,380 21%

Blu-Ray / HD-DVD recorders 20 30 200 530 1,120 2,305 3,810 109%

IPTV adapters 382 470 740 1,200 1,800 2,675 4,132 54%

In-Home Video Networking 4,170 7,345 12,982 21,101 32,607 52,415 85,671 60%

Wireless HDMI 0 0 0 1,971 2,556 3,258 7,122 N/A

Remote streaming appliances 225 500 760 1,000 1,200 2,000 41%

BIu-Ray / HD-DVD burners 116 585 2,808 3,503 4,708 11,883 112%

SD/HD Camcorders 13,600 14,400 14,900 15,100 15,300 15,200 15,407 1%

IPTV infrastructure 6,107 10,385 12,157 16,477 18,479 20,914 25,884 21%

Mobile TV infrastructure 265 366 494 645 835 1,079 1,414 30%

Broadcast & Digital Cinema 24,007 27,196 32,345 28,138 30,461 36,278 38,988 5%

Phone Cameras 387,500 531,000 644,000 765,000 830,000 868,000 981,468 11%

Web cameras 14,700 15,400 16,000 16,600 17,200 17,800 18,456 4%

PC TV Tuners 1,135 2,311 3,677 6,714 12,015 15,725 17,885 58%

TOTAL UNITS 455,537 616,989 747,195 888,084 980,289 1,057,968 1,232,499 32%

Also validated by independent strategy consultant - Dr Handel Jones (Excludes PC Market)

Page 6: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

6©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Competitive Advantages

Higher performance & quality - based on Studio Quality Algorithms 2 channels of 1080i encode / 1080p60 encode / 10-bit / 4:2:2 support

“Anything in, anything out” transcoding Flexible software-programmable engines Multi-codec decode + encode

Advanced Security Features Emerging as a strong customer care-about “Q” has comprehensive encryption/transcryption features

e.g. encrypting data when passed to external memory

Secure on-chip memory for keys & boot images

Flexible front-end video preprocessor Advanced noise reduction, scaling & deinterlacing

Highly Scaleable - no software rewrites required - easy to create variants “HD Encoder” – Camcorders, Blu-Ray recorders / “SD Encoder” – Slingbox-type applications

“Mobile” – High end (720p) cameraphone / “Lite” – Low end (VGA) cameraphone

“Wireless HDMI” – Low latency for UWB, etc

Page 7: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

Additional Material

Use Cases

IP Overview

Software Development Environment

Page 8: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

12©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Wireless HDMI solution (H.264 option)

HDMI 1.2

Q-basedencoder

Wireless USBTX

Wireless USBRX

TV/STBDecoder

HDMI 1.2

USB 2.0 OTG

USB 2.0 OTG

Rate control

Link quality feedback

802.11nor UWB

Low latency I-frame only encode H.264 (can use standard/modified TV decoder)

50-200 Mbps compression Dynamic rate control adapts to wireless link quality

Quantization, 4:4:4/4:2:2/4:2:0, 8/10/12 bpp, block sizes, etc Can also drop down to long-GOP at 5-10 Mbps

Using standard TV/STB Decoder Multi-room coverage with the same solution

1920x1080i6024/30/36 bppRGB / YCrCb1.5 – 3.0 Gbps

480 Mbps PHY50-200 MbpsAES encryptedstream

HDMI 1.2

Q-basedDecoder

Page 9: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

13©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Integrated TV “Pause Button”

Store video from broadcast, HDMI or analogue sources Encode and/or transcode and/or downscale video

Integrated solid state NAND flash storage Longer lifetime & higher reliability than Hard Disk 8GB Flash gives ~4 hrs (HD), ~20 hrs (SD)

Support external SD/MMC or USB key for placeshifting & sideloading Transcode to portable devices, e.g. iPod, Zune, Mobile phone Add Digital Rights Management to protect content

AspexQ-basedEncoder/

Transcoder

Video RAM32Mx16

DDR2-667

Serial Boot / ID

Flash

NAND FlashStorage

USB 2.0USB socket

for RemovableFlash Drive

Cable/Satellite/Terrestrial

Tuner inputs

HDMI inputs

TV Decoder

SoCTransport Stream

Plasma/LCDPanel

HDMI or Digital YUVSD/MMC

SD or MMCsocket for

memory card

Page 10: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

14©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Networked digital TV

Add home networking chipset Wireless, Ethernet, Powerline, MOCA, HomePNA, etc

Use DLNA to publish content to networked devices Industry standard for media servers

Secure reformatting for placeshifting, sideloading & internet streaming Streaming to second TV, PC, portable device, or internet (“Slingbox”) Reduce bitrate and/or resolution to meet bandwidth or device constraints Transcode to other codecs (e.g. Windows Media) for client devices Add Digital Rights Management (e.g. Microsoft DRM) to control content

AspexQ-basedEncoder/

Transcoder

Video RAM32Mx16

DDR2-667

Serial Boot / ID

Flash

HomeNetworking

Chipset

Cable/Satellite/Terrestrial

Tuner inputs

HDMI inputs

TV Decoder

SoCTransport Stream

Plasma/LCDPanel

HDMI or Digital YUV

Home NetworkWiFi, Powerline,

Ethernet, MoCa, etc

Home NetworkWiFi, Powerline,

Ethernet, MoCa, etc

PCSecond

TVPortableDevice

Broadband Modem Internet

InternetLaptop

or MobileDevice

Page 11: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

15©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Blu-Ray recorder / DVR

Record from SD or HD analogue sources Full 1920x1080 resolution in H.264, VC-1 or MPEG-2 Choice of bitrates and resolutions for control of recording time

Transcode broadcast streams Ensure compatibility with Blu-Ray/HD-DVD codec constraints Reduce bitrate to extend recording time

Transcoding from AVCHD/HDV Camcorder inputs “Long play” recording

AspexQ-basedEncoder/

Transcoder

Video RAM32Mx16

DDR2-667

Serial Boot / ID

Flash

Transport Stream

Blu-Ray/HD-DVDrecordable drive

Hard DiskDrive

HDMI

Component in Digital Y Cr CbVideo ADC

Tuner / DemodCable/Sat/Terr in

Audio ADC I2S

Transport Stream

Stereo audio in

HDMI

Blu-RayDecoder

SoC

Page 12: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

16©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

AspexQ-basedEncoder/

Transcoder

PCI Express plug-in card

Video RAM32Mx16

DDR2-667

HDMI

Component in

PCI Express x1

Serial Boot / ID

Flash

Digital Y Cr CbVideo ADC

Tuner / Demod

Cablecard/DVB-CIsocket (optional)

PSU &Power

sequencer

ATSC/Cable/Sat in

1 Lane PCI Express (desktop) or ExpressCard (laptop) form factors H.264 SD or HD encode from component or HDMI inputs

Any resolution & bitrate from 1..20 Mbps, Baseline (Quicktime) or Main / High Profile

Transcode from off-air MPEG-2 HD to H.264 (HD or SD) Free-to-air or using Cablecard/DVB-CI Conditional Access smartcard Can transcode multiple SD streams

“Slingbox” functionality – variable resolution & bandwidth VC-1 / H.264 Transcode/sling content from PC (or PC-connected peripheral)

Webcam videoconferencing Accelerated HD-DVD / Blu-Ray burning

Audio ADC I2S

Transport Stream

Stereo audio in

PCIe slot (desktop)or

ExpressCard slot (laptop)

PCI 32/33

Page 13: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

17©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

USB / Wireless TV capture

Video RAM32Mx16

DDR2-667

HDMI

Component in

USB 2.0 OTG (Host or Device)

Serial Flash

(Program)

Digital Y Cr CbVideo ADC

Tuner / Demod

PCI 32/33Cablecard/DVB-CIsocket (optional)

AspexQ-basedEncoder/

Transcoder

PSU &Power

sequencer

ATSC/Cable/Sat in

Standalone USB Dongle or Wireless Media Ingest engine USB 2.0 interface configurable as host or device

H.264 SD or HD encode from component or HDMI inputs Any resolution & bitrate from 1..20 Mbps, Baseline (Quicktime) or Main / High Profile

Transcode from off-air MPEG-2 HD to H.264 (HD or SD) Free-to-air or using Cablecard/DVB-CI Conditional Access smartcard Can transcode multiple SD streams

“Slingbox” functionality – variable resolution & bandwidth VC-1 / H.264

Audio ADC I2S

Transport Stream

Stereo audio in

PCUSB port

(Wired Option)

802.11n WiFiUSB chipset

(Wireless Option)

Page 14: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

18©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Webcam / Videoconferencing app

Video RAM32Mx16

DDR2-667

USB 2.0 OTG (Host or Device)

Serial Flash

(Program)

Digital Y Cr Cb

CMOS orCCD

CameraModule Aspex

Q-basedEncoder/

Transcoder

PSU &Power

sequencer

Digital Y Cr Cb (or RGB) input from image sensor 8/10/16/20 bit input, up to 165 MHz pixel clock

H.264 (Quicktime) or VC-1 (Windows Media) encoding at up to 1080i60 Other video formats (Flash, MJPEG, MPEG-4) could be added as software upgrades

USB Video Class support Bulk or Isochronous Stream-based (MPEG-2 TS) Frame-based (MJPEG etc)

Audio ADC I2S

PCUSB port

(Wired Option)Microphone

Page 15: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

19©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Aspex Compression Engine

Software programmable architecture Exploits Aspex’s expertise in multi-standard video encoding Based on 8th generation Aspex ASProCore Supports concurrent multiple steams and standards

Configurable for any price or quality point Optimized for low system power

AspexCompression

Engine

UncompressedVideo

ElementaryStream

SystemBus

Page 16: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

20©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

SADAccel

ECAccel

MBPU

Ctrlunit

Processing Units

Control Unit: VLIW program controller and scalar processor, e.g. DSP, ARM.

Macro Block PU: SIMD parallel co-processor for data processing. Designed to minimise power and memory bandwidth.Performs all macro block processing including motion search.

(Optional) Sum of Absolute Difference Accelerator: Hardware accelerator with flexible fully programmable search strategy.

(Optional) Entropy Coding Accelerator: Hardware accelerator. Supports multiple standards including CABAC, CAVLC, etc.

Page 17: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

21©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Aspex Compression Engine

Scalable to meet any price / performance point

System Control CPU(ARM, MIPS, DSP, etc)

MacroblockProcessingU

nit

MacroblockProcessing

Unit

MacroblockProcessing

Unit

SADAccelerator

SADAccelerator

EntropyCoding

Accelerator

MacroblockProcessing

Unit

SIMD Instruction bus

On-chip video memory

Off-chip video memory

DMADMADMADMA

ControlUnit

AMBA AHB Interface

Arbiter

Scalable number of SIMD Macroblock PUs (Decides performance)

Scalable number of SAD

Motion Estimation accelerators

(Decides Quality)

Scalable amountof on-chip memory

(Performance & Power)Scalable amount

of off-chip memory(Quality & Power)

Scalable number ofinstances for

multi-stream support

Page 18: Paul Greenfield, CEO High Definition Video Transcoding for Consumer Markets CONFIDENTIAL.

22©Copyright 2007 Aspex Semiconductor Holdings Limited CONFIDENTIAL

Software Development

Software tools Comprehensive suite of GNU based cross development tools

Compiler, assembler, linker, loader, libraries Supported under Linux and Windows

Derived from previous ASProCore programming tools and libraries Proven on seven ASProCore versions over 10 years

Programming Majority of customers

Use the Aspex encoder libraries and program in C/C++ via the library API Some customers wishing to differentiate themselves

Directly programming the PUs in an extended version of C/C++ New statement to declare data parallel variables and perform data parallel

operations

Programming model Conventional SISD processor with co-processors Simple to understand, program and debug

All control on the SISD processor


Recommended