+ All Categories
Home > Documents > AVC-ULTRA TECHNOLOGY - We are SMPTE · AVC-ULTRA TECHNOLOGY BALANCING: ... Will it fit in the pipe?...

AVC-ULTRA TECHNOLOGY - We are SMPTE · AVC-ULTRA TECHNOLOGY BALANCING: ... Will it fit in the pipe?...

Date post: 02-May-2018
Category:
Upload: truongcong
View: 216 times
Download: 1 times
Share this document with a friend
55
AVC-ULTRA TECHNOLOGY BALANCING: FILE SIZE, PROCESSOR LOAD AND PERFORMANCE FOR NEW WORKFLOWS AND APPLICATIONS- LEARN MORE HTTP://WWW.PANASONIC.COM/BUSINESS-SOLUTIONS/AVC-ULTRA.ASP
Transcript

AVC-ULTRA TECHNOLOGY

BALANCING: FILE SIZE, PROCESSOR LOAD AND PERFORMANCE FOR NEW WORKFLOWS AND

APPLICATIONS- LEARN MORE HTTP://WWW.PANASONIC.COM/BUSINESS-SOLUTIONS/AVC-ULTRA.ASP

AVC-ULTRA

Compression is just the CODEC

Media

Format

Wrapper

CODEC

AVC-Intra Class 100

DNXHD, ProRes

AVC LongG

MXF OP Atom

MXF OP1B,

Quicktime,

DVI

P2, AVCHD

HDCAM, Mini DV,

SR

LTO, HDD,

BluRay Disc

P2 Card,

SD Card

Compression Overview

The goal of compression

lossless compression

When is lossy compression necessary?*

Goal for Improving Compression*

Compression improvement costs*

*Video compression quality is content and application dependent

Compression Overview

Intra-frame = I frame only

Inter-frame compression = Long GOP

long GOP can achieve higher compression ratios

long GOP compression performance is highly content and application dependent

Video CODECs balanced for applications

Image Qality

File Size

Complexity

How good will the

content look?

Will it hold up to further

processing:?

How much storage will I

require?

Will it fit in the pipe?

Will my hardware

encode/decode the

content fast

enough?

The Pie Gets Bigger

As processor speed improves

As storage gets cheaper

As high data rate physical links come into use

As GPU begin to be utilized

With Moore’s law

But Everyone Gets Hungrier

As resolution increases

As “temporal” resolution increases

As more downstream processing is expected

As production teams wish to be mobile

Utilizing WAN and wireless networks

Budgets are shaved

Many different people expect that THEY will get the extra piece from Mr.. Moore

What is AVC?

AVC stands for Advanced Video Coding

ITU-T was standardized it as “H.264”, and ISO standardized as “ISO/IEC 14496-10 MPEG-4 part10 AVC”

AVC is a core technology for all types of encoding applications

AVCHD - High profile AVC implementation supported by Panasonic and Sony

AVC-Intra - applications of AVC high profiles using Intra frame coding

AVC-Ultra are expanded AVC-Intra applications and other high profile applications

The goal of the JVT was to double the compression efficiency of then existing techniques

What does AVC give us Over MPEG 2?

Support for the new “formats”

60p, 444, 2K, 4K

Efficient compression of 10bit or 12bit quantization

Opportunities to trade complexity

For performance

For file size

AVC Production Format

CODEC design

n Baseline Profile

n High Profiles

n High Profile is supported by Blu-ray Disc and AVCHD

n High Intra Profiles

n Subset of High Profile that uses only I picture

n High 4:2:2 Intra Profile (Hi422IP) e.g., AVC-Intra class 100

n High 10 Intra Profile (Hi10IP) e.g., AVC-Intra class 50

n Main Profiles

n basic tools + high efficiency tool (including CABAC)

n Extended Profiles

n basic tools + high efficiency tool (excluding CABAC) + streaming tool

n High 444 Intra

- Including 60p

- Including 60p

n High 4:2:2 profile is AVC-LongG (10 Bit 4:2:2)

- AVC 444 (12 Bit 4:4:4 1080p, 2K, 4K)

& AVC – Intra Class 200

What’s New in the AVC toolbox?

Intra-Frame prediction

Variable block sizes, 2x2, 4x4 and 8x8

Integer Transform & Quantization

Improved Inter-frame prediction (long GOP) & motion estimation

Finer motion prediction accuracy

Powerful CAVLC and CABAC entropy encoding

Flexible image slicing optimizes multi-node processing

De-blocking Filters to hide errors

How About H.265??

More prediction tools

More block configurations

More entropy coding

More motion prediction

Heavier processor load

More later…

Intra frame Prediction

Some possible

prediction modes

Best approximation, repeat right

adjacent pixels Errors

Pixel Block Error Image

Variable Size Blocks

Varying block sizes are

chosen to provide best

fit to image data

structure and thus

generate optimal

coefficient data sets.

This creates more

efficient coding.

Motion Vectors

Improved INTER frame Compression

More complex (weighted) referencing More accurate motion vectors

¼ pixel & 1/8 pixel motion vector accuracy

& a variety of block sizes

Motion PREDICTION

What Is Entropy Coding?

More common data strings represented by fewer bits

Morse Code is Entropy Coding

Entropy coding requires knowledge of the statistical behavior of the data

n Context Adaptive Variable Length Coding (CAVLC) changes

the code table to suit the localized image content

~ 25%* improvement over non-adaptive coding (e.g.,

huffman coding)

n Context Adaptive Binary Arithmatic Coding (CABAC) looks

at the entire pictures probability distribution & can provide a

30% compression gain

~ 10%* improvement over CAVLC

*estimated average, real results are content dependent

Advanced Entropy Coding

No Change in Video Quality

Significant differences in coding complexities!

Huffman

Coding

CAVLC

CABAC

Relative

compressed

file sizes

Single CPU Model

CPU #0

Multi CPU Model

CPU #0

CPU #1

CPU #2

CPU #3

Total 4 CPUs

CPU #0

CPU #1

CPU #2

CPU #3

GOP 0 GOP 1 GOP 2 A

B

C

D

A B C D

A

B

C

D

* Use 1 GOP = 6 frames for Explanation

Multi Slice Encoding

PS

NR

Long GOP

I B B P B B I B B I I I I I I I I I

Time Time

GOP

I Frame Only

To GOP or not to GOP

1st 5th 10th

Long GOP Codec

PSNR

Generation

AVC-Intra100 : Cut Edit

AVC-Intra50 : Cut Edit

Still Pictures

Fast Motion

Confetti fall

Flashing lights

Landscape

Long GOP quality

is content

dependent

To GOP or not to GOP

10 bit vector scope trace 8 bit vector scope trace

In High Profiles Bit Depths >8 Are Available

Inverse Bit Penalty

45

50

55

60

65

70

75

PS

NR

-Y

(Lu

min

an

ce)

12bit

10 bit

8 bit

Bit Rate Mb/s 50 100 150 200 250 300 350 400 450 500

Intra Frame CODEC Test

At Higher Bit Rates, AVC

encodes images so

accurately, reducing the bit

depth, reduces the

compression efficiency!

At Higher Data Rates Greater Bit Depth is More efficient!

CODECs are balanced for each application

Image Qality

File Size

Complexity

Driven by complete

production path.

•Resolution

•Bit depth

•Color accuracy

•Error tolerence

What pipe am I using?

How expensive is storage?

What are my shooting

ratios?

CPU, GPU, LSI, FPGA

Power requirements

Thermodynamics

Speed requirements

Multiple streams

PROXY

LPCS audio

New Applications Call for New Implementations

Class 50

720 24pN

1080 24pN

720 60p

1080 60i

Class 100

720 24pN

1080 24pN

720 60p

1080 60i

Class 200

720 24pN

1080 24pN

720 60p

1080 60i

GOP

GOP Class 50

1080 60p

Class 100

1080 60p

Class 200

1080 60p

444

1080p, 2K & 4K

Compression

Level

Resolution

Formats

No

t u

sed

fo

r A

VC

-In

tra

Selecting AVC Tools

No

t us

ed

for A

VC

Lo

ng

G

Integer Transform & Quantization

Variable block sizes, 2x2, 4x4 and 8x8

Intra-Frame prediction

Improved Inter-frame prediction (long GOP)

Finer prediction accuracy to minimize errors

Flexible image slicing optimizes multi-node processing

Powerful CAVLC and CABAC entropy encoding

De-blocking Filters to hide errors

Original frame

Intra Prediction

Intra prediction error

Intra Prediction data = 21Mb

40 Mb Total

Prediction Error = 12Mb

Integer

Transform

Integer

Transform Quantization

adjustable

Quantization

adjustable

Advanced

Entropy

coding

Lossless

Lossless

Lossy

CODEC Design Example AVC-Intra

A simple, yet powerful example of the

efficiency of AVC-Ultra.

16 channels of HD Long-G 25Mb/s

sent over one Cat-6 Ethernet cable

Small parsing server feeds 16 ToughPad

PCs via Gig-E router to decode 16 channels

of full res HD 4:2:2 10 bit content.

LongG enables the movement of high quality HD

(at “DV Bitrates”) over existing networks while

maintaining network speed.

As shown at the NAB 2013

File upload by 4G/LTE (with supported third party's 4G/LTE dongle)

File upload by

Wired LAN Wireless LAN

(with optional dongle AJ-WM30)

Wired LAN

iPad/iPhone/PC

PC

AJ-

WM30(option)

Live streaming

REC start/stop

Metadata/Text memo input

Proxy data playback

Proxy easy edit

direct mode functions

Wireless LAN

AJ-

WM30(option)

Wi-Fi router

Third party 4G/LTE dongle

Wireless LAN

AJ-

WM30(option)

Public Wi-Fi

4G/LTE

4G/LTE

Wired LAN

FTP server

FTP server

FTP server

FTP server

File upload

Streaming (via FTP server)

direct mode functions

What Salesforce did for CRM.

What SoundCloud is doing for audio.

Aframe can do for video.

IMPLEMENTATION HARDWARE OR SOFTWARE

“DYNA” Chip

Format Name

MXF

OP- ATOM

MXF

OP- 1b

QT

MOV Class

Sampl Ing

Bit

Depth

Intra/

GOP

SD

1080 720 1080 24p 25p 30p

60i

50i

24p 25p 30p

60p

50p

60p 50p

AVC-Intra444 P 444 4:4:4 12bit Intra 200M

AVC-Intra200 P 200 4:2:2 10bit Intra 200M 200M 200M

AVC-Intra100 P 100 4:2:2 10bit Intra 200M

AVC-Intra50 P 50 4:2:0 10bit Intra

AVC-LongG50 P G50 4:2:2 10bit GOP 50M

AVC-LongG25 P G25 4:2:2 10bit GOP 25M 25M 25M 50M

AVC-LongG12 P P G12 4:2:0 8bit GOP 12M 12M 24M

AVC-LongG6 P P G6 4:2:0 8bit GOP 6M 6M 12M

AVC-Proxy

P 6.0Mbps** 4:2:0 8bit GOP

P 1.5Mbps 4:2:0 8bit GOP

P 800K 4:2:0 8bit GOP

DVCPRO HD P 4:2:2 8bit Intra

DVCPRO50 P 4:2:2 8bit Intra

DVCPRO P 4:1:1 8bit Intra

DV P 8bit Intra

Compression Format File Format microP2 Recording covered N/A for hardware limitation Unsupported

AVC-Ultra Formats Supported

P 3.5Mbps 4:2:0 8bit GOP

** 1920 x 1080 proxy

Format v Data Rate

Format 720p 60

1080i 60

1080 24pN 1080p 60

Data rate 220 Mbps 180Mbps 440Mbps

720 24pN 720p 60

1080i 60

1080 24pN 1080p 60

27 Mbps 110 Mbps 90Mbps 220Mbps

Class 50 – pre-filter 4:2:0 10 bit

Class 100 – full res 4:2:2 10 bit Class 100

Class 50

Class 200 – full res 4:2:2 10 bit Class 200

720 24pN 720p 60

1080i 60

1080 24pN 1080p 60

15 Mbps 55 Mbps 45Mbps 110Mbps

Class 444 HD or 2K 444

AVC Ultra Recording

Simultaneous Recording

Dual Codec Recording

AVC-Intra100

AVC-LongG6

AVC-Intra100 simultaneously

AVC-Intra100

simultaneously

AVC-ULTRA Codec With Single Dyna Chip

AVC-ULTRA as a file format

1 - Select Compression

2 - Select Wrapper

MXF – OP Atom or OP1B

AVC-LongG +AVC-Intra

with Proxy

CONTENTS

CLIP

VIDEO

0001AB.XML

001AB2CD.XML

0001AB.MXF

AUDIO 0001AB00.MXF 0001AB01.MXF

ICON

0001AB.BMP

001AB2CD.BMP

AVCLIP

001AB2CD.MXF

PROXY

0001AB.MOV

001AB2CD.MOV

001AB2CD.MXF

001AB2CD.XML

AVC-LongG (Op-1B)

with Proxy

CONTENTS

CLIP

VIDEO

AUDIO

AVCLIP

PROXY

ICON

001AB2CD.BM

P

001AB2CD.MOV

Very easy to import “stand alone” Op1b file

0001AB00.MXF 0001AB01.MXF

AVC-Intra ( Op - Atom )

with Proxy

CONTENTS

CLIP

VIDEO

0001AB.XML

0001AB.MXF

AUDIO

ICON

0001AB.BMP

PROXY

0001AB.MOV

AVC-LongG uses MXF OP-1b

OP-1a uses simple interleaving of the data;

okay for broadcast, but not easy to search

or manipulate e.g. Jog, Slo-Mo, scrub etc.

OP-1a also requires the entire file to arrive

before it can be played.

OP-1b uses “chunking” where the A/V data

is broken into 2 seconds “stand-alone”

chunks. Chunks can be played and processed

individually, audio is parsed in 2 sec chunks

also greatly easing head seeks / data buffering.

OP-1b can be played after just a few chunks

are cached.. Ideal for RT streaming!

Many P2 Partners are already committed to continue expanding support as Panasonic

introduces additional compression modes with AVC-ULTRA Many P2 Partners are already committed to continue expanding support as Panasonic

introduces additional compression modes with AVC-ULTRA

AVC-Ultra Partners: IBC 2013

1. 1.

2.

3. 3.

Import Plug-ins Export Plug-ins

Avid Media Composer

7.0.1 / 6.5.3

( Windows / OSX )

Off-line > On-line editing by Proxy 2.

P2 Plug-ins for Avid workflow

For digital cinema (native 4K) – 4,096 x 2,160 pixels, 17:9

For TV broadcasting (QFHD) – 3,840 x 2,160 pixels, 16:9

Compared to Full HD – 1,920 x 1,080 pixels

4096 (Cinema)

3840 (TV broadcasting)

Full HD

1920 x 1080

2160

What about 4K?

What we should be asking ourselves

Does 4K even need to get into the home to be a factor?

Is 4K a “raster size” a new format or a chance to brake the rigidity of current

live broadcast formats?

Where is video technology growing?

How can we use 4K technology today?

What is stopping 4K from moving to live production?

Why Does 4K Matter?

Codec Resolution Frame rate Colour sample Bit depth Intra/Long

4096 x 2160 24p

to

60p

4:4:4 12bit Intra

4096 x 2160

3840 x 2160 4:2:2 10bit

Intra

Higher picture quality

for creative work for production

4Kx2K & 1080p50/60 | Class4:4:4, Class200

Low data rate with high picture quality

for cost effective workflow

LongG50 | LongG25

Extremely low data

for network based workflow

LongG12 | LongG6

Class

100,50

THANK YOU

Michael Bergeron

[email protected]

AVC-ULTRA Resources

www.panasonic.com/broadcast

1/3” Shoulder / Hand

AG-HPX255

9,600lm

P2 HD Camcorders, Recorders, Workflow Recorders / Workflow 2/3” Shoulder

Ak-HRP200

AJ-PX5000

AJ-HPX3100

AG-HPX600

AG-HPX250

AG-HPX370 AG-HPD24

Ak-HRP200 AJ-PD500

AW-RP50

Ak-HRP200

Micro / Full size P2

Ak-HRP200 AG-AC90

AW-RP50 Streaming / workflow

AG-HMR10 / HCK10

Cards / Readers

AJ-PX270P P2 Hand-held Camcorder

Current P2 formats (AVC-Intra 100/50, DVCPRO-

HD/50/25)

AVC-ULTRA Long G

FTP and Dual/Simultaneous codec

Optional 3G/4G capability

1080/60p / VFR

HD-SDI, HDMI, TC, Sync, Audio

Next generation, quieter, more sensitive 1080p 60

3MOS imagers

Shipping in March 2013 @ est $6,500

AJ-PX270 Overview

Micro & Full-size P2 slots

Superb Image Quality in ALL formats;

SD, HD**, even Proxy. (**inc 1080p 60)

Enjoy efficiency and quality.

Simultaneous HD and Proxy!

Wireless control, Proxy, Streaming, and

metadata workflows.

Wireless / LAN IP connectivity.

For News, Production, Sports…

The AVC-Ultra handheld with big 2/3” broadcast camera DNA

AJ-PX5000 - First Native AVC-ULTRA Camcorder

Master-quality and/or low-bit-rate 10-bit,

4:2:2 recording in Full HD

Records in AVC-LongG and AVC-

Intra100/50 as standard

2/3-inch, 2.2M 3-MOS sensors

Full-resolution, 10-bit 1080/60p (in AVC-

Intra100)

Optional Class200 (Feb. 2014)

Two microP2 cards slots, two P2 card slots

Shipping: $25,000 SLP

NEW!

Network, Major Sports, Archive Masters, Cinema (2nd unit / action)

AJ-PD500 Recorder

MicroP2 half-rack recorder with AVC-Ultra recording

Recording in AVC-LongG and AVC-Proxy as standard

AVC-LongG50 (10-bit, 4:2:2) and AVC-LongG25 (4:2:2,

10-bit) recording included.

Full-resolution, 10-bit 1080/60p in AVC-Intra100

Optional AVC-Intra200 and AVCHD playback

Great for rental and staging playback

Shipping: $14,000 SLP

NEW!

VariCam 3

Master-quality and/or low-bit-rate 10-bit, 4:2:2

recording in Full HD

2/3-inch, 2.2M 3-MOS sensors

B4 lens mount enables use of native format prime

lenses and servo zooms

Exceptional Color Quality

Two microP2 cards slots, two P2 card slots

4:4:4 12-bit

High Frame rates (Class100 up to 120p)

Available in 2014

VariCam 4K


Recommended