TV Pl at f or m Di v. , Sony Vi sual Pr oduct sToshi Ogur aJ ul y/ 16/ ' 14

HDR proposal

now HDR

Temporal resolutionDepth resolution

8K

4K

SD

QVGA240p

120p60i

30p

OLED

LCD

HDRBT.2020

DCI

12bit6bit

Spatial resolution

Lumi Dy-Range Color Dy-Range

2K

60p

LCD w/ LDsRGB

8bit10bit

FY11

Beyond UHD

UHD and mor e

Re al wor l d br i ght ne s s ( Dol by mat e r i al )

4

Real world brightness range is

quite large

Lu

min

ance

Lev

els

Real World

[cd

/m2

]

109

108

106

104

102

100

10-2

10-4

10-6

Sun light

Sun Direct

Indoor light

Moon light

Star light

Human Vision

Nig

ht

Vis

ion

Da

y V

isio

n

Typ

ica

l Ra

nge

w/o

ad

just

me

nt ~1

05

Current LCD Future TV

Vi s i on Dynami c Range

~1

03

~10

14

Cur r e nt s t andar d vi de o t r ans mi s s i on

6

3 digits

signal(8bit)

5 digits

Camera

Production(16bit,linear)

limitation: 8bits, 100cd/m2max

3 digits

LCD

Lossycompression

100 100

Resemblanceexpansion

信信信信信信

信信信si

gnal

leve

l

Real world real world

信信信信信信信信

disp

lay

brig

htne

ss

Production Transmission Displying

5 digits

LCD(LD),OLED

Current standard• production 信 5 digits• transmission 信 3 digits• displaying LCD 信 3 digits OLED, LCD(LD): 5 digits

↓

transmission is a bottleneck and information lost

created image transmitted as it is

HDR vi de o t r ans mi s s i on

7

5 digits

signal(10~12 bit,

nonLinear)

datacompression

displaymapping

5 digits

Camera

Production(16bit, linear)

X000

信信信信信信

信信

sign

al le

vel

real world X000real world

disp

lay

brig

htn

ess

production transmission displaying

5 digits

HDRdisp.

HDR standard• production 信 5 digits• transmission 信 5 digits

more• displaying HDR disp. 信 5 digits

↓

by HDR, created image can be

reproduced as it is

HDRと と と と と と と Wha t i s HDR 信 I t ' s a dva nt a ge

8

Panelluminance

Signallevel

100

500cd/ 信

Original Sourcecd/ 信

n-bit

Panelluminance

Signallevel

100

3000cd/ 信

Original Sourcecd/ 信

8bit

Bit 信 (n) 信信信信信信信信Banding 信信信信信信信信

ToneCurve

HDR, High Brightness DisplayLDR (current)

Source example( ととととととと )

信信信信信信信信信信信信信信信信信信信信信信信信信信信信信

信信信信信信信信信信信信信信信信信信信信

信信信信信信信信信信信信信信信信信信信信信信信

LDR, High Brightness Display

Panelluminance

Signallevel

100

Original Sourcecd/ 信

信信信信信信信信信信信信信信信信信信信

3000cd/ 信

8bit

HDR 信信信信信信 Display 信信信信信信信信信Combination of HDR video and high brightness disp.

Col or Vol ume c ompar i z on <BT. 2020 v. s . BT. 709>

9

BT.2020(10,000cd/m2) & BT.709(100cd/m2); Yxy

Wider gamut and higher brightness brings much more number of the colors

と Reproducing the glitter of light and color

BT.2020

BT.709

from Dolby material (light blue area can not be expressed by BT.709)

HDR wor kf l ow

HDR wor kf l ow

2014/1/2013

Creation Distribution Consumption

HDR

HDR

HDR

HDR

HDR

HDR

14Tech. Strategy Dept.

Capturing/Editing video mastering Transmitting Decoding Displaying

NativeContents

RawData

HDR s ol ut i on c andi dat e

HDR Video

LDRVideo

HDR Video

LDRVideo

EOTFHDR

HDR

LDREOTFgamma

HDR master

GameGFX

LinearHDR

LinearLDR

Panelcorrection

Panelcorrection

OETFHDR

OETFgamma

Enc DecFilmscan

Stillimage

Edit

CGComp

BroadcastIP delivery

Physical media(BD, DVD, memory)

Capturing/Post-production Transmission Displaying

Transmission Technology

Optical Electrical Transfer Function

Display Mapping

Technology

High Contrast Display

Technology

HDR Shooting Technology, HDR editing environment

15Tech. Strategy Dept.

Capturing/Editing video mastering Transmitting Decoding Displaying

NativeContents

RawData

HDR s ol ut i on c andi dat e

HDR Video

LDRVideo

HDR Video

LDRVideo

EOTFHDR

HDR

LDREOTFgamma

HDR master

GameGFX

LinearHDR

LinearLDR

Panelcorrection

Panelcorrection

OETFHDR

OETFgamma

Enc DecFilmscan

Stillimage

Edit

CGComp

BroadcastIP delivery

Physical media(BD, DVD, memory)

Capturing/Post-production Transmission Displaying

It is important to keep the environment for• individual technology evolution for each stage among the

workflow• individual selection of the video format: HDR, WCG,

Quantization number, spatial resolution

Transmission Technology

Optical Electrical Transfer Function

Display Mapping

Technology

High Contrast Display

Technology

HDR Shooting Technology, HDR editing environment

17Tech. Strategy Dept.

Capturing/Editing video mastering Transmitting Decoding Displaying

NativeContents

RawData

HDR s ol ut i on c andi dat e <Dol by Vi s i on>

HDR Video

LDRVideo

HDR Video

LDRVideo

EOTFHDR

HDR

LDREOTFgamma

HDR master

GameGFX

LinearHDR

LinearLDR

Panelcorrection

Panelcorrection

OETFHDR

OETFgamma

Enc DecFilmscan

Stillimage

Edit

CGComp

BroadcastIP delivery

Physical media(BD, DVD, memory)

Capturing/Post-production Transmission Displaying

Capturing• HDR cameraEditing• Dolby plug-in tool• HDR monitor

OETF• Barten model Dolby PQ curve Philips EOTF• Gamma base BBC curve BT.2020/BT.709

Transmission• Separate stream HDR/LDR• Scalable codec Dolby Layered MPEG SHVC• Compatible stream BBC Philips Technicolor

Signal Processing• Linear space convert Dolby PQ EOTF• Display mapping HDR, WCG

HDR panel• High brightness High power LED XDR• Local dimming # of division LD algorithm XDR• Dolby Monitor

18Tech. Strategy Dept.

Capturing/Editing video mastering Transmitting Decoding Displaying

NativeContents

RawData

HDR s ol ut i on c andi dat e <c ol l abor at i ve s ugge s t i on>

HDR Video

LDRVideo

HDR Video

LDRVideo

EOTFHDR

HDR

LDREOTFgamma

HDR master

GameGFX

LinearHDR

LinearLDR

Panelcorrection

Panelcorrection

OETFHDR

OETFgamma

Enc DecFilmscan

Stillimage

Edit

CGComp

BroadcastIP delivery

Physical media(BD, DVD, memory)

Capturing/Post-production Transmission Displaying

Capturing• HDR camera (Sony)Editing• plug-in tool (Technicolor)• HDR monitor (SIM2, XDR)

OETF• Barten model Dolby PQ curve Philips EOTF• Gamma base BBC curve BT.2020/BT.709

Transmission• Separate stream (MPEG regular) HDR/LDR• Scalable codec Dolby Layered MPEG SHVC• Compatible stream BBC Philips Technicolor

Signal Processing• Linear space convert EOTF (according to OETF)• Display mapping HDR, WCG (disp. manufac.)

HDR panel• High brightness High power LED (Toshiba) XDR (Sony)• Local dimming # of division LD algorithm (Toshiba) XDR (Sony)

Sony s ugge s t i on f or HDR

Sony s ugge s t i on: ope n s t andar d s ys t e m

EOTF と Bar t e n mode l ( Dol by PQ, Phi l i ps EOTF unde r di s c us s i on)

or BBC EOTF ( unde r di s c us s i on @I TU)

• c r e a t or ' s c hoi c e

• me t a : ma s . br i ght ne s s , r e f e r e nc e whi t e , … ( unde r di s c us s i on)

Tr ans mi s s i on と Si ngl e l aye r ( r e gul ar s t r e am) と or SHVC

• f or c ur r e nt de c ode r : s i ngl e l a ye r ( s e pa r a t e s t r e a m f or HDR, LDR)

• SHVC<Sc a l a bl e HEVC> ( J ul / ' 14 s t a nda r di z e d @MPEG)

Re c e i ve r と ① Mul t i EOTF r e ady ②SHVC r e ady ( i f ne c e s s a r y)

• LDR EOTF ( ga mma ) , HDR EOTF ( Ba r t e n, BBC, e t c . )

• SHVC: whe n t r a ns mi s s i on s i de wi l l r e qui r e ( f or f ut ur e )

Col l abor at i ve Sugge s t i on f or HDR

20

Sony suggestion Dolby Vision

technology

EOTF multi EOTF(Barten family & Gamma family) PQ curve (Barten family)

max L variable (operational rule) 10,000cd/m^2

codec Single layer: AVC, HEVC Multi layer: SHVC(future)

Dolby Layered coding(proprietary)

Disp. mapping

meta data base & signal analysis base meta data base

meta data 3 levels: Mandatory/Standard/Expert proprietary

Band width

HDR only same as regular stream LDR+10~20%

HDR & LDR double or LDR+XX%(SHVC/RExt) LDR+10~20%

additional hardware

decoder: noEOTF: <multi> programmablenonLinear-Linear: yes (no w/ simple solution)

decoder: additional composer, meta extractorEOTF: <Dual> PQ, gamma(for LDR)nonLinear-Linear: yes

Sony s ugge s t i on vs Dol by Vi s i on

21TVPF Div.

Sony s ugge s t i on f or me t a

Eac h c ompany has t he i r own opi ni on about HDR

• movi e s t udi o: r i c h me t a ( but not one opi ni on)

• BBC- R&D: f e a r i ng mi s s i ng me t a s ome whe r e t r a ns mi s s i on s t a ge

• HDR f or ma t pr opos e r s : me t a br i ngs a dva nt a ge of t he i r s ugge s t i on

• SMPTE, MPEG信 me t a s houl d be s t a nda r di z e d

Sys t e m t o i nc l ude al l of t hos e r e que s t s

⇒ I nt r oduc i ng ' Le ve l ' of me t a

Le ve l - 1: ma nda t or y ( mi ni mum i nf or ma t i on t o ha ndl e HDR s i gna l )

Le ve l - 2: s t a nda r d ( s t a t i c i nf or ma t i on of c ont e nt i t s e l f )

Le ve l - 3: e xpe r t ( dyna mi c i nf o. of c ont e nt , va l ua bl e i nf o. f or di s pl a y ma ppi ng, …e t c . )

• Above i nf or ma t i on s houl d r e pr e s e nt c ol or vol ume , whi c h i nc l ude s l umi na nc e a nd c ol or i nf or ma t ion.

• Hi ghe r l e ve l i nc l ude s mor e opt i ona l i t e ms t o a ppl y ma ny i de a by pr opos e r s .

HDR me t a dat a

22TVPF Div.

HDR me t a dat a

Le ve l de f i ni t i on

LEVEL信 信 Mandat or y• s t at i c me t a f or c ol or gamut and EOTF ( ut i l i z i ng c ur r e nt s t a nda r d f or ma t )

• VUI : c ol or pr i ma r i e s , ma t r i x_c oe f f s , t r a ns f e r _c ha r a c t e r i c s

• c ol or pr i ma r i e s : BT2020 i s a va i l a bl e a t bot h AVC a nd HEVC

• EOTF: PQ i s a va i l a bl e a t HEVC onl y

LEVEL信 信 St andar d• St at i c me t a at mas t e r i ng ( ne w a ppl i c a t i on)

• VUI , Mas t e r i ng di s pl ay c ol or vol ume SEI : Col or s pa c e , mi n/ ma x l umi na nc e

• SEI i s a va i l a bl e a t HEVC onl y

LEVEL信 信 Expe r t• Dynami c me t a f or e ac h uni t , s c e ne or f r ame ( ne w a ppl i c a t i on)

• VUI , Kne e f unc t i on i nf or mat i on SEI と

• Lumi na nc e f or e a c h Sc e ne / f r a me ( Pe a k l umi na nc e ) , . . .

2014/6/2723

HDR Col l abor at i on

HDR wor kf l ow

2014/1/2025

Creation Distribution Consumption

HDR

HDR

HDR

HDR

HDR

HDR

Sc ope

• Te c hnol ogy, St a nda r di z a t i on, Ope r a t i ona l s pe c , I nt e r ope r a bi l i t y

Pur pos e

• Bui l di ng e nt i r e wor kf l ow f or HDR

• Gua r a nt e e qua l i t y of ' HDR'

• Coope r a t i ng pr omot i on

• Common l ogo

Subj e c t s

• Cr e a t i on, Tr a ns mi s s i on, Di s pl a yi ng

• Equi pme nt , Cont e nt , Se r vi c e , . . .

HDR Col l abor at i on

26PTAS Div. / PTS Dept.

HDR s hoot i ng

Cont r as t pe r f or manc e

• ne e d e nough c ont r a s t f or huma n vi s i on s ys t e m

• ( s ugge s t i on) i ma ge c a n de s c r i be mor e t ha n 400% wi t h e nough ba ndi ng pe r for ma nc e

• ne e d t he ba c kgr ound of 400%, how t o e va l ua t e ba ndi ng pe r f or ma nc e

Tr ans mi s s i on pe r f or manc e

• ne e d t o t r a ns mi t e nough s i z e c ol or vol ume wi t h ne c e s s a r y i nf or ma t i on

• ( s ugge s t i on) mor e t ha n 10bi t , wi de r c ol or ga mut t ha n BT. 709, c ol or vol ume me t a i nf or ma t i on

HDR s pe c i f i c at i on ( 1) ( dr a f t )

27PTAS Div. / PTS Dept.

HDR t r ans mi s s i on

s i gnal f or mat r e qui r e me nt

• ne e d t o ha ve e nough c a pa c i t y a nd me t a da t a c a pa bi l i t y t o t r a ns mi t HDR vi de o

• ( s ugge s t i on) mor e t ha n 10bi t , mor e t ha n 400% l umi na nc e i nf or ma t i on, l a r ge r c ol or ga mut t ha n BT. 709, HDR me t a

HDR me t a r e qui r e me nt

• ne e d t o r e pr oduc e HDR/ WCG c ol or vol ume c or r e c t l y

• 3 l e ve l me t a

• ma nda t or y me t a

• s t a nda r d me t a

• e xpe r t me t a

• me t a mi ght be u t i l i z e d not onl y ne w HDR di s pl a y, e ve n c ur r e nt d i s pl a y t oo

• ne e d t o ke e p me t a da t a dur i ng t r a ns mi s s i on

HDR s pe c i f i c at i on ( 2) ( dr a f t )

28PTAS Div. / PTS Dept.

HDR di s pl ay

Br i ght ne s s pe r f or manc e

• ne e d t o ma ke pe opl e f e e l da z z l e d

• ( s ugge s t i on) 700c d/ m2 mor e w/ a r ul e f or a r e a

• ne e d da t a of c ur r e nt s t a t us

Cont r as t pe r f or manc e

• 信 信 信 信 dyna mi c r a nge 信 信 信 信 信 信 信 信 信 信 信 信 信 信

• ( s ugge s t i on) 105 mor e ( e . g. 0 . 01~1000c d/ m2) w/ c l a r i f i e d me a s ur e me nt me t hod

• ne e d da t a of c ur r e nt s t a t us

Bandi ng pe r f or manc e

• ne e d t o a voi d pe opl e s e e i ng ba ndi ng e a s i l y

• ( s ugge s t i on) Col or di f f e r e nc e l e s s t ha n 4dE00 ← de t a i l e d i nve s t i ga t i on i s ne c e s s a r y

• how t o ha ndl e d i t he r i ng f unc t i on, wha t ' s ki nd of e va l ua t i on e nvi r onme nt ?

HDR s pe c i f i c at i on ( 3) ( dr a f t )

29PTAS Div. / PTS Dept.

SONY is a registered trademark of Sony Corporation.

Names of Sony products and services are the registered trademarks and/or trademarks of Sony Corporation or its Group companies.

Other company names and product names are registered trademarks and/or trademarks of the respective companies.