Introduc)on Technology Development Group
Who we are
• We are a group of technologists dedicated to providing enabling technology to help the divisions be more profitable.
• We are largely focused on produc)on and delivery: how we produce and master content, how and what we deliver to the consumer, and how we protect the assets.
• We work closely with the technical people in each division and with those in IT.
• Like IT, we are a corporate group.
2 9/15/14 Sony Pictures Confiden)al
Spencer Stephens Chief Technology Officer
Scot Barbour VP, Produc=on Technology
Tim Wright VP, Worldwide New Media and Technology
New Hire VP, Security and Media Technology
Andrew Livingston Manager, Digital Policy
Yoshikazu Takashima Exec Director Advanced Technology
Masaki Nakayama Execu=ve Director, Technology Opera=ons
Dawn Branch Administra=ve Assistant
Culver City London
9/15/14 Sony Pictures Confiden)al 3
Basics
4k or UHD
• Ultra High Defini)on (UHD) is 3840 x 2160 • UHD is being called 4k, 4k UHD, Ultra HD 4k, … • Digital cinema defini)on of 4k is 4096 x 2160
• SPE’s defini)on of 4k UHD content • Shot and mastered in 4k • Not up-‐scaled from lower resolu)on
• It’s the highest quality version of a movie or TV show • 4k movies & TV is shot on 35mm film and on new digital cinema cameras like the Sony F65
9/15/14 Sony Pictures Confiden)al 5
8’
26” Standard Def
> 7x SH
SH*
*Screen Height 9/15/14 Sony Pictures Confiden)al 6
8’
50” HD
> 3x SH < 7x SH
SH
9/15/14 Sony Pictures Confiden)al 7
8’
85” UHD
> 1.5x SH < 3x SH
SH
9/15/14 Sony Pictures Confiden)al 8
8k Quiz
1. What’s the ideal viewing distance for an 8k TV?
2. What size 8k would you want if your sofa is 8’ away from it?
0.75x Screen Height
260”, 1 9 feet wide
9/15/14 Sony Pictures Confiden)al 9
Increased spa)al resolu)on isn’t enough
• Picture specifica)ons for high def are based on CRT TV capabili)es • With 4k there is an opportunity to improve other picture parameters
• These new parameters can improve HD too but will need new players.
Parameter Comments
Larger color space (ITU-‐R Rec 2020 or XYZ) • Colors that cannot be reproduced on a CRT TV
High dynamic range (HDR) aka extended dynamic range (XDR)
• More details in the highlights, darker shadows. • Brighter screens for be_er color display • HD is 100 nits, new XDR TVs are 1,000 nits, studio target is
4,000 nits but there are power considera=ons.
10 or 12 bits color depth
• 8 bit used in HD can cause “contouring” of the image. (10 vs 12 bits s=ll being debated)
Higher frame rates
• 48 fps or 60 fps for high frame rate movies • 100 fps or 120 fps sports broadcast
9/15/14 Sony Pictures Confiden)al 10
Increased spa)al resolu)on isn’t enough
• Picture specifica)ons for high def are based on CRT TV capabili)es • With 4k there is an opportunity to improve other picture parameters
• These new parameters can improve HD too but will need new players.
Parameter Comments
Larger color space (ITU-‐R Rec 2020 or XYZ) • Colors that cannot be reproduced on a CRT TV
High dynamic range (HDR) aka extended dynamic range (XDR)
• More details in the highlights, darker shadows. • Brighter screens for be_er color display • HD is 100 nits, new XDR TVs are 1,000 nits, studio target is
4,000 nits but there are power considera=ons.
10 or 12 bits color depth
• 8 bit used in HD can cause “contouring” of the image. (10 vs 12 bits s=ll being debated)
Higher frame rates
• 48 fps or 60 fps for high frame rate movies • 100 fps or 120 fps sports broadcast
9/15/14 Sony Pictures Confiden)al 11
Not all 4k is created equal Sony F65 4096 green pixels 2048 red pixels 2048 blue pixels Red Epic 2560 green pixels 1280 red pixels 1280 blue pixels Sony F55 2048 green pixels 1024 red pixels 1024 blue pixels Arri Alexa 1440 green pixels 720 red pixels 720 blue pixels
Bayer pa_ern and CMOS sensors
8k pixels True 4k output
5.5k pixels 4k output
4k pixels 4k output
2.8k pixels 2.8k output
9/15/14 Sony Pictures Confiden)al 12
Acquiring 4k content – features and episodic Camera Type Maximum ResoluBon Comments In use? 4k? HDR?
35mm Film Scanned at 4k Most features and all episodic that are shot on film
Yes Yes Yes
65mm Film Scanned at 6k “Lawrence of Arabia” No Yes Yes
35mm CCD Digital Cinema Cameras
1920x1080 Sony F35, Genesis (2005) No No No
Arri Alexa 2880x1620 or 2880×2160 depending on format
CMOS RAW or ProRes Yes No Yes*
Red Epic & Dragon Up to 5.5k & 6k respec=vely CMOS RAW Yes Yes Yes*
Sony F55 4096x2160 CMOS RAW or XAVC Yes Yes Yes*
Sony F65 Normally 4096x2160, 8192x2160 possible
CMOS RAW Yes Yes Yes*
CGI effects Typically 2k Resolu=on is rendering cost issue. Yes Op=on Op=on
* These cameras are, in varying degrees, capable of HDR but produc=on decisions may mean footage isn’t HDR 9/15/14 Sony Pictures Confiden)al 13
Consumer Services
Delivering 4k to the consumer
• AVC encoded 4k is 2-‐3 )me larger than HD • Not 4 )mes larger
• 4k delivery becomes prac)cal with HEVC (H.265) codec • Perhaps 35-‐40% more efficient than AVC today • Hardware decoders in shipping devices
• Sony Pictures is requiring significantly stronger content protec)on for UHD/4k than for HD
9/15/14 Sony Pictures Confiden)al 15
Availability of 4k in the consumer market • Sony shipped server loaded with 11 4k movies with the 84” 4k TV in late 2012 • Sony 4k Video Unlimited service launched 1st September 2013 • Preload and download 4k movies and TV shows • Second gen 4k player and TVs have Nejlix 4k
• Nejlix started 4k streaming SPE content to Sony and Samsung TVs in June 2014 • Adap)ve streaming means instantaneous resolu)on may be less than 4k or content is spa)ally subsampled or heavily compressed
• A lot of interest by broadcasters in UHD • BSkyB and Sky D are shoo)ng football in UHD and with HDR • Korean broadcasters have linear UHD channels. • DirecTV will launch using RVU – 4k HEVC decode in TV, not in STB
9/15/14 Sony Pictures Confiden)al 16
TV series delivering to Nejlix in 4k
• Blacklist • Breaking Bad • Masters of Sex • House of Cards
9/15/14 Sony Pictures Confiden)al 17
Market Deployment Timeline
What we expected
1. Physical media 2. Download 3. Streaming 4. Linear
What’s happening
1. Sony pre-‐loaded players 2. Streaming 3. Linear 4. Download 5. Physical media
9/15/14 Sony Pictures Confiden)al 18
Enhanced Content Protec)on
Star)ng Point
• No content protec)on system is impenetrable, but the system has to be hard to crack. • You just got hacked, what are you going to do? • Rapidly re-‐secure the content protec)on • Contain the breach to a single )tle/copy
• Learn from the Condi)on Access (CAS) industry for cable, satellite, etc. • Security system providers whose reputa)on is at stake • Both a technology and a service • Sopware running in Trusted Execu)on Environments • Rapid proac)ve and reac)ve renewability • Breach and hacker monitoring
• What are people trying to hack the system working on?
9/15/14 Sony Pictures Confiden)al 20
SPE Requirements for 4k/UHD Content
• HDCP 2.2 output protec)on • No other digital outputs currently offer appropriate security
• On line authen)ca)on • Check for current content protec)on version • Prevent pre-‐street date piracy
• Title diversity • When one )tle/copy is compromised, incremental hacking is required to compromise the next )tle
• Decode in trusted execu)on environment (TEE) with hardware protected video path. • Forensic watermarking iden)fying player model/version • Content protec)on technology/implementa)on from expert companies with appropriate prac)cal experience
9/15/14 Sony Pictures Confiden)al 21
SPE Requirements for 4k/UHD Content
• HDCP 2.2 output protec)on • No other digital outputs currently offer appropriate security
• On line authen)ca)on • Check for current content protec)on version • Prevent pre-‐street date piracy
• Title diversity • When one )tle/copy is compromised, incremental hacking is required to compromise the next )tle
• Decode in trusted execu)on environment (TEE) with hardware protected video path. • Forensic watermarking iden)fying player model/version • Content protec)on technology/implementa)on from expert companies with appropriate prac)cal experience
*This not a complete list
Challenging for linear -‐ use return path through TVs Internet connec=on
Requirement for off-‐line playback
State of the art in new devices
TV makers have rapidly realized this is a necessity
9/15/14 Sony Pictures Confiden)al 22
Thank You Spencer Stephens
Movielabs specifica=ons for next genera=on video: h_p://movielabs.com/ngvideo/index.html