Contact

Name: Dominique Grillet

Company: AMP Visual TV

E-Mail: dominique.grillet@ampvisualtv.tv

Phone: +33 (0)608 669 371

4K ultraHD TV wireless REmote

PROduction SYStems

Project Consortium AMP VISUAL TV (ATLANTIC MEDIA), France

Worldlinx, Belgium

Siru Innovations, Finland

Supponor, Finland

Tampere University of Technology (TUT), Finland

INSA de Rennes (IETR), France

Kalray, France

NULINK, Switzerland

European Broadcasting Union (EBU) / Eurovision, Switzerland

Ecole Polytechnique Fédérale Lausanne (EPFL), Switzerland

Indoor Studio Production

Remote Production

Outdoor Mobile Production

Venue

Studio

Control

STADIUM AUSTRALIA

Virtual Advertising

Original Region B

Region C Region A

Use Cases

Olympics

Football

Ice Hockey

Formula 1

Target Events

Primary Goals 1) Minimize the setup costs in 4K TV production From indoor studio to outdoor large-scale events

Logistics on site replaced with remote TV studio

2) Improve 4K TV delivery chain Seamless path through wireless & wired components

Content protection included

3) Improve visual experience High-quality 4K TV with added services

Personalized billboard advertising for live events

Viewer immersion with numerous mobile cameras

Business Impact • 73 member broadcasters of EBU can profit from End-to-end 4K TV chain on EBU’s worldwide network

Added value TV services

• Powering TV production with European technology Improves competitiveness of European companies

Facilitates entering overseas markets

• 4KREPROSYS project paves the way for European Digital Agenda for Connected Continent

Digital European Leadership in TV sector

Core Technologies

Technology Purpose

High Efficiency Video Coding (HEVC) 2X compression efficiency over prior-art

Efficient HEVC video codecs Ultra-low end-to-end delay in processing

Software-defined radios (SDR) Congestion-free wireless video transfers

IP network technologies “All -IP” principle for TV content & services

Content protection mechanisms Privacy and anti-piracy

Advertisement insertion technologies Virtual advertising

Automatic antenna tracking Better Quality of Service (QoS)

Demo

CASE A:

Wired 4K Video

CASE B:

Wireless HD Video

Sony FDR

X1000v

4K Action Cam

GoPro HERO4

HD Action Cam

HDMI

RGB

HDMI

RGB

Epiphan

Av.io 4K

Capture Card

2160p

@30fps

MPEG-TS

MPC-HC Player

&

HEVC Decoder

AVerMedia

ExtremeCap

U3

1080p

@25fps

Tx

Rx

YUV

HEVC

MPEG-TS

MPEG-TS

MPC-HC Player

&

OpenHEVC

Decoder

Kvazaar Visualizer

Selective Encryption

YUV

HEVC

with Decryption without Decryption

Development Goals 1.Coding efficiency close to HEVC reference encoder

2.Portability to various platforms (CPU/GPU/ASIC/FPGA)

3.Real-time coding speed

4.Low-cost implementation

5.Well-documented source code

Impact Portable code customizable to application-specific needs

Product-friendly LGPL2 licensing

Potential applications: virtual advertising, 4K TV

production, VoD, video conferencing, video surveillance,...

Can be used through FFmpeg and LibAv

Part of teaching at Tampere University of Technology

Excellent framework for new joint research projects

Performance 1080p@30fps on Core i7 3.4 GHz 4-core processor

1080p@60fps on Core i7 3.0 GHz 8-core processor

2160p@60fps on Xeon 2.2 GHz 22-core processor

#1 open-source academic HEVC encoder

Features Profile Main, Main Still Picture, Main 10

Internal Bit Depth 8 (10 if enabled when compiling)

Color Format 4:2:0, 4:0:0

Coding Modes Intra, Inter, Skip, Merge

Slice Types I, P, B

Configurations AI, RA, LP

Coding Blocks 64×64, 32×32, 16×16, 8×8

Intra Modes DC, Planar, 33 Angular

Intra Blocks 32×32, 16×16, 8×8, 4×4

Inter Blocks 64×64, 32×32, 16×16, 8×8, AMP, SMP

Transform Blocks 32×32, 16×16, 8×8, 4×4

Transform Split Inter (64×64 only), Intra

Parallelization Tiles, Wavefront, Picture-Level

Rate Control Single-Pass

SIMD Acceleration AVX2

Kvazaar Visualizer Visualizes coding decisions, allows real-time debugging

Available in a separate branch on Github

Kvazaar Digest Main developer: Tampere University of Technology

Source code: github.com/ultravideo

License: GNU LGPLv2.1

Language: C, ASM

Lines of code: 25 k

Contributors: 17

OS: Windows, Linux, Mac

Processors: x86, x64, PowerPC, ARM

Compatibility: FFmpeg, Libav

Presets: 10 (placebo … ultrafast)

Award Winner 2016

WIRELESS VIDEO LINK WITH SIRU4K WAVEFORM

The ultimate goal:

- 4K video compatible wireless

radio link

- FPGA-based standalone

Software Defined Radios

- Low power consumption,

enabling mobile transmissions

- On board video codec on both

ends (receive and transmit)

Siru Innovations Oy is a Finnish high-tech company, established at the

beginning of 2011. Siru Innovations develops its own Graphics IP,

Software Defined Radio and Industrial Touch Screen User Interfaces

and also provides professional services in the industry. At Siru

Innovations, our team has an average of more than 15 years of

experience in commercial FPGA/ASIC/electronics development.

Achievements:

- HD video link using two Siru

Innovation’s SDR20 transceivers

- The LTE-based waveform

developed and tested in software

mode

- First version of the final waveform

is synthesized to the FPGA and now

being tested

Siru Innovation’s SDR20 Software Defined Radio which is

being used as a base for the waveform development.

www.siru.fi

REMOTE Media Control Room

LOCAL STADIUM

FIBER

Sup

po

no

r A

R S

ign

age

Rep

lace

men

t A

reas

Supponor AR Signage Replacement Areas

Sup

po

no

r A

R S

ign

age

Rep

lace

men

t A

reas

REMOTE PRODUCTION

Supponor Closeup camera data

Supponor Main camera data

Main Closeup

Cameras with Supponor AR Optics

Remote Production for Virtualised Advertising

Replacement

Supponor has performed numerous successful remote

production and virtual advertising replacement tests at

Watford FC in the English Premier League during Season

2016-2017.

These remote production tests involve Supponor's digital advertising

replacement technology being used to replace the animated LED

signage on local in stadium perimeter boards with targeted virtual

advertising for broadcast to multiple regions as part of the live television

production.

Only the augmented camera setup is located at the venue

while all the signal processing and computation needed for

the digital advertising replacement happens in the Master

Control Room located in Preston, UK.

Modified outputs:

4 x 1080i50 SDI with different

virtual advertisements

Cameras: Sony HDC 1500

Lenses: Canon HJ22, Canon XJ86