230 File Based World Paulsen BO1 Final

8/6/2019 230 File Based World Paulsen BO1 Final

1/43

The

NEXT GENERATIONof

DIGITAL MEDIA WORKFLOW

Evolution to aEvolution to aFileFile--onlyonly

InfrastructureInfrastructure


2/43

Session Topics

What happens when they are only files?

aka when baseband is no more

Quality Control in a File-based domain

Automated Test & Measurement

How the Network is ImpactedProvisioning and efficiency for content migration

Content delivery networks - internal & long distance

exchange Planning, Processes and Procedures

Expectations, shortfalls, handling upgrades


3/43

The Demise Of Baseband

Inevitable reduction of baseband implementations

Retained for live productionNLE is moving away from exclusive real time ingest

Baseband costs increase to maintain the status quo

Non-real time media exchange expands

Faster or slower depending upon immediacy of content

Scalable with the network bandwidth/speed

Ideal for compressed video and file based platforms

Baseband unnecessary for delivery going forward

Pre-packaged formats (already in cable & satellite)

Platform Interchange (direct to air and for transport)


4/43

The Value of Working with Files

Platforms offer unconstrained flexibility

Content is readily repurposed The transport of content is unbound

network based vs. point-to-point physical

Replaces aging analog and digital lineal tapefiles are more durable and extensible

promotes independence from fixed media formats

Costs for file only implementations will decrease


5/43

Uses & Expectations

File-based platforms will

support the NextGen Digital Media domainaddress ATSCs evolving standards (i.e., A/101

interactive, A/72 AVC, NRT protocols, ATSC 2.0)

new mobile applications (A/153 ATSC-M/H)future delivery diversification (VoD, Web)

Preservation of legacy content and fixed media

archive content onceclean up analog formats correctly, once and for all

preserves digital content completely


6/43

File-based Frameworks

Promote integration through a layered architecture

Acquisition, storage, manipulation, and deliveryprocesses

Achieves flexibility by loosely couplingthe infrastructure

to the applications Force structurefor

media asset management

focused work centers, content sharing, collaborationcapabilities that aid in developing or repurposing content


7/43

File-based Frameworks

Provide consistency in workflow

broadcast operations will still use several workflowflavors

applications are extended to work area needs

from acquisition through content preparationthen to playout and on to archive


8/43

Legacy Hybrid WorkflowARCHIVE

Limited FormatsRigid work structure labor intensiveGeneration lossesExcessive Q/ASecondary Information/Metadata manual


9/43

The New Digital Media Workflow (DMW)

GIGABIT NETWORK

FILE BASEDPROCESSING

PLAY TO AIR

POSTPRODUCTION

NEW MEDIADISTRIBUTION

QAMEDIA

MANAGEMENTARCHIVE

ACQUISITION & INGEST

VIDEO

VIDEO


10/43

Enabling a Comprehensive

File-based Environment

Decisions and Policies must be established:

Compression types and formats Coding types and bit rates for levels of quality

Acquisition media (SSM, optical disc, HDD)

Intra-facility interchange formats

Archive methods (near-, short- and long-term)

Disaster recovery mechanism and platform Edit decision making (proxy vs. low-bandwidth)

Monitoring and quality assurance


11/43

When There Are Only Files

Many Work Tasks can be Automated

ingest, quality control, security, backup

Personnel diversification is improved

Baseband house formats can be relaxed Platform interchanges gain flexibility

however, not necessarily simpler or more achievable

Quality control becomes essential!


12/43

Part II

Quality Control in a File Domain


13/43

Touch Points for QC/Test & Monitoring

POINTS OF QC ANALYSIS

MediaTypes

AnalogVideo

Sources

DigitalVideo

Sources

VideoFormats

ANALOG(NTSC, PAL)

SD, HD(720p, 1080i,

1080p)

CIF, QCIF

(Internet, Mobile)

Other(resolutions,frame rates,aspect ratio,

formats)

VIDEO CODECSMPEG2, H.264, AVC-

INTRA, JPEG, JPEG2K,MPEG2 Pt-2, VC-1, VC-3

VIDEO CODECSMPEG2, H.264, AVC-

INTRA, JPEG, JPEG2K,MPEG2 Pt-2, VC-1, VC-3

FILE FORMATS

MPEG-2(TS, PS, PES)

ASF, QTGXF, MXF3GPP, DV

FILE FORMATS

MPEG-2(TS, PS, PES)

ASF, QTGXF, MXF3GPP, DV

BROA

DCAS

T

DELIV

ERY

ALTERNATIVEMEDI

A

AUDIO CODECS

AACE-AC-3, AC-3

DOLBY-E

WMP3WMALayer ILayer II

AUDIO CODECS

AACE-AC-3, AC-3

DOLBY-E

WMP3WMALayer ILayer II1 2 4


14/43

Automating File-based QC


15/43

What Operators Wont See or Hear

Content can be irreparably damaged very early ondangers of image impairment are camouflaged

with no way to recover from many errors

and while it may lookgood, it is still no good Errors created in the encoding process

may be passed through or masked by a good decoder

may still crash a home STB decoderhard to spot missing I-frames, corrupted syntax, levels of macro-

blocking, improper motion vectors, etc

Audio that sounds good, but has:

out-of-phase, channel swapped or lost due

channels missing, wrong dial_norm or DRC

compressed audio but metadata parameters are corrupted


16/43

Audio/Visual Impairments

Encoding quality errors

blockiness, improper motion-vector, misorderingmissing or other improper audio metadata

Timing and segmenting

mistiming, truncation, extension of heads/tailscommercial insertion triggering errors, splicing errors

Format errors or missing information

PAL instead of NTSC, progressive instead of interlace

line standard or framing incorrect


17/43

Non-Audio/Visual Impairments

Multiplexing Errors

Missing data (closed captions, ratings)

Metadata errors

DRM, MXF, BXF (automation/traffic)

Industry interchange specificationsImproper CableLabs compliance

Incorrect MPEG syntax (in ES or PS)

PIDs, PATs, PMTs, PCRs


18/43

Traditional Content Work Flow for QC

INGEST PROCESSESMultiple

ContentProviders

or SourcesManual

QCChecks

QC Script

Transcoding

WrappingTrimming

(Tops & Tails)SegmentingVersioning

Transfer

toServer

-----------Playout

Ready

CONTENT

REJECTED


19/43

Improved Content Quality Assurance

ContentProviders

or Sources

AutomatedQC

PluggedInto Existing

Workflow

Content Meets Rules

TranscodingWrappingCataloging

SegmentingAdd Graphics

Transferto

Server

-----------PlayoutReady

FILES

CONTENT

REJECTED

AutomatedQC Checks

LinearPrograms

LINEAR VIDEO

Automated

QC

IRD


20/43

Corrective Actions

Option-1

decode to baseband, correct with baseband

processing equipment, re-encode(most aesthetic correction or visual/aural discrepancies

must be fixed by humans)

Option-2fix the syntax, (meta)data insertion, or timing

adjust audio metadata or normalization

Option-3reject, then re-feed/re-order the content

abandon and substitute with evergreen material


21/43

New Tools for File Analysis Automated File Analysis

Tektronix Cerify

Interra Systems Baton

Videotek QuiC

MXF tools

Snell & Wilcox, MOG Solutions, Metaglue

Transport stream, MUX and Picture Quality checking

JDSU, Rohde & Schwartz, Tektronix, Triveni

Audio analysis, encoding and metadata correction

Dolby DP600

Delay and Lip Sync correction

disruptive vs. non-disruptive instruments


22/43

Tools Allow You to See & Solve

Video thumbnails and audiowaveform shown in frames

surrounding the alert

Details for each file

within the Job

Alerts for eacherror within the file

Test summary foreach file in Job

Courtesy Tektronix(AZCAR is a Cerify Developers Community member)

Errors in frame


23/43

File-based Augmentation Adding ancillary data (cc, ratings, or v-chip)

Adding logos or branding

Tagging of AdID, ISAN/V-ISAN or ISCI data Inserting playout descriptors

Active Format Description (AFD SMPTE 2016)

Certain traffic/automation tagging (BXF SMPTE 2021)

MXF versioning

Multi-language, video description, PG vs MA versions

Advanced Media Workflow Association (AMWA)Focus on high-level workflow for commercial, syndicated and long form programming

from creation through distribution and then broadcast.


24/43

Part III

Impacts on the Contribution Network


25/43

Managing Files Over Networks

Requires appropriate network provisioning

Scaling for growth

Internal or local storage managementMoving of very large file sizes (upwards of 50 GB)

Security

Handling of varying traffic volatility High Speed Interchange

Internally between work centers

Site-to-site and site-to-multisiteGeographic exchanges with products such as

Omneon ProCast CDN, Isilon, Aspera, Signiant


26/43

File Preparation & Processing

Preparation to prescribed formats

delivered to the facility read to go

Transcode farms

option to use COTS products vs. grow your own

license & per seat costs, interoperability, customization

Engines may be dedicated or integrated

server storage with application processing

integrated transcode clients

deeply tied with automation (extended with QC)

Transcoding vs. unwrapping/rewrappingprocessing times vary

blind transcoding may be ambiguous


27/43

Network Security and Resiliency

Secure file delivery

cryptography

SSL (Secure Sockets Layer)TLS (Transport Layer Security)

selectable payload encryption (AES 256/128/64)

certified delivery using Public Key Infrastructure Network resiliency using

file check-pointing (saving a program state)

firewall traversal


28/43

Operability

Employs industry-standard applications

watch folder based management and interchange

encoding, proxies, and metadata carriage

watermarking, transcoding, content playout or distribution

Simple Object Access Protocol (SOAP),

Service Oriented Architecture (SOA),

Web Services


29/43

Network Centric

Digital Media Distribution Policy based, Web-enabled network management

the network traffic control cop

uses business-based prioritization Tracking, scheduling, reporting and auditing

employs a dashboard view of system status

Controls data confidentiality and integrityCertifies delivery to resources and recipients

Denies unauthorized access

Template based execution of scheduled jobsusing data movement agents

with conformance to business policies

provides redundancy utilizing data differencing


30/43

Intelligent

Content Distribution Networks (CDN)

Intelligent Traffic Management(ITM) offers:

efficient network traffic & bandwidth utilization diversification of transcoding and rate shaping operations

rights management and security

platform extensions, adding diversity to operations automated re-transfer as a background task

ability to use content before FTP transfer is complete

controlled exchange of contentbetween workgroups and other sites


31/43

Media Dispatch Protocol

SMPTE EG 2032-4-2007

For the delivery of files over IP networks

Three parts to MDPprotocol specification (SMPTE 2032-1)mapping specification (SMPTE 2032-2 for MDP/XML/HTTP)

profile specification (SMPTE 2032-3 is the basic target pull profile)

Developed for MAN and WANsuitable for LAN

MDP is not

a transfer protocola file wrapper or container format (i.e., MXF, QuickTime, etc)

a metadata protocol


32/43

Media Dispatch Protocol

SMPTE EG 2032-4-2007

Courtesy of SMPTE


33/43

Content Management Architecture


34/43

Site-to-Site Distribution

File interchange for

collaborative production

content delivery (WIP, approvals or release)

disaster recovery site content population

Content is automatically distributed to destinations usingwatch folders

Nodes (agents) at each site ensure content is moved in themost efficient manner

Transfer scheduling employed to

manage the bandwidth of each individual transferprioritize jobs via rules-based transfers

increases network proficiency


35/43

Site-to-Multisite Distribution

Moves content efficiently between several geographicallydistributed global sites

provisioned on existing IP-networks as an overlay

uses a content-aware file delivery layer

Uses highly scalable enterprise-class platforms

Nodes easily added/removed at new locations

Unidirectional distribution

selects most appropriate route available

multi-cast enabled for satellite delivery

Managed from any location on the network

ensures universal management, monitoring and access


36/43

Part IV

Planning Considerations

for a File-based Infrastructure


37/43


38/43

Media Asset Management

The Key to Success is in a centralized MAM plan

essential element in automated file management Requires adopting new workflow principles

should adhere to open work flow standards

development of your ownservice oriented architecture (SOA)

Selecting the right MAM product

most products are still proprietaryusers often insist upon customizing workflows

costly, less friendly, often undesired by vendor


39/43

Process and Procedure Setting

Establish written policies, practices and procedures

Set acceptability thresholds

Utilize a reporting check list automate whenever possible

logging of errors, statistics, all corrective actions taken

Develop a backup plan with sufficient evergreen content

Prepare the system failover and failback

Adopt versioning management (use MXF)

Know how to find the files

Catalog with MAM, use check-in and check-out, etc

Rigidity with flexibility

Just in Time content delivery may not be practical


40/43

Impacts from System Upgrades

Upgrades will become a regular part of life

Make certain you perform regression testing Forward thinking needed for server growth

play to Air platform, disk expansion, VoD, archive

Understand that both file and system issues areaffected by

inter-departmental interchanges or workflow

platform obsolescence in work zones

the I need a better mousetrap proliferation


41/43

Shortfalls in Implementation Spotty or incomplete implementation

Deployed only a portion of the necessary tools

Insufficient training and exposure prior to launch

System was customized for todays thinkingsort out and remove unobtainable results

set aside misrepresentations and vaporware

Limited acceptance by the staffthe old ways never die, felt threatened, apprehensive

didnt want to become the guinea pig

Only a few understand or evangelized the long term,extensible value to the overall organizationinitial ROI didnt meet the accounting expectation


42/43

The Successful Implementation

Mitigates manual processes

Reduces time getting products to air

Minimizes errors improves flexibility

Creates the perfect paths for

archivingrepurposing/versioning of content

disaster recovery/asset protection

prevention of obsolescence

Complex at the start worth it in the end


43/43

Thank You

Karl Paulsen

Chief Technology Officer

AZCAR Technologies, Inc.

[email protected]

724-873-0800 ext 203
mailto:[email protected]:[email protected]

Date post:	07-Apr-2018
Category:	Documents
Upload:	chris-clark
View:	224 times
Download:	0 times

230 File Based World Paulsen BO1 Final

Documents