ML/AI based Applications-driving demand

Manish Sharma

Director, R&D Strategy

Samsung R&D Institute, India

Introduction

• Example AI-based applications• Voice Intelligence (AI speakers and Voice assistants)

• Vision Intelligence

• Streamed services in Broadcast Networks

• Conclusions• Role of Data and the Network

• Interoperability and Standards

Voice Intelligence

3

Current screen

USER’s SAY

Get relevant response based on Context

Voice Intelligence Goal

4

Understand conversational speech, dialogue naturally, answer questions correctly, and providemulti-lingual interpretation/translation like a human

Communicate with user through multi-modal interfaces and understand dynamic environment

Always Helpful & Always Learning

Voice Intelligence

Voice Recognition

Speaker Recognition

Voice Synthesis

Language Generation

NLUDialog

Management

Action Planning

Q&A

Summary

Auto Translation

Language Detection

Inherent FunctionExtended Function

6M LanguagesAmbient

Knowledgeable Empathetic

Multi-lingualRespond to Various User

Environments: Multi-device,

Multi-user, Multi-modal…

Respond Smartly to Any Question

through Continuous Learning

Improve User Satisfaction through

Personalized Emotional Response

Provide Multiple

Languages Support

Vision Intelligence

5

Translate as-you-go

Foreign language is no barrier Translate as you looki through the

camera

Discover Near By Places

Guide by your side….always Find nearby places of interests Identify landmarks or businesses and learn

more about them

Point & Shop Camera

Shop on sight Shop anytime and anywhere. Not knowing the name….No Problem Point the camera and get product info Multiple purchase options with price Recognise products and connect with

respective CPs to get relevant information

Vision Intelligence Goal

6

Always Helpful & Always Learning

Vision Intelligence

Landmark Recognition

Sensor Fusion Object Detection

Object Tracking

AR Rendering

Face Landmarks& Tracking

Face Detection

UserRecommendation Auto Translation

Inherent Function

Extended Function

Visual Understanding

User Personalization Augmented Rendering

Spatial Understanding

Detect & recognize objects

User Preference Mining Rendering of virtual objects and

augment information

Sensor calibration &

Camera tracking

User Personalize

Detect, recognize and track objects in real-time

Get distance of objects in a scene, estimate size and dimension of objects, sense depth

Understand user preferences and personalize user’s visual experience

Samsung TV Plus(OTT Service) TV Plus is a new video service that provides a rich experience for Samsung Video

partners. The experience isn’t rooted in applications, but in native channels. Partners can provide a lean-back or interactive user experience

7

TV Shows / Movies

Promotional

On Now

Up Coming

New Release

Editorial TV Genre

Sports

Promotional

On Now

Up Coming

Cricket

FIFA 2018

Promotional

On Now

Up Coming

Just Ended

Related

Apps

Oscars 2018

Movies

News

TV Shows

For You

On Now

Up Coming

Continue Watching

Trending TV Shows

My Recordings

Newly Released

Editorial

Promotional

Manual Curated

User Personalized

All Content

Samsung AI Platform

8

SDK

Context Analytics Engine - App usage , User activity logging- Device status , Sensor info - Time, Place base Recommendation- User behavior

Personalization

Deep Integration

- Interfacing 3rd party data & services- Deep integration with BixbyHome- Template based design- API for integration – Client & Server side

Bixby “Brain”

Samsung Apps/Services

Utility

OTT & Internet Partner Content

….

RealtimeAd Engine

ML in Video Broadcast Networks

• Recommendation systems for OTT viewing

• Demand driven Video Broadcast

• Dynamic Content caching at edge

• 8K video streaming through next generation 5G network-Network Resource Allocation

5G-XcastHybrid broadcast service; combinations of networks and technologies give a seamless experience

as the user moves between different locations

Media/Entertainment

Multimedia public warning alert

Samsung part of the EU standardization of 5GXcast

5G testbed for Video Streaming @Samsung Lab, IIT Delhi

• 5G Testbed under development• Based on Software Defined

Radio with High Speed Xilinx FPGA.

• Focus on next generation Content streaming and delivery applications over wireless networks

Conclusions

• Changing nature of data moving through the network• Dynamic/Active data+ML inferencing in real-time• Not just streamed video but analysed/annotated video

• Changing nature of the network• Dynamic and adaptive to real-time demand changes• Not just single topology but data-aware and application-aware network

• Role of interoperability• Disaster-recovery• Real-time reliability constraints• Customers asking for multi-platform networks