Almost every device that interacts with humans has an audio component

Innovating IoT and Wearable Devices with

Acoustic technology

October 4, 2016

Paul Beckmann, CEO – DSP Concepts

pbeckmann@dspconcepts.com

2

Introduction

• Dr. Paul Beckmann– 1984-1992: M.I.T., SB, SM and PhD in EE specializing in DSP

– 1992-2001: Bose Corp., developed algorithms for home theater,

pro audio, 3D audio

– 2001-2003: Enuvis Corp., VP Engineering, developed high-

sensitivity GPS algorithms

– 2003-present: DSP Concepts founder/CEO, developed Audio

Weaver and consulted for OEMs

• DSP Concepts– Licenses Audio Weaver: versatile, modular DSP software that requires no coding

– Develop audio processing IP

– Audio DSP consulting/engineering services

3

About DSP Concepts

DSP Concepts is a leading provider of Audio DSP technology, tools and design services

We have over 12 years of experience delivering premium audio solutions for OEMs, silicon vendors, and IP providers

1. Audio Solutions

– System Architecture

– System Customization & Tuning

– Processor profiling and

benchmarking

2. Audio Tools – Audio WeaverTM

– The only graphical cross-

platform audio design

framework

3. Audio Algorithms

– A wide variety of IP for

loudspeaker playback and

microphone input

4

Product Development is Changing

Our VisionDevelopment of products is optimized through global collaboration and integration of tools, technologies and people

5

Which Sense Would You Give up?

6

“Sound is a powerful force that, along with being

able to bring that sense of peace and well-being,

can make human beings love, cry, and in some

cases even kill.” – Deepak Chopra

7

Playback

Communication

Voice Input

Analytics

Where is Audio Heading?

• Speaker processing

• (CE, Pro-Audio)

• Microphone

• Speaker

• (Mobile, CE)

• Audio as UI

• (IoT, Mobile, CE)

• Contextual awareness

• Smart devices

• Big data

• (IoT, Mobile, Wearables, CE,

Medical)

8

Interfaces

First Wave Second Wave Third Wave

8

9

Processing By Senses

10

Smartphone drives microphone costs down

0.0

1000.0

2000.0

3000.0

4000.0

5000.0

6000.0

2013 2014 2015 2016 2017

MEMS Microphone Market (M units)

Market for Analog MEMS Market for Digital MEMS

11

Smartphone drives microphone costs down

Sources: IHS and Yole

© 2015 Property of UBM Canon; All Rights Reserved

2015 UBM Electronics Embedded Markets Study

12

57%

42%

41%

40%

22%

18%

17%

5%

Sensor driven

Cloud connected

Industrial

Smart buildings

Wearable

Medical

Connected vehicles

Other

2015 only (n = 220)

New in 2015If you are developing Internet of Things (IoT) applications,

please indicate the type of application.

Majority of IoT devices sensor driven – little data becoming big data

© 2015 Property of UBM Canon; All Rights Reserved

2015 UBM Electronics Embedded Markets Study

13

How many people are on your embedded project team?14 or so engineers..

What is your development team’s ratio of total resources (including time/dollars/manpower) spent on software vs. hardware for your embedded projects?

60/40

Thinking now about the last embedded project you completed (no longer in development), how many months did that project take to finish?

About 12.5 months

My current embedded project is programmed mostly in: C and C++ account for over 80%

Other interesting highlights about embedded market

14

Scarcity of Resources

Audio DSP

872

Embedded Software

97,975

Audio Engineer

30,915

59 261

129

11

• Expertise needed to develop audio processing software.

• Numbers taken from LinkedIn search

15

Audio Weaver® Design ToolsAudio Weaver Features

• Graphical interface

• Large library of optimized modules

• Real-time tuning

• MIPs and memory profiling

• Regression testing

• Multirate processing

• Frequency domain processing

• Advanced features using MATLAB

Audio Weaver Benefits

• Easy to evaluate IP

• Easy to integrate IP

• Easy to tune IP

• Easy to port IP

• Easy to pick processors

• Easy to ship products

• Easy to support customers

16

The Only Cross Platform Solution

Supported Cores

• ARM Cortex-M4 and M7

• ARM Cortex-A w/NEON

• Intel x86

• Analog devices SHARC, Griffin,

and Blackfin

• TI C6xxx. Jacinto.

• Tensilica Hifi 2 and 3

Feature Roadmap• Multicore support

• 64-bit run-time support

• Presets

• Sample rate converter

integration

Close partners with ARM and Tensilica

17

Demos

• Dialog Enhancement – think of post-

processing modes based on purpose

(music vs talking)

• Time of Arrival – think of robotics,

sound location, cameras

• Voice trigger

• Wind removal – pre-processing

noise cancellation

18

Trends: Microphone Applications

• Smartphone

– # of microphones / Smartphone now at 4pcs (Nokia)

– iPhone5/5s 3pcs. iPhone6 4pcs. iPhone7 TBD. Galaxy S5

switched to DMEMS

• Tablets

– Major OEMs using DMEMs (3pcs). Whitebox (ECM)

• Notebooks / Chromebooks / Ultrabooks

– Strong focus on voice quality. Poised to increase up to 3

/4 for UB

• Emerging Applications

– IoTs, Smart TV / Remote

– Wearable & Fitness

– Ultrasonic

19

Trends: Automotive Microphone Use Cases

• Telephony

– Microphone arrays

• Voice input (aka, “Alexa for your car”)

• Noise dependent equalization

• Active noise cancellation

• Autonomous vehicles

– EMS detection

– Honk detection

– Exterior or interior mics?

20

Trends: Microphone in Headphones

• 35% of headphones in NA shipped with microphones

in 2013..expected to rise to 65% in 2018

• Future source predicts that by 2018 all in-ear

headphones will be equipped with microphones!

• USBC will also increase the probability that localized

pre- and post- processing

• What can be done?

21

Use Case: DTV Video Conferencing

22

Use Case: Security

• Microphone use increasing in cameras

• Sophisticated features

– Direction of arrival estimation

– Automatic gain control

– Echo canceler

– Beamforming

– Acoustic event detection - Machine learning

based CNN algorithms

– Trigger word detection

– VR preprocessing

23

24

Where Microphone Innovation will Occur

Transducer

Combo MEMS Sensor

Vertical Integration -

SW Algorithms + CPU + Mic

25

We are at the heart of Acoustics –

“Unleashing the Power of Sound”

1. Post-processing

2. Pre-processing

New Markets examples:• Medical Wearables Quivium

Cough detection

• Amazon Echo

• Security, DIY

• Education

• VR both voice recognition &

virtual reality

Proliferation of premium acoustics.

Customers are seeking improved acoustic solutions

(pre & post)

Microphone market: ASP

Down and mobile growth stabilizing

Needs new market growth

stimulus

..intelligent audio is coming,

requires DSP knowledge to optimize the

audio signal path

Scarcity of DSP and Acoustic

Expertise requires Turn-Key Solutions

Audio next big input into Contextual Awareness

Acoustic EventDetection

Including ADAS!

Thank You!