Interfacing with Humans in the IoT Era
Huibert Verhoeven
SVP & GM IoT
© 2018 Synaptics Incorporated 2
SYNAPTICS LEADS THE HUMAN INTERFACE REVOLUTION
PIONEERING THE RELATIONSHIP BETWEENPEOPLE AND INTELLIGENT DEVICES
© 2018 Synaptics Incorporated 3
Synaptics – Pioneers in Neural Network Processing
NEURALNETWORKS
1986 - Synaptics was founded to commercialize analog neural
network chips for ultra-low power pattern matching
Action potential
Pre-synaptic(“sending”) cell
SYNAPSE
Post-synaptic(“receiving”) cell
© 2018 Synaptics Incorporated 4
Experience is Everything – Over 30 Years in Human Interface
20 Locations WorldwideFounded in 1986
NASDAQ: SYNA
+70% in Engineering
2300+ Employees
FY17 Revenue: $1.72B
© 2018 Synaptics Incorporated 5
Industry Innovator in Human Interface Solutions
• First with touchpads for notebook PCs (TouchPad™)
• First with capacitive touch on mobile phones (ClearPad®)
• First with capacitive touchscreen technology for mobile phones (ClearPad®)
• First with pressure sensitive touchscreen solution (ForcePad®)
• First with touch & display driver integration (TDDI) for smartphones & auto
• First with Match-in-Sensor™ fingerprint authentication (Natural ID™)
• First with optical-based fingerprint sensors for smartphones (Clear ID™)
• First to meet Amazon’s far-field qualification with only 2 microphones (AudioSmart®)
• First multimedia processor to power Android TV on service provider STB (VideoSmart™)
1st
© 2018 Synaptics Incorporated 6
Advanced Underlying Technologies
Far-field Voice and
Speech Capture
Acoustics and Audio
Output Processing
Video and Image
Processing
Optical Imaging
Display Driver and
Integrated Sensing
Capacitive Sensing
© 2018 Synaptics Incorporated 7
Boundless Opportunities in a New Growth Era
2000 2010 2020
Notebook PC SmartphoneConsumer IoT
Automotive
© 2018 Synaptics Incorporated 8
Revolutionary Jump in Device Intelligence
User learns fixed device Ambient AI adapts to user
DE
VIC
E I
NT
EL
LIG
EN
CE
User struggles with
multiple devices
PAST PRESENT FUTURE
© 2018 Synaptics Incorporated 9
Voice will be Everywhere
© 2018 Synaptics Incorporated 10
Do you want me to take
care of dinner? I found a
2 for 1 offer from Chronic Tacos
I think you would like
Ordering dinner for two.
Expected to arrive in 30 min
Sure that
sounds good.
Devices will become Context and Conversation Aware
© 2018 Synaptics Incorporated 11
Ambient Computing will be Omnipresent
“Hi John, would you like me
to set the temperature to 80°?”
“I’ll turn off lights in the living room.”
“Here are your favorite movies on Netflix.”
“Should I make some popcorn?”
It’s too cold
outside. I think I’ll
stay in and watch
a movie.
AI identifies users, location and context
PRIVACY RESPONSE AVAILABILITY
© 2018 Synaptics Incorporated 12
Data Deluge of Ambient Computing
Vast amounts of cameras & sensors
gathering massive volumes of data
Ambient computing requires Intelligence at the Edge
CONCERNS
• Security & Privacy
• Performance & Latency
• Availability
© 2018 Synaptics Incorporated 13
Smart Home Processing Capability
2013Single Core Processor
at 2000 DMIPS
2018Quad Core Processor
at 43,000 DMIPS
© 2018 Synaptics Incorporated 14
IP Needed for Future Successful Voice IoT Products
SoC
RF
Speaker
Amp
FFV
Processing
Cloud Services
ADC
Trigger
BiometricsSmart Amp
Local
ASR/NLU
Context
Awareness
NLUVoice
Calling
Speech
Recognition
Media
Content
ShoppingHome
Control
Security NPU
© 2018 Synaptics Incorporated 15
SyNAP* on Android - Software Architecture
Linux
Android NN Runtime
Synaptics /
IP Providers
Android Applications with ML (apk)
App
Developers
GPU
Drivers
OpenCL
GPU HAL
NPU LLD
NPU HALExtension
HAL
Scheduling NN Operations on the best possible core
CPU
Fallback
VS-6xx and later
TensorFlow Lite
*SyNAP: Synaptics Neural Network Accelerator and Processor
© 2018 Synaptics Incorporated 16
Semiconductor Process Implications
Our HMI vision requires low active power, ultra-low standby power,
significant computation, and dedicated neural network hardware
© 2018 Synaptics Incorporated 17
IoT Process Sweet Spot Different from Mobile
0
0.5
1
1.5
2
2.5
3
3.5
28nm IoT focus FinFet
Active Power Unit Cost Investment
© 2018 Synaptics Incorporated 18
Key Aspects of Consumer IoT Solutions
Small form-factor and highly integrated solutions for
ubiquitous use in homes
Extremely low power during idle periods but high-
performance during active periods
Fast time-to-market through near turn key systems
© 2018 Synaptics Incorporated 19
Boundless Opportunities
TOMORROWTODAY
© 2018 Synaptics Incorporated 20
© 2018 Synaptics Incorporated 21
Local Intelligence – Smarter Edge
SMART CLOUDSMART DEVICES
PRIVACY RESPONSE AVAILABILITY
PRIVACY RESPONSE AVAILABILITYTODAYCommands mostly processed in cloud
TOMORROWCommands mostly processed locally
INTELLIGENCE
INTELLIGENCE