Post on 27-Mar-2020
transcript
Proprietary & Confidential | 1Proprietary & Confidential | 1
&Integrated Sensing
Cognition System
Proprietary & Confidential | 2Proprietary & Confidential | 2
The lastgeneration of drivers
Proprietary & Confidential | 3Proprietary & Confidential | 3
Company Overview
⁺ Addressing the heart of the autonomous vehicle challenge;
Understanding the changing environment with the most advanced 3D sensing and cognition algorithms
⁺ Our offering:⁺ AI sensor fusion platform
⁺ “Point and Shoot” LiDAR
⁺ Founded in Feb 2016
⁺ Raised seed in July 2017AI
Deep learning
Computervision
3D modeling
System architecture
Proprietary & Confidential | 4Proprietary & Confidential | 4
Autonomous Vehicles
Driving Control
Driving Decisions
Cognition/Fusion
Sensors
Proprietary & Confidential | 5Proprietary & Confidential | 5
Driving Control
Driving Decisions
Cognition/Fusion
Sensors
Autonomous VehiclesIntegrated Sensing & Cognition System
Proprietary & Confidential | 6Proprietary & Confidential | 6
⁺ Sensors: Camera, Lidar Radar
⁺ Basic fusion
⁺ High accuracy
⁺ Low latency
⁺ High reliability
⁺ Affordable
Main challenge for L3 and higher autonomous cars
Solutions need to be:
But current solutions are lacking:
Proprietary & Confidential | 7Proprietary & Confidential | 7
Legacy Fusion Solutions
Driving Decisions & Control
Basic Fusion/Cognition
Camera cognition SW
LiDAR cognition SW
RADARcognition SW
Camera LiDAR RADAR
Environment Model
Proprietary & Confidential | 8
Proprietary & Confidential | 9Proprietary & Confidential | 9
Raw Data Fusion
Combined Algorithms for a rich environment model
Point & Shoot LiDAR and RADAR
Driving Decisions & Control
Raw Data Fusion/Cognition
CameraLiDAR
Point & ShootRADAR
Point & Shoot
Rich Environment Model
Proprietary & Confidential | 10
Data Fusion
Raw
Proprietary & Confidential | 11
Raw Data Fusion
⁺ Integrating sensor data on a pixel level
⁺ Overcome sensor faults
⁺ Optimize detection
⁺ Simplify decision making
Legacy Fusion Solutions
VAYAVISION Raw Data Fusion
Proprietary & Confidential | 12
& Shoot LiDAR
Point
Proprietary & Confidential | 13
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
& Shoot LiDAR
Point+
+
+
++ +
++ + +
+ ++
+
+
++ + + + + + + + + +
++
+
+
+++
+++++
++
+
+
+++
+++
+ +
++++++++++++
+++++
++++++
+
+
++
++
+
+
+++++++++
+
+
+
++
+
+ + + + + + + + + ++ + + + + + + + + + + ++ + + + + + + + + + + +
+ + + + + + + + + + + + + ++ + + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + +
+ + + + + + + + + + + + + ++ + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + ++ + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + +
+ + + + + + + + + + +
+ + + + + + + + + + ++ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + +
+ + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + + + + +
+ + + + + + + + + ++ + + + + + + + + + + ++ + + + + + + + + + + +
+ + + + + + + + + + + + + ++ + + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + ++ + + + + + + + + + + + +
++++++++++++
+++++
++++++
+++++++++
+ + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + + +
+ + + + + + + + + + + + + + + + + + + + + + + +
Proprietary & Confidential | 14
Point and Shoot LiDAR Requirements
⁺ 150m Range @ 10% reflectivity
⁺ 120° x 25° Field of View
⁺ <0.1° Horizontal resolution
⁺ 0.1° Vertical resolution
⁺ <6cm accuracy
⁺ 60 Frames per second
⁺ 5000 points per frame
Proprietary & Confidential | 15
for a Rich
Environment Model
Combined Algorithms
Proprietary & Confidential | 16
Rich Environment Model
U1
Free space LaneCar PedestrianUnidentified Obstacle
Traffic lightSignBicycle SLAM
Proprietary & Confidential | 17Proprietary & Confidential | 17
Combined algorithmic approach
⁺ SLAM
⁺ High Resolution 3DModel
⁺ Free space detection
Proprietary & Confidential | 18Proprietary & Confidential | 18
Proprietary & Confidential | 19Proprietary & Confidential | 19
Proprietary & Confidential | 20Proprietary & Confidential | 20
Proprietary & Confidential | 21Proprietary & Confidential | 21
Overwhelming amount of data
Proprietary & Confidential | 22Proprietary & Confidential | 22
Stronger processor
Proprietary & Confidential | 23Proprietary & Confidential | 23
What we need
⁺Strong CPUs and GPUs
⁺Development Environment
⁺Scalability
⁺Market acceptance
Proprietary & Confidential | 24Proprietary & Confidential | 24
What we need
⁺Real Time System⁺ CPUs⁺ Interfaces⁺ Peripherals
⁺Algorithms⁺ Strong GPU
acceleration⁺ Development cycle
Proprietary & Confidential | 25
Best platform
Proprietary & Confidential | 26
Summary
Change pics
Proprietary & Confidential | 27
VAYAVISION’s AI Sensor Fusion Platform
⁺ Raw data fusion:⁺ Better cognition algorithms⁺ Can operate with VAYAVISION
LiDAR and 3rd party sensors (Cameras, LiDARs and RADARs)
⁺ Point and Shoot LiDAR⁺ Better resolution and higher frame
rate⁺ Affordable
⁺ Richer environment model
Fusion/Cognition
ADAS/AD
LiDAR Point & Shoot
Camera
RADARPoint & Shoot
GPS
V2X
Map
Cellular
Vehicle Control
HMI
DRIVE PX 2
Proprietary & Confidential | 28Proprietary & Confidential | 28