Proprietary & Confidential | 1Proprietary & Confidential | 1
See the View (STV) Project
Environmental Perception
for
Safer and Reliable Autonomous DrivingArie [email protected]
Co-funded by the Horizon 2020program of the European Union
What we do
Driving Decisions
Perception & Fusion
Sensors
Vehicle Perception
based on raw data fusion with upsampling and AI
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 3
Fusion & Perception
PerceptionEngine
Raw Data Fusion & Detection
⁺ Raw data fusion not objects
⁺ 3D RGBd model
➢Higher detection rates
➢Less false alarms
➢Overcome faults
Camera
. . .
RADAR
LiDAR
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 4
Fusion & Detection Framework
⁺ Higher Quality (accuracy and reliability)
⁺ Lower system cost (Sensors, BUS, processing, energy)
Sensors Raw Data
⁺ Camera
⁺ Lidar
⁺ Radar
Environmental Model
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 5
Detection, Classification, Segmentation
Obstacle detection
Road Detection
Object BB detection
Semantic Segment.
Objects data-base
Objects
Multi-frame Object Tracking
Environmental Model
HD RGBd3D Model
Software Framework
Fusion & Perception
Ego-motion
Up-sampling
Calibrate
&
Unroll
&
Match
E-MI/F
Driving Module
Raw data Fusion
Camera
. . .
RADAR
LiDAR
Co-funded by the Horizon 2020program of the European Union
LIDAR 64 - Before Up-sampling
Co-funded by the Horizon 2020program of the European Union
LIDAR 64 - After Up-sampling
3D High Resolution at Low Cost
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 8
Accurate SLAM – Ego-Motion
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 10
Environmental Model
Pedestrian
Vehicles
Free Space
Free Space
Red – Objects
Bird Eye View Detection by Non- DNN
Detection by Classification (DNN)
Blue Ground
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 11
Peacocks crossing the street Detecting the unexpected – Non-DNN
Proprietary & Confidential | 12
Urban Driving in Tel-Aviv
Proprietary & Confidential | 13
STV Project Objectives
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 14
STV expected and planned performances
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 15
STV Project plan
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 16
STV Schedule and Gantt Chart
Co-funded by the Horizon 2020program of the European Union
Proprietary & Confidential | 17Proprietary & Confidential | 17
Benefits
⁺ Raw Data Fusion ⁺ The optimal method for reliable detection
⁺ Up-Sampling ⁺ Increasing LiDAR/RADAR low resolution
with smart algorithms
⁺ Detection and Classification ⁺ Most accurate and reliable detection
Better performance with current sensor set and
Roadmap for low cost system
Co-funded by the Horizon 2020program of the European Union
