PowerPoint Presentation

How neural networks can make a drone your next best friend

Tessie Hartjes

MASTERElectrical Engineering Electromechanics & power electronics

BACHELORInnovation ScienceTrack: EnergieIris Huijben

MASTERElectrical EngineeringTrack: Care and Cure - Signal Processing

BACHELORPyschology & Technology Track: Robotica

How neural networks can make a drone your next best friendBlue Jay Eindhoven10-08-2016

1

01

2015 - 2016

2

www.bluejayeindhoven.nlThe first domestic droneShowing the useful potential of drones02

3

www.bluejayeindhoven.nl03

4

www.bluejayeindhoven.nlBiggest challenge04

Accurate indoor navigationFlying indoor and between people = no room for error!The drone will fly more stable when it flies itself (autonomous)But, existing solutions arent accurate enough

5

www.bluejayeindhoven.nlOur solution04

Visible light communication: cm exact indoor navigation

Online database

Every LED lamp has its own recognizable frequency

An online database holds the position of every lamp and is accessed by the drone

The camera of your smartphone registers the composed light and calculates your position with respect to the known configuration of the lampsUnique and precise solution within robotics domain but one problem: people only walk in the x- and y-plane need for sensor fusion

6

www.bluejayeindhoven.nlOur solution04

Sensor fusion

LiDARLight detection and ranging sensor

Altitude measurement based on timing differences of laser beamsOptical flowRelative x and y displacement

A camera that sees relative movement through image displacement

7

www.bluejayeindhoven.nlBlue Jay as assistent05

Object recognitionNavigation

Face recognition

8

www.bluejayeindhoven.nlNeural networks for flexibility06

9

www.bluejayeindhoven.nlTraining and testing07

YawPitch

In mijn bachelor eindproject ben ik vorig jaar bezig geweest met herkenning van draaiingshoek van een gezicht.Ik heb toen verschillende soorten neurale netwerken getraind op databases van fotos van gezichten met meerdere draaiingshoeken en verlichtingshoeken.

In deze grafiek zie je een van de betere resultaten. Hier heb ik ook gebruik gemaakt van de grootste trainingsdatabase met de meeste variantie. Nu aan jullie de vraag, hoeveel fotos heb ik hiervoor gebruikt denken jullie?10

www.bluejayeindhoven.nlTraining and testing08

16.664 pictures

11

www.bluejayeindhoven.nlChallenges & user cases09

Object avoidanceHealth careRecognizing new people and objectsNoise reduction

Assistance / guidanceFire safety

12

www.bluejayeindhoven.nl

14