Augmented Reality (AR) in Computer

Aided Engineering (CAE) Dr.-Ing. M. Losurdo

What/Why Augmented Reality (AR)

Main Software Developer Kit (SDK) and Algorithms

AR SDKs

Image Target: Natural Feature Tracking (NFT)

Augmented Reality (AR) in Computer Aided Engineering (CAE)

1. Background

2. Software (SDKs)

3. Gesture Recognition

4. Hardware (AR Binocular Glasses)

AR for Numerical Computing (CFD/FEM)

CFD+AR State of The Art

Case 1: Present Scenario

Case 2: Future Scenario

Case Study & Results

Advantages/Disadvantages

Conclusion

Overview

What is Augmented Reality (AR):

“Augmented reality (AR) is a live, copy, view of a physical, real-world

environment whose elements are augmented (or supplemented) by computer-

generated sensory input such as sound, video, graphics or GPS data.”

Why Augmented Reality (AR):

Educational

Training

Information

Navigation (Head-Up Display, Rear View)

CAD/CAE Engineering

What/Why Augmented Reality (AR)

Augmented Reality:

1. Wikitude

2. Metaio

3. D'fusion Studio

4. Vuforia

“…there is little doubt that the future of AR is not in smartphones or

tablets, but in more natural, eyewear-based interfaces.

The real question is when that future will actually begin…”

https://www.abiresearch.com/press/augmented-reality-eyewear-is-interface-of-future-b

Augmented Reality – Main SDKs:

Main Algorithms

.

3D

Models

Augmented

Reality

SDK

Unity 3D (Game Engine)

• Eclipse (Android)

• XCode (iOS)

Mobile

Device

Data

Conversion

.

Natural Feature Tracking (NFT) Setup - Vuforia

Augmented Reality requires a reference (virtual point) or a real target to

project and overlap the virtual content.

For the cases here presented, the NFT Target Method is used.

Image Targets are pre-processed using the provided online Vuforia Target

Manager

1) Background:

Augmented Reality in CAE used to visualize CAD 3D models

CFD/FEM:

From 2D Pictures to 3D Virtual Reality (Head Mounted

Display, Stereoscopic Glasses, Immersive Reality…)

How Augmented Reality will be used in Computational

Engineering:

Available Technology: Mobile, Tablet quadcore , 2Gb RAM

Binocular See-Through Vision Glasses will be Released in

2014 (Pre-Sales)

Data Conversion required

Augmented Reality (AR) in Computer Aided Engineering (CAE)

Augmented Reality for Numerical Computing (CFD/FEM) :

AR Extends the Range and the Visualization

Possibilities/Capabilities of Commercial and Academic Scientific

Data Rendering (Image Post-Processing)

AR Increases Visualization Performance of Data Sharing

and Client Data Delivery/Presentation

Focus on:

Multiple Element Interaction /Coupling

Turbulence, Vortex Shedding…

Flame Stability

Multiphase Flows (Solid/Liquid Particles)

Wearable Technology Industry looking for “Killer Apps”

Augmented Reality (AR) in Computer Aided Engineering (CAE)

2) AR SDKs + Industries:

METAIO (Software SDK):

Strategic Partnership with IKEA, Volkswagen (MARTA XL1) +AUDI

(eKurtzinfo App)

3D CAD Models/Parts Visualization http://www.metaio.com/

QUALCOMM : Vuforia SDK +CPU Samsung Mobile

Focus on Gaming/Advertisement Apps + CPU Snapdragon Samsung S5 https://www.vuforia.com

UNITY 3D Game Engine Enviroment : Vuforia/Metaio SDK

Direct Import of Vuforia and Metaio SDKs

Easy to Use + Direct App Deployment to Windows/Android/iOS

Java + C# Routines https://www.unity3d.com

Software (SDKs) Augmented Reality (AR) CAE Oriented:

3) AR Gesture Recognition:

Image Target (Point Markers)

Pre-processed Images

Hand-mounted Images

Simultaneous Localization And Mapping (SLAM):

Pre-defined Shape of the Elements to be Tracked (Face/Hand Tracking

Algorithm)

The use of one camera (Odometry) requires the mapping of the whole

Visualized Environment

Gesture Recognition (Shape/Profile Recognition)

3D Depth Cameras : Windows Kinect, SoftKinetic…

Software (SDKs) Augmented Reality (AR) CAE Oriented:

http://www.epson.com/cgi-bin/Store/jsp/Landing/moverio-bt-200-smart-glasses.do?ref=van_moverio_2014

Epson:Moverio BT-200 ($699.00 PRE-ORDER PRICE, April 2014) Strategic Partneship with Scope AR (AR Software)

“Built on the Android platform, developing for Moverio is no

more complex than building a mobile app”

http://www.vuzix.com/augmented-reality/products_star1200xld/

Vuzix:Star 1200 XLD (Price: $4999)

https://www.spaceglasses.com/

Meta:Spaceglasses (Deliveries Start July 2014, Price: $3000)

Vuzix Announces Strategic Partnership with Wikitude (AR Software):

http://www.vuzix.com/wp-

content/uploads/2014/01/13113866_020414%20Vuzix%20Strategic%20Partnership%20with%20Wikitude.pdf

Strategic Partnership with Softkinetic (Gesture Recognition):

http://www.softkinetic.com/AboutUs/NewsEvents/ArticleView/tabid/562/ArticleId/305/language/en-US/NEWS-

meta-Selects-SoftKinetic-To-Bring-Real-Time-3D-Input-And-Natural-Interactions-To-Revolutionary.aspx

4) Hardware Augmented Reality Binocular Glasses List:

Complete List available at: http://www.activeantiglare.com/ActiveAntiGlare/ar2.html

CFD+AR State of The Art:

EXA Powerflow:

Strategic Partnership with RTT (Real Time Technologies)

RTT Software Development for VR and AR Rendering

RRT is now 100% Dassault Systemes (CATIA, Solidworks, 3DS…)

Solidworks has developed an 3D CAD Model AR for iOS: http://www.pddnet.com/videos/2013/02/edrawings-ios-augmented-reality

CD Adapco+AR: (2013, Conference, PC desktop + Webcam) http://www.cd-adapco.com/conference_video/v3-fire-smoke-analysis

ANSYS+AR: (2012, PC desktop + Webcam ) http://www.ansys-blog.com/tag/augmented-reality-freshwater-sandbox/

CFD +Augmented Reality (AR) in Computer Aided Engineering (CAE)

CFD +Augmented Reality (AR): Future Strategy and Partnerships

CD

Adapco

AR

SDK

AR Glass,

Smart

Technology

BMW

Airbus

Siemens

Continental

CFD Data

Converter

Game

Engine

AR Scene

Processing

Case 1

Present

Scenario

Data From Clients

App Deployment

CD

Adapco

Qualcomm

Vuforia

SDK

AR Glass,

Smart

Technology

BMW

Airbus

Siemens

Continental

CFD Data

Converter UNITY 3D

Standalone

Program

Case 2

Future Scenario

CFD +Augmented Reality (AR): Future Strategy and Partnerships

Optional

Required

CFD in Augmented Reality (AR)

CFD in Augmented Reality (AR)

CFD in Augmented Reality (AR)

Advantages:

“Light”, Portable, Inexpensive

Confidential Data Encryption

Personalized Data View

Vectorized Graphic Format

“In-Situ” Rendering

Disadvantages:

Data Conversion Required

Scene Set-Up

Static Scene or short frame-motion animations

Specific App. Development Required

Multiple Image Targets Required for a 360° View

Augmented Reality (AR) in Computer Aided Engineering (CAE)

.

Augmented Reality for Numerical Computing (CFD/FEM) :

AR enhances scientific data understanding

AR is a new and fast developing technology Next Big

Thing

AR Wearable Hardware suitable for CFD/FEM currently

under development (Binocular See-Through Glasses)

AR Wearable Hardware will mount the same equipment of

Smartphones and Tablets (Android/iOS)

Wearable Technology Industry looking for “Killer Apps”

Cost Reduction compared to Virtual Reality Equipment

Work in Progress Wide Range of Opportunities

Conclusion

.