Augmented Reality – showcase, development and
discussions
8th October 2014
Manly Emporium
What is Augmented Reality?
a technology that superimposes digital content
on a user's view of the real world.
• Combines the real & virtual
• Is interactive in real time
• Is registered in 3D
Ronald Azuma, 1997MIT Ph.D
So how does AR work?
Local matching
Cloud matching
GPS
Accelerometer
Gyroscope
GPS
NFC/Beacons
Input Matching Sensory Data
Non 3D
AR Content
Local tracking
Cloud tracking
Tracking AR Output
Microphone,
light,
temperature
Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality ApplicationsAuthor: Daniel Kurz
• Traditionally, visible light energy hits something and
bounces off it, a detector then receives it and turns it
into an image.
• Thermal cameras detect more than just heat
though; they detect tiny differences in heat – as
small as 0.01°C
• The hotter something is the more thermal energy
it emits. This emitted thermal energy is called a
“heat signature.”
Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality ApplicationsAuthor: Daniel Kurz
• Detects residual heat resulting from a warm fingertip
touching the colder surface of an object
• Detects is a surface has actually been touched, or if a
finger only approached it without any physical contact
• determine the corresponding 3D position on the
touched object based on visual object tracking using a
visible light camera
• 3D position of the touch is used by human machine
interfaces for Augmented Reality providing natural
means to interact with real and virtual objects.
Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality ApplicationsAuthor: Daniel Kurz
Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality ApplicationsAuthor: Daniel Kurz
https://www.youtube.com/watch?v=t1HmYNqp8NM
FLIR ONE: Thermal imaging device for your iPhone 5/5s
https://www.kickstarter.com/projects/ebeall/hemaimag
er-accessible-thermal-imaging-for-smart-de
FLIR ONE: Thermal imaging device for your iPhone 5/5s
https://www.youtube.com/watch?v=3i94L0B-Y-U
Presence and Discernability in Conventional and Non-
Photorealistic Immersive Augmented RealityAuthors: William Steptoe, Simon Julier, Anthony Steed
• Non-photorealistic rendering (NPR) has been shown as
a powerful way to enhance both visual coherence and
immersion in augmented reality (AR).
• Investigates the use of NPR in an immersive,
stereoscopic, wide field-of-view head-mounted
video see-through AR display.
• Introduces many real-world effects including
latency, tracking failures, optical artefacts and
mismatches in lighting.
• recover the most plausible real-world lighting
conditions depending on incident light angle using
Spherical Harmonics.
Presence and Discernability in Conventional and Non-
Photorealistic Immersive Augmented RealityAuthors: William Steptoe, Simon Julier, Anthony Steed
https://www.youtube.com/watch?v=gb79GliV370
Presence and Discernability in Conventional and Non-
Photorealistic Immersive Augmented RealityAuthors: William Steptoe, Simon Julier, Anthony Steed
https://www.youtube.com/watch?v=Bc_TCLoH2CA
Semi-Dense Visual Odometry for AR on a SmartphoneAuthors: Thomas Schöps, Jakob Engel, Daniel Cremers
• direct monocular visual odometry system which runs in
real-time on a smartphone.
• tracks and maps on the images themselves
instead of extracted features such as keypoints.
• New images are tracked using direct image
alignment, while geometry is represented in the
form of a semi-dense depth map
• AR applications can be derived from semi-dense
depth maps, and demonstrate the practical
applicability in the context of an AR application in
which simulated objects can collide with real
geometry.
Semi-Dense Visual Odometry for AR on a SmartphoneAuthors: Thomas Schöps, Jakob Engel, Daniel Cremers
https://www.youtube.com/watch?v=X0hx2vxxTMg
New '3D Haptics Touchable 3D Technology' Enables you to
Touch 3D images, Boosts Virtual-Reality GamingAFP, Japan
"It works by fooling the brain, blending the images the eye
is seeing with different patterns of vibration created by a
small device on the fingertip," adds Mr Nakamura.
The Daqri Smart Helmet
The Daqri Smart Helmet
https://www.youtube.com/watch?v=qIU456jtkmw
FlexSense: A Transparent Self-Sensing Deformable Surface
• FlexSense, a new thin-film, transparent sensing surface
• based on printed piezoelectric sensors
• reconstruct complex deformations without the need for
any external sensing
• improves mobility and is not affected from occlusions
• FlexSense can be used for a variety of 2.5D interactions
FlexSense: A Transparent Self-Sensing Deformable Surface
https://www.youtube.com/watch?v=3Jo9ww9cLzg
Dyadic Projected Spatial Augmented Reality
• augmented reality system that combines dynamic
projection mapping, multiple perspective views and
device-less interaction.
• face to face, or dyadic, interaction with 3D virtual
objects
• interact with 3D virtual objects and each other
without cumbersome devices
Dyadic Projected Spatial Augmented Reality
https://www.youtube.com/watch?v=Df7fZAYVAIE
Microsoft RoomAlive: turns your room into a Holodeck
• The evolution of the Microsoft Research research project
IllumiRoom
• projection-mapping animated environments onto the walls
• a unified, scalable approach for interactive projection
mapping that dynamically adapts content to any room
• With six procam units, every square inch of a room can be
projection mapped.
Microsoft RoomAlive: turns your room into a Holodeck
https://www.youtube.com/watch?v=ILb5ExBzHqw
Apple's iPhone-based augmented reality navigation conceptPatents filed September 4, 2014
• "Federated mobile device positioning”
• "Registration between actual mobile
device position and environmental
model"
Apple's augmented reality patent filings
were first applied for in March 2013 and
credit Christopher G. Nicholas, Lukas M.
Marti, Rudolph van der Merwe and John
Kassebaum as inventors.
Source: http://appleinsider.com/articles/14/09/04/apple-invents-iphone-based-augmented-reality-navigation-with-x-ray-vision-features
Current iOS 7 Maps Flyover of New York City.
Apple's iPhone-based augmented reality navigation conceptPatents filed September 4, 2014
Apple's iPhone-based augmented reality navigation conceptPatents filed September 4, 2014
1800 615 617
LinkedIn: au.linkedin.com/in/hugoortega
Twitter: @OnlyAugmented
http://www.insidear2014.com/munich/speakers/