AUGMENTED REALITY

AN PROJECT IDEAPREPARED BY: ABHISEK PADHI (TECHNIKALY)

WHAT IS AUGMENTED REALITY ?

In Simple Words…• Augmented reality is technology that combines

virtual reality with the real world. • The current world of augmented reality

deals with live video imagery which is digitally enhanced with computer generated graphics.

A Virtual World simulating a real world model

BUT…

THAT’S NOT AUGMENTED REALITY

Wikipedia SPEAKS ...

AUGMENTED REALITY (AR) :-is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data.

IS AUGMENTED

REALITY A

NEW TECHNOLOGY?

Live Telecast Of Cricket

In our television Uses: AUGMENTED REALITY

Live Football Matches

Uses Virtual marking on the field made by computer which we see in our television

• While the smartphone doesn't have the computing power for many augmented reality applications, IT IS INTRODUCING THE WORLD TO THIS CONCEPT

TECHNOLOGY REQUIRED

FOR AUGMENTED REALITY

(AR)

HARDWARE• The main hardware components for augmented reality

are: processor, display, sensors and input devices.

• These elements, specifically CPU, display, camera and MEMS sensors such as accelerometer, GPS, solid state compass are often present in modern smartphones, which make them prospective AR platforms.

An iPhone Showing anAugmented Realityapplication

DISPLAYSThere are essentially 3 different kinds of displays of augmented reality:

• THE HEAD MOUNTED DISPLAY (HMD) is worn on the head or attached to a helmet. This display can resemble goggles or glasses• THE HANDHELD DEVICE is a portable computer or mobile

smartphone such as the iPhone.

• SPATIAL DISPLAY makes use of projected graphical displays onto fixed surfaces.

•An head mount display

• An head mount display worn by a person

The Most popular smartphone the iPhone is a brilliant example of smartphone deploying AR apps.

TRACKING• Modern mobile augmented reality systems

use one or more of the following tracking technologies: digital cameras and/or other optical sensors, accelerometers, GPS, gyroscopes, solid state compasses , RFID and wireless sensors. These technologies offer varying levels of accuracy and precision.

INPUT DEVICES

• A smartphone or a WEBCAM that signals its position and orientation from camera images.

COMPUTER

• The computer analyzes the sensed visual and other data to synthesize and position augmentations.

TRACKING• Modern mobile augmented reality

systems use one or more of the following tracking technologies: digital cameras and/or other optical sensors, accelerometers, GPS, gyroscopes, solid state compasses , RFID and wireless sensors. These technologies offer varying levels of accuracy and precision.

INPUT DEVICES• A smartphone or a WEBCAM that

signals its position and orientation from camera images.

SOFTWARE AND

ALGORITHMS

ALGORITHM

• A key measure of AR systems is how realistically they integrate augmentations with the real world.

• The software must derive real world coordinates, independent from the camera, from camera images.

• That process is called image registration.

• Image registration uses different methods of computer vision, mostly related to video tracking. Many computer vision methods of augmented reality are inherited from visual odometry.

Usually those methods consist of two parts…

First detect interest points, or fiduciary markers, or optical flow in the camera images. First stage can use feature detection methods like corner detection, blob detection, edge detection or thresholding and/or other image processing methods.

The SECOND STAGE restores a real world coordinate system from the data obtained in the first stage. Some methods assume objects with known geometry (or fiduciary markers) present in the scene. In some of those cases the scene 3D structure should be precalculated beforehand. If part of the scene is unknown simultaneous localization and mapping (SLAM) can map relative positions. If no information about scene geometry is available, structure from motion methods like bundle adjustment are used. Mathematical methods used in the second stage include projective (epipolar) geometry, geometric algebra, rotation representation with exponential map, Kalman and particle filters, nonlinear optimization, robust statistics.

SOFTWARE

IN COMPUTER• ARToolKit• FLARToolkit• Total Immersion • Metaio, junaio

IN MOBILE• Wikitude• Layar Etc…

TYPES OF

AUGMENTED REALITY

GPS AND COMPASS

TECHNOLOGY Found in smartphones and tablets Uses devices' GPS, compass features and high-speed

wireless networks Allows more complex applications of Augmented Reality.

Main Attraction:

Limitation:

Provides useful local web-content information and added services in 2D format at the geo-location of the user

Fairly imprecise due to current inaccuracy of the GPS technology

MARKER BASED Marker-based AR uses a camera and a visual marker to

determine the center, orientation, and range of its spherical coordinate system.

Most of the time, the applications using markers are based on open source technology.

AR Toolkit is the first fully-featured toolkit for marker-based AR

It has the advantage to be easily affordable but sometimes it is not supported and fairly weak.

Total Immersion provides the world’s most widely used commercial augmented reality platform.

TRACKING USING MARKERS

EXAMPLES OF MARKERs

DIFFERENCE…

A QR Code A Marker used For tracking in AR

MARKER LESS TRACKING

This is currently one of the best technology for tracking

It performs active tracking and recognition of real environment on any type of support without using special placed markers.

Allows more complex applications of Augmented Reality.

EXAMPLES…

APPLICATIONS

Augmented Reality

Navigation

Industrial Design

Learning

Architecture

Archaeology

Tourism and sightseeing

In an office

Sports & Entertainment

Commerce

Medical

RETAIL

ARCHITECTURE and DESIGN

FUTURE OF

AUGMENTED REALITY

IN OUR

OPINION …

It may completely change the way we study by simulating any real world situation for learning purposes.

In our opinion this augmented reality( AR ) has a lot if future in next generation interfaces like wearable gesture recognized computing, popularly referred to as SIXTH SENSE and is currently being developed as a brainchild of Pranav Mistry @MIT Media Labs.(This involves marker less tracking.)

It’ll Provide an alternate solutions to the boring world of textbooks by augmenting various images to provide an interactive and real world picture of the things which one reads in the textbook.

NOTABLE RESEARCHERS

• Ivan Sutherland invented the first AR head-mounted display at Harvard University.

IVAN SUTHERLAND

• Steven Feiner, Professor at Columbia University, is a leading pioneer of augmented reality, and author of the first paper on an AR system prototype, KARMA (the Knowledge-based Augmented Reality Maintenance Assistant), along with Blair MacIntyre and Doree Seligmann

STEVEN FEINER

• L.B. Rosenberg developed one of the first known AR systems, called Virtual Fixtures, while working at the U.S. Air Force Armstrong Labs in 1991, and published first study of how an AR system can enhance human performance

• Dieter Schmalstieg and Daniel Wagner jump started the field of AR on mobile phones. They developed the first marker tracking systems for mobile phones and PDAs.

Dieter Schmalstieg

THANK YOUIt’s a TechniKaly Production

Follow TechniKaly on:Twitter || Facebook || Google Plus || Rss