„„Al. I. Cuza” University of IaAl. I. Cuza” University of Iassi, i, RomRomaaniania

Faculty of Computer ScienceFaculty of Computer Science

AR is used in many domains:◦ Medical◦ Entertainment◦ News Business◦ Military

Very popular on mobile devices

Layar Reality Browser◦ Display real time digital

information on top of the real world

◦ The real world is augmented as seen through a mobile phone

Wikitude World Browser◦ AR browser for Android platform◦ Location-based Wikipedia and

Qype content

SomaView◦ AR application for Android

platform◦ Discover digital world

around you: hotels, transportation, shopping, ...

NyART◦ AR application which allows

browsing of hundreds of exhibitions happening in the moment of use in different cities

GeoVector◦ „advanced pointing search”

– directional search

How can we develop an AR application? Answers (from existing solutions):

◦ Create it from scratch◦ Use an existing application and modify it

What happens when our application architecture cannot be derived from other existing architecture?

The majority of existing applications are distributed as installable software so that we cannot have the source code.

Or (our solution),◦ Use an AR framework which has already

implemented basic AR features

There are several features which can be seen as a base for every AR application:◦ Shape recognition

◦ Depth detection◦ Rendering

Detect how far is placed an object when it is seen through a video camera

Current approach: we use consecutive frames and detect how much an object changed its position

Virtual objects◦ OpenGL

Real object◦ Split the video input into

shapes (parts of the video input)

Final rendering◦ Combine the virtual objects

with scenes of the video input respecting the depth

WEB SERVER

Process HTTP requests

Depth Detection Service

Shape Recognition Service

DATABASEStores 3DWML

representation for virtual objects

HTTP Request

HTTP Response

• Client side:Rendering and instancing

a huge number of ojects:• Rendering:

• 90 objects in less than 4 seconds

• Usually there are no more than 32 objects which are rendered in maximum 1 second

• Instancing:• 512 objects in less

than 1 second

Server side◦For 1000 simultaneous clients, 90% of the

requests were fulfilled in 463 milliseconds◦around 5000 clients should be able to

simultaneously use a single server

Prototype◦ Can be considered first step in developing AR

framework after analysing the test results◦ It offers some basic features for AR development◦ Cross platform (Android, Symbian, Windows Mobile)◦ Lesser GNU Public License◦ Other advantages

each component can be reimplemented easy to add new components, services, implementations

for different algorithms