Home >Documents >Special considerations for Standards in Mobile AR

Special considerations for Standards in Mobile AR

Date post:15-Feb-2016
Category:
View:31 times
Download:0 times
Share this document with a friend
Description:
Special considerations for Standards in Mobile AR. International Workshop on AR Standards – 11. + 12. October 2010, Seoul [email protected] - Institute for Graphics Research IGD. Fraunhofer IGD Institute for Computer Graphics Research. - PowerPoint PPT Presentation
Transcript:

instantReality mobileAR - Browser

Special considerations for Standards in Mobile ARInternational Workshop on AR Standards 11. + 12. October 2010, [email protected] - Institute for Graphics Research IGD

Timo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD Fraunhofer IGD Fraunhofer IGDInstitute for Computer Graphics Research

Mission: Technologies and Applications of Visualization, Interaction and Communication in the field of ICTDirector: Prof. Dr. techn. Dieter W. Fellner4 Locations: Darmstadt, Rostock (Germany), Singapore and Graz (Austria)180 Researchers (FTE)14,7 Mio. Turnover-> Department Virtual and Augmented Reality

Timo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD Just super short:We are a non profit organization funded through government and industrial projects.We are doing generally next slide2Dep. Virtual & Augmented RealityResearch Topics

Computer Vision

Computer Graphics Interaction Technologies Timo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD Computer Vision, Graphics and Interaction research.We try to bring scientific solution into business usually trough licensingI am working at the department for Virtual and Augmented reality, and thus AR is our every day exersize3OverviewThe aim of the presentation is triggering consciousness about the idea of AR and presenting an open approach practically ..

Where are the problems in standardization of AR?What are the common structures and where are variations?What is the role of those structures in the context of AR?Technological hardware issuesWhy and what kind of standards are there and do we need?Our approach to overcome the mentioned issues and help developing standards

Cannot cover the whole horizon of problems .. But can try

Timo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD ProblemsGeneral goal of having standard(s) which apply to general needs of AR.

What is the problem?There are tracking technologies for AR, but they are in an early stage. Every application type needs its custom strategy, technology and specialized content.What do we want to cover with a standard?Due to the complexity of many parties involved in the field of AR and the high potential of possibilities.The terminology AR is not clearly differentiated generally and can lead to confusion.Which sense is augmented by what and through what?2D,3D, training, leading, informing, disinforming, helping, covering etc..Diverging hardware and software technologiesBringing the paradigm to content massesTechnologiesTimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD This is also the stcructure of the presentation5CommonTechnologiesCommonTechnologiesArising potentials of technological developmentin contrast to commonly used technologies in appsMass - SolutionCustomized Mass-SolutionCommonTechno-logiesCutting Edge-SolutionScientific SpecificLaboratory-SolutionsTimeDevelopmentProvide tools for everyoneLayar, Wikitude etc..Brandedi.e. iLiving

ComplexityTimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD - Mass SolutionsThis presents a rough visualization of the potential of common technologies. Orange areas represent accumulated AR technologies which are used already by masses (Geo-Based outdoor tracking, Marker, Poster). These are more or less proved, robust and usable by masses. A standard might be derived from these, but the orange circle grows not regular by time. If you think of blue circles representing the state of the art scientific developments, which usually take years before they are applicable in a common context and even more, when they can be used by every one.

6Augmented RealityAbstract Building BlocksContextEngineContentAnnotationEngineContextInformationInteraction EngineApplicationModelReference ModelAnnotation ModelSensorsOutputInteractionDeviceTimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD Just for recall how AR usually works..Very abstracted version of building blocks- We differentiate in between Context Engine and annotation engine because of hardware technological issues. - many combintions and relations can be established

7Computer Vision Based Augmented RealityCameraVisionEngineContent

3D AnnotationEngineExtrinsics (+ Intrinsics,Occlusions,Lights,Models etc..)Interaction EngineImage+IntrinsicsDisplay ImageScreenApplicationModelReference ModelAnnotation ModelTimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD This is a very classical example of a marker trackerStraight forward usually, but is slightly extended in order to show potential developments - Parameters, indicating other parameters of concern, but currently just very simple laboratory solutions are available (gaining the light positioin)Can be marker, poster etc .. Vision based tracking engine which also outputs the extrinsic and other parameters are thinkable- Future engines, especially when able to render photorealistic in 3d can signficantly support the tracking engine by simulation in real-time when using geometric based algorithms - look at the cardinality of the reference model which now can transfer back to the content. This indicates also that future engines are able to generate content as they recognice.- Selfenhancing tracking

8Role of Reference Model

Retrieval of the camera Pose (6Dof)Find the absolute coordinates of user and objectsGPS, Compass, Acceleration DataUse prototype model for registration (i.e. Poster, Marker, Lines)RepresentationAbsolute in latitude, longitude, altitude, roll, pitch, yawRelative in Cartesian coordinates and angles (or axis angle, quaternion..)In relation to some object or object group real or virtual?Interaction Find differences of formulated and real world (POI,AOI,VOI)This creates potential content for interactionTrack movable and deformable objectsDetect user interaction/behavior using sensors (Hands, gestures etc..)Allow feedback of generated data

Timo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD - First purpose in vision based AR-> finding the Camera pose and its 6 Degrees of FreedomThere are Different representations that have to be thought about Moving Objects- in order to allow for interaction, that not just happens on the touch screen, you can also use the vision sensor in order to register objects- Not all objects are in a static positions like in Geo-Located AR- Objects can move and will have different states.- 9Role of Visual Annotations in ARBuilding elements in GUIsVisual AidsDirect Visual Aids (DVA): Superimposed 3D-models/animations (direct association with object)Indirect Visual Aids (IVA): Annotations related to tracked object (reminder)

Mental Model BuildingUsers internal representation of the taskCan be improved by providing context information

Passive PartsInformation about the task in generalHigher-level instructions global picture

Collaborative Annotations (expert trainer)

DVA

IVATimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD This is how we interprete the Idea of annotations in aR Applications.There are cases, where it might be senseful to classify annotations: NOT BY VIDEO, IMAGE, 3D-ModelWe divide by intention:But by Visual Aids: Augmented informations usually are Visual aids, that are superimposed onto the point/Area of interestWe differentiate in between indirect and direct ones. they are basically the same but have a different intent.- Direct Visuals usually are 3D imposed models helping the user to understand and create a direct association- Indirect just reminds the user of some association- he 10Role of the interaction modelCustomizing the Annotation ModelManipulation Scene GraphInteractive ContentCustomizing the Reference ModelDynamically change tracking behavior and point of focus (POI)Allow interchange in between Annotation and Registration ModelUse of declarative formulation as far as possible.Allow scripting for specializationTracking and Events:2D-Projected Positions with distance hintDetection Events (i,e. Object enters/leaves display)Interaction of user/objects with the scene Content must be delivered free or encrypted.. Who will do this?Timo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD Hardware technology issues on mobile devicesLow computational resources in relation to modern PCsLimited memoryOpenGL ESDifferent camera modules (Intrinsics)Sensor support and calibrationPartly supported hardware accelerationSoftware Interfaces and LanguagesSymbian (C++, Microkernel, Qt)Android (Java, C++ through NDK)iPhone (Obj-C, C++ support)Algorithms need to be optimized for HWCostly and hard to maintain large set of handsets in one common Code-BaseTimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD Open StandardsSustainability for AR-ContentApplications and generation tool chains should be based on..X3D (ISO/IEC 19775:2004)HTML5ECMAScript (ISO/IEC 16262:2002)JavaScriptCSSSTEP-FormatKMLBenefitsSustainabilityInteroperabilityPortingRapid developmentTimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, Korea Fraunhofer IGD X3DOM (x3dom.org)HTML5/X3D Integration Model

Simple car configurator to interactively change color and rimsTimo Engelke, A4, October 11th,2010, International Workshops on AR Standards, Seoul, KoreaN900 with miniB Fraunhofer IGD X3DOM

Popular Tags:

Click here to load reader

Embed Size (px)
Recommended