AUGMENTED REALITY & HCI-KINECT
HUMAN COMPUTER INTERACTION
ISIDRO NAVARRO
AUGMENTED REALITY BARCELONA - MEETUP-032013-december-12
La Salle Campus Barcelona
AR & VR - Architect03
AUGMENTED REALITY BARCELONA
INTRODUCTION
2
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCI
• Introduction– ‘Augmented Reality Barcelona’– Blogs, Communities and Groups
• HCI• Research• Industry• Applications• Related Themes
AUGMENTED REALITY BARCELONA
INTRODUCTION
3
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIAugmented Reality Barcelona
Who we are?...more than 110 members from more than 35 entities
La Salle, LAYAR, Catchoom, Engidia, INAR, Tetravol, Mitjans Digitals, T-Systems, Alt64, Bienetec, Aumentaty, Namastech, MKTCultural, Augmate, BOC, Ltc&group, EspiRA, Funky Whale Games, BeMyApp, FoolHead Studio, FEZOO, TEF, Medialab Barcelona, PANGEA Reality, Iris Control Systems, Mobile World Center, Innovae Vision, UPC, Aumentasolutions, AR Dirt Podcast, Doubleyou, Amplified Robot, Merchlar, Boston Scientific, Einnova, AR Standards, ENTI,…
AUGMENTED REALITY BARCELONA
INTRODUCTION
4
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIBLOGS & PEOPLE
http://www.ardirt.com
http://augmentedpixels.com/blog/
http://augmentation.wordpress.com
http://augmentedblog.wordpress.com
http://www.augmented.org/blog
http://www.augmentedlegality.com
http://gamesalfresco.com
http://medicalaugmentedreality.com
http://augmentedrealityoverview.blogspot.com
AUGMENTED REALITY BARCELONA
INTRODUCTION
5
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCICOMMUNITIES in Google+
AUGMENTED REALITY BARCELONA
INTRODUCTION
6
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIGROUPS in Linkedin
Mobile Augmented Reality (3500+)AR Glasses (2700+)Immersive 3D Environments & Augmented Reality (1000+)Geospatial Augmented Reality (400+)Layar Reality Browser (400+)AR-UX : Augmented Reality User Experience (250+)ARE: Augmented Reality Educators (50+)La Salle AR (40+)
AUGMENTED REALITY BARCELONA
INTRODUCTION
7
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIAR market studies
Virtual Reality & Augmented Reality Market worth 1.06 Billion by 2018“Virtual Reality & Augmented Reality Market – By Technology (Mobile & Spatial AR, Semi & Fully Immersive VR); By Sensors & Components (Accelerometer, Data Glove, HMD, ICs); By Applications (Medical, Military, Gaming), By Geography (2013 – 2018) ”, published by MarketsandMarkets
WEB
AUGMENTED REALITY BARCELONA
HUMAN COMPUTER INTERACTION
8
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCICONCEPT
Human-Computer Interaction (HCI) is a discipline concerned with the design, evaluation and implementation of interactive computing systems for human use and with the study of major phenomena surrounding them.1992, SIGCHI Curriculum Development Group
AUGMENTED REALITY BARCELONA
RESEARCH
9
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCISIXTHSENSE - MIT Media Lab
Haptic System'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. Author: Pranav Mistry
VIDEOWEB
AUGMENTED REALITY BARCELONA
RESEARCH
10
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIOCULUS RIFT & Motion Capture System
This projects details a stereo camera rig that I've built for the Oculus Rift, and showcases a series of augmented reality demonstrations. The video also covers a method to use the Rift wirelessly (Virtual Environments and Computer Graphics group at University College London)Author: William Steptoe
WEB VIDEO
AUGMENTED REALITY BARCELONA
RESEARCH
11
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCISANDBOX – KeckCAVES
Science education, Keck Foundation, CaliforniaThe sandbox is equipped with a Kinect 3D camera and a projector to project a real-time colored topographic map with contour lines onto the sand surface. The sandbox lets virtual water flow over the surface using a GPU-based simulation of the Saint-Venant set of shallow water equations.Authors: Oliver Kreylos, Buraz Yikilmaz & Peter Gold from KeckCAVES
VIDEO WEB
AUGMENTED REALITY BARCELONA
RESEARCH
12
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIREALITY EDITOR - MIT Media Lab
Internet Of ThingsThe Reality Editor is a system that supports editing the behavior and interfaces of socalled “smarter objects”, i.e. objects or devices that have an embedded processor and communication capability. Author: Valentin Heun
VIDEOWEB
AUGMENTED REALITY BARCELONA
RESEARCH
13
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIGestural Interface for Remote Spatial Perception
Wearable device GIST helps the blind ‘see’ what’s around them.Authors: Vinitha Khambadkar and Eelke Folmer are computer scientists from the University of Nevada
VIDEOWEB
AUGMENTED REALITY BARCELONA
RESEARCH
14
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIKinect Sign Language Translator – Microsoft Research
The prototype system understands the gestures of sign language It displays the signer and renders a written and spoken translation of the sign language in real-time, and it also takes the non-signer's spoken words and turns them into accurate, understandable sign language.Author: Xilin Cen, Professor, Chinese Academy of Sciences
VIDEOWEB
AUGMENTED REALITY BARCELONA
RESEARCH
15
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIinFORM – MIT
Dynamic Shape DisplayinFORM can render 3D content physically, so users can interact with digital information in a tangible way. It also interact with the physical world around it, for example moving objects on the table's surface. Remote participants in a video conference can be displayed physically, allowing for a strong sense of presence and the ability to interact physically at a distance. Authors: Daniel Leithinger, Sean Follmer & Hiroshi Ishii from MIT
VIDEO WEB
AUGMENTED REALITY BARCELONA
INDUSTRY
16
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIPRIMESENSE labs
SMART TERRAINApps powered by Vuforia can now enable users to create their own play space and interact with the physical world in ways not experienced before by enabling game physics to apply to real world surfaces and objects.
VIDEOWEB
AUGMENTED REALITY BARCELONA
INDUSTRY
17
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIOMEK
OMEK BECKON & GRASPOmek Beckon and Grasp are a full-featured set of middleware and tools that enables you to quickly and efficiently deploy full-body and hands gesture and tracking interfaces in your applications and devices, for operation at ranges from 1.5 to 3.5 meters and 10 cm.
VIDEOWEB
AUGMENTED REALITY BARCELONA
INDUSTRY
18
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIXBOX ONE – Microsoft
Kinect-GameThe console includes a newly upgraded Kinect motion sensing peripheral. New features such as a built-in Skype client for videoconferencing, user recognition and tracking, and the ability to use voice commands and gestures to navigate the console's user interface.
VIDEO
AUGMENTED REALITY BARCELONA
INDUSTRY
19
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIPLAYGROUND – Playstation 4
Player interaction for immersive gaming.The Playroom, an alternate reality game that comes pre-loaded on PlayStation 4 projects the miniature machines into players' living rooms. Using the PlayStation Camera, players can interact with them, kicking, flicking, and cradling them as they frolic and cower.
VIDEO
AUGMENTED REALITY BARCELONA
INDUSTRY
20
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIRAZER HYDRA – Sixense Entertainment
Magnetic motion sensingIt uses a weak magnetic field to detect the absolute position and orientation of the controllers with a precision, as stated by its developers, of 1 mm and 1°; it has six degrees of freedom. The current release is wired, but a wireless version is in development.
VIDEO
AUGMENTED REALITY BARCELONA
INDUSTRY
21
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIREACTIVE GRIP – Tactical Haptics
Friction controllerReactive Grip touch feedback works by mimicking the friction and shear forces that we feel in the real world when holding an object or touching a surface. This is accomplished by measuring the movements of the player’s hand and actuating small sliding plates in the grip of the controller to recreate the friction and shear forces you expect
VIDEO
AUGMENTED REALITY BARCELONA
APPLICATIONS
22
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCISTREET MARKETING - Appshaker
Interaction in public spaces for street marketing.Projects using augmented reality, motion/body tracking and gesture control.
VIDEOWEB
AUGMENTED REALITY BARCELONA
APPLICATIONS
23
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCILEAP MOTION & Kinect
The Leap Motion controller senses how users moves their hands over the device.Author: Yhosinaga Takashi
WEB VIDEO
AUGMENTED REALITY BARCELONA
RELATED THEMES
24
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIIRIS – Hybe
Interactive mirror with Arduino and KinectRIS is a media canvas with matrix of conventional information display technology - a monochrome LCD. Through the phased opening and closing of circular-segmented black Liquid Crystal, IRIS can create various patterns and control the amount (size) of passing lights. Seoul Art Space_Geumcheon, KOREA
VIDEO
AUGMENTED REALITY BARCELONA
RELATED THEMES
25
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIEYEBORG – Cyborg Foundation
Eyeborg is a cybernetic eye that allows you to hear colours from infrared to ultraviolet.The current eye is based on a chip that transmits sounds via bone conduction.Author: Neil Harbisson
WEB VIDEO
AUGMENTED REALITY BARCELONA
RELATED THEMES
26
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIEPOC nuroheadset - EMOTIV
EMOTIV + KINECT CONTROLLED ROBOTThe Microsoft Kinect RGB-Depth camera overlays the floor in relation to the robot's position and orientation. The user selects a location on the floor with the mouse by moving his head.
WEB VIDEO
AUGMENTED REALITY BARCELONA
RELATED THEMES
27
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIOLIMPIC CHANGES
Contest for the best idea of projects about the olimpic winter games in Rusia.People interacts with the tickets machine to get it for free while they do sport.
VIDEOWEB
AUGMENTED REALITY BARCELONA
RELATED THEMES
28
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCINEUROCAM – Neurowear
Wearable camera system that detects your emotions.It automatically records moments of interest based on an analysis of the users brainwaves..Author: Mitsukura, professor of Keio University
WEB VIDEO
AUGMENTED REALITY BARCELONA
RELATED THEMES
29
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCISHIPPO – Neurowear & Kiluck
Neuro tagging map – Wearable device registers your emotions and tag the map for sharing in social apps.
WEB VIDEO
30AUGMENTED REALITY BARCELONA
Augmented Reality & HCI-KINECTBy ISIDRO NAVARRO
#mee
tupA
RHCIISIDRO NAVARRO
LinkedInYoutube
SlideshareGoogle+Twitter
FacebookScholarMeetup