Introduction to Mixed Reality

Jung Lee

2017/4/17 | # 2

Contents

• Basic Principles of MR

• Application Examples

• MR Devices

• Discussion

2017/4/17 | # 3

Who Am I?

2017/4/17 | # 4

Virtual Reality, VR

• Virtual space with only artificial entities

Inception, 2010

2017/4/17 | # 5

Augmented Reality, AR

• Real world overlapped with virtual entities + interaction among them

Harry Potter & the Order of the Phoenix, 2007

2017/4/17 | # 6

What is Augmented Reality?

2017/4/17 | # 7

What is Augmented Reality?

• Definition by Ronald Azuma, 1997 Real world with virtual entities Interactive in real-time Placed in 3D

Augmented Reality Car

2017/4/17 | # 8

Mixed Reality Continuum

• Combinations of the real and virtual worlds

RealityVirtualReality

AugmentedReality

AugmentedVirtuality

Mixed Reality

2017/4/17 | # 9

MIT Sixth Sense (Pranav Mistry, TED 2009)

• Prototype for the future AR concept

Basic Principles of MR

2017/4/17 | # 11

Basic Principle of VR

• Binocular disparity Difference between images seen from both eyes

2017/4/17 | # 12

2017/4/17 | # 13

Basic Roles of AR Components

• User Observes the AR display and Changes the viewpoint

• System Tracks the user’s viewpoint, Registers the virtual content in the real world, and Presents situated visualization

Application Examples

2017/4/17 | # 15

Virtual Try-On

FXMirror, FXGear

2017/4/17 | # 16

VR Therapy : Arachnophobia

• Realistic movement of a virtual spider Relatively weak immersion into the situation

2017/4/17 | # 17

VR Therapy : PTSD

• Soldiers, fire fighters, policemen, victims of sexual assaults, etc. Repeating the similar situations

2017/4/17 | # 18

Sport Broadcast Visualization

2017/4/17 | # 19

AR Browser

• Superimposes points of interest on a live video

Yelp Monocle

2017/4/17 | # 20

Translation

• Spontaneous translations of text Over the camera image

Google Translate

2017/4/17 | # 21

AR Navigation

i-Navi

2017/4/17 | # 22

Augmented Magazines

2017/4/17 | # 23

AR Game

The Eye of Judgement, SCE Japan Studio, 2007

2017/4/17 | # 24

AR Environment

Illumi Room, Microsoft Research

MR Devices

2017/4/17 | # 26

<VR>HTC Vive

2017/4/17 | # 27

<VR>

Tilt Brush, Google

2017/4/17 | # 28

<VR>Cyberith Virtualizer + Oculus Rift + Wii Mote

2017/4/17 | # 29

Gear VR, Samsung

• Smartphone-based VR HMD*

• Partnership with Oculus

Head tracking Touch-based controller

Google Cardboard

HMD : Head-Mounted Display

2017/4/17 | # 30

Crisis of Samsung in 2016

2017/4/17 | # 31

<VR>Playstation VR (PSVR)

2017/4/17 | # 32

<VR>Summer Lesson for PSVR

2017/4/17 | # 33

<VR>Social VR, Facebook

2017/4/17 | # 34

<VR>

Microsoft ???????, $299 !!!

Coming on Windows 10 Creator's Update

• Free positioning

2017/4/17 | # 35

<AR>

Google Glass

2017/4/17 | # 36

<AR>

META 2

2017/4/17 | # 37

<AR>

HoloLens, Microsoft (Concept)

2017/4/17 | # 38

<AR>

HoloLens, Microsoft (Demo)

2017/4/17 | # 39

<AR>

Magic Leap

2017/4/17 | # 40

<Interface>

Manus VR

2017/4/17 | # 41

<Interface>

Project Soli, Google

2017/4/17 | # 42

<Interface>

MYO, Thalmic Labs

2017/4/17 | # 43

<Interface>

Eye Tribe

2017/4/17 | # 44

<Interface>

KOR-FX

2017/4/17 | # 45

Discussion

• High-quality MR devices are coming …

• Lack of contents & applications VR : entertainment (game, remote experience, …) AR : life assistant (info. provider, virtual surgery, …)

• VR : indoor application• AR : everywhere application

2017/4/17 | # 46

My Vision

• AR memory palace

• Unified AR framework Ubiquitous

• Everywhere• Anytime

Intuitive• Everyone• Anything