• The Uber-Spatial Web Browser • The Clickable World Lightfield • Medical/Healthcare App • Sensoryware Games Cross Platform
II
\ •
1 w
w
MI I
1 V
V
Screentm
7 ' '
•••• •
\ •
• \
••\••
„.
••••z:`,
Sp JOM NtONdra A„I is, X 0 Yi
mnototto
\K
::
rr./
0.
. .
•
• . ';'•::••••••• ' ' • '' ' ' ' ' ' ' '
s.s.••••• ••••••• \
\,
7
'//
• ..
7 .0
1'4 u
..
• • • • • • • • .. •
•• •
...
fiiiFi
ii/1l: min
. .. . . .
• ei/
Magic Leap Sensory Weartm Music Venue Applications
Our studio will develop initial applications that will show off the capabilities of Magic Leap in the music space.
Digital Live Artisttm will "beam" an artists in full scale and digital presence into your home - enabling you and your friends to enjoy a personal
concert at home from your favorite band.
Digital Music Venuetm will "beam" you and your friends into a amazing digital space it will look and feel as if you are at a live music concert.
Magic Leap will also partner with an array of artists, labels, publishers, and managers.
ffliiiiYflfiiYfffliYfffffffffffffffffffffffff/fffff////, ......... .........
V.=
• \-4
Digital Live Concerttm
a ic Leap Sensory Weartm Systei Beta Applications
The technology demonstrated in the Speakbot app (demo) paves the way for Monster Battle
and Digital Live Artist.
The Development for Wire World & Digital Live Concert paves the way for
a multitude of other applications and tools in the SDK.
Our Users:
Persona Overview
MO
AVERAGE GAMER
Soda! Sarah Samantha & Greg
MMOG EXTREME GAMER COMIC-CON
Coe the icd Taylor the Teena9er
• • • Yryry- .. - „•, --
UNDER 6 GIRL GAMER
Average Andrew
UNDER 18 COOL KIDS
ANTI-GAMER TEENAGE GIRL OUTDOOR TH
GAMIFIED WORKER-
ara the Teenager Outdoor Owen Waiter the Worker
••/////////////////////////////////////////////////////////////////////// •
DJ Magic Mix
MUSIC CULTURE
amazon
eZz/ 044'
........ ........ ........ mm.3informs :""""- estg.
cont„ &-ftitOr6-'pattheitttottabbratof.
Sprint
•••••••••••••••••••••••••••••••••••••••••••••
Product Overview &
Design
///
•
•
•
•
•
•
• §,
Sensory Weartm System
Backlit on/off finger slide
Molded in textural pattern
*:•.•!:4r;$;r:i:%;
Sensory Wear System
•Novel technology which "paints" images on to the retina
•Reality Engine - Cinematic Realitytm Depth Technology provides for lifelike depth realism
•Blends the physical world and the digital world
Registers and localizes the world
• MAGIC LEAP
• WORLD OBJECT STATES
0 fr
MAGIC LEAP WORt41.
0 ******0
CLOUD SERVERS
Magic Leap Sensory Weartm System
USER GRID
• it
0
045 **E:36*****6004*********
Massive Parallel State Computing Cloud & Grid Network
Shared Resources To Enable World Platforms
r „as4 , v,7, /7/
%A d A iii/.
• General Purpose Wearable Computing
• Initially Targeting $65b+ Gaming Market
• Can Expand To $100b+ Mobile Comm Market
• Enabled By Proprietary Scanning Fiber Projector & True3D Technology
J
Sensorywaretm System: Current Design Families
Ma
7
......... .......... .......... ........... ............. .........................
v/‘ , r/ 'iii/ z A A A
y
z owa.
..'‘ -- --- ----
Engineering Program Management • Agile process • Task/ownership assignment • Schedule System & Software Teams • Architecture • Alpha prototypes • Integrate with Dr. G Invaders Alpha Optical Engineering • Benchtop Testbed • Optic System Simulations Industrial Design/Human Factors • ID • Personas • Ergonomics
Scx
464.4m000
.;i44W3x0.d...%
SX.:10.XX;
YI!..14f4Z*%
• 11!
xv.6.,:ekt
no?. • .....
Preliminary Component Architecture Vniumafrie. Rfinorialc
7 r ,/,
Volumetric Model OTS
ID Model Custom Integrated Parts
Components
A Design Attributes: Lite, Gamer, Extreme Gamer
Lite
Extreme Gamer
DESIGN DIRECTION ›),
"A THRO"
41;;;0*4"
.
•
%:( /..
V ... /r. ..A IA .d.:i.
' ,, .. 4:: ....... / ..:!:,:' ' •/: :- %:0::.A -V :V ...:' ../ .4.V./. .:/:: 0:/':./...
.
. A Design Attributes: Magic Glass, Organic, Minimal, Human Tec
DESIGN DIRECTION ›),
THRO CLEAR"
:::::•::"""""""""""""••••••••••••••••••""
46;7/
DESIGN DIRECTION
"CLEAR"
v
A Design Attributes: Magic Glass, Organic, Minimal, Human Tech
/, , 4f. /, .47.0 z
/W/ 0,/ /
,,,,,,,,,,,,, • ,,,,,,,, ,, ,,,,,, ,,,,,,,,,,,,,,
, „0/ "1"/
r
/7/
.• •. • . •:•:...
"
f
•z%
, - /Z // /r
••••••:!, text"'
,
•
,,,,,,,,,,,,,,,
:%%"/Afe.yhreee4f,
/:*
V
/ 40/ „, •4 / 4/i , /4/ / / 0 4
400
4
ee:
ma ' ( t er n efface
ENTERTAIIIMEP,I TOOLS NA:! GAT ON RC:A.)1j( 31' ITY
,„„„„„„„„„„„„„„„„„„„„„„„„„„„„„, 5
/,•;;',,5:;;•
VIDEO
X. X. 44.. $
5
• ;••.,:".% •
• •„.,••
HY OM VA ma ve v... me vv. OM VA
5'7A PY5 , •• • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • •••
g-p •,.44
frS, XS VS. SSC XX. XS X. OX XS SS, XS VS.
#4
44,
p NEWS"
rAPY el,. Alie HA§
VA ma ve v... me vv. OM VA AV VA OA
.ip .0 VV, OM VA Avr ve v.. ve vv. OW VA Avr
g
W.
PHOTO g
g
" FILE $
and
y
zz
;
n rn
▪ CORE CONTENT
iteratiVf •••% • ;7, e,51 e,4%%11
Determine the scope of the systei , ,3 • • ,,•;•$: 5 'v..). ••••••••
••;;;'••.•:,r,•:;y:1
_SIGN Contents and Organization_ • • Preliminary System Diagram rMX* XS X9 S. WO S. 004 JOGS X* CRS X9 S. VAS. 004.41
g. XV VV. S. VV. VSg
VS VA.. W. ...A., /A/ IV, /A* VA./. /.4 VA./ IV, 4. We /A* WVA. /A/ IV, VA./ ri..n /4, /4 .1. IV, VA./ e.
Areas of Focus
nformation Architecture / Content Organization
Navigation of Content
0 Primary navigation
Secondary navigation
interaction / Input Styles
Direct vs. Indirect / Physical vs. Virtual / Gestural vs. 7"raditiona I Etc.
0 Direct vs Proxy
0 Floating vs. Mapped
Scenario Based Brainstorming
For Example -3 User wants to connect via video with a friend
0 Context: Standing/sitting/walking
0 Environment: Home/work/public space
Social: Open vs. discrete
Aesthetics / Visualization
. Ul Philosophy
UI Philosophy
n./Inr TrA ,T
Intelligent / Empathetic (context specific)
Fun / Playful interaction (when appropriate)
Symbiotic (user aware)
Adaptable (system learns, user learns, idea of scaffolding)
just because you can do it, doesn't mean you should.
o 'wow actor" should not trump usability
Aim tor a long "wow"
omv0'0%w (.; 4.5xQ
User selects application/menu object to expand experience (experience
varies depending on the application)
A 'swipe' hand gesture brings UI 'ring' UI 'ring' presents user with into the users field of view, application/menu options (scrollable)
........
Hula-Hoop Interface
This could be the first step to opening up 'magic rooms'
Portals provide access to system contents (apps, games, tools. etc.)
Navigation or method for "drilling down" tbd
Portals can be opened on any sized object (or open space), including
small pads for discrete interactions
Magic Portal Interface
Gestural interaction used to initiate new 3D portal
Specific tools can be assigned to specific objects so that they open
automatically, eliminating the need to navigate the UI
Virtual 3D objects can be removed from the portals and mapped to objects in the room
This interaction design principle would enable users to build
virtual 'magic rooms'
........... ......... .........
•• ,,,,,,,,,
Magic Portal Interface
Expanding Hand Interface
Image recognition in the system brings
The user can select an item from up the primary navigation menu when
the menu or spread fingers to
the user holds up his/her hand
expand menus
Expanding Hand Interface
Alternatively, users can rotate through menus using a circular
gesture in the palm of his/her hand
Map to Environment Interface
........ •
Holding the gesture, the user moves his/her arm towards the
environmental object to be mapped to
Both objects are highlighted in the same color to confirm action
User opens hand to map the virtual object to the physical
environment
User pinches virtual object to be mapped and holds gesture
Objects that can be mapped to in the environment are
illuminated
Exploration of Primary Interaction
Scenario Based Brainstorming
' '/ //# 1
•
VA
Content Organization A New Platform
•
. • • • • • • • ••.x/Aw'' ..• • ... ......•.•
•
. ' .. ' ..... ' • .
•
,W;)4%;,;
:vvm.,:,0;,•„//..,//w/7/4/
Swipe the side (Sio • Spread hands apart ▪ Bring hands together
wrs;t, movements las ),)nosed to rde arm move
!•%, y
• Al aVe
• Puli hand back Swipe to the side (s ow)
• Hip hand over. sz Close hand • Siie to the sde fr-"-"a ri
Pinch- thumb to fore lint • Pause (hand, .finger,
Stab (Pont)
• we / 6( (“.Ao - Flip hang over
t Plovement
MMERS ,ON ,SRRATION Common Interaction & Input Gestures
Gesture auidethi
Intuitive
Ergonomic for a wide variety of body sizes and abilities
F"laid
Scalable / Discrete (when appropriate-
Cufturally accepted
i#1.;14,41:
MME, ,SON INSPIRATION The Aeon Project
Expanding radio menu
Icon based main menu
3d helix content management
Pop up 2d alerts
VIDEO: h tp,://v ww,yankodestn.comI2011/08/021 (-)n
be% ond-au emented-realit
MK,E, ,S,ON INSPRATION Mediating Mediums — The digital 3d
2d and 3d objects dl splays
Mapping to 2d sue faces (real and virtua l
Site recognition
Visualizing / manipulating virtual objects
VIDEO: httgiAwww,yankodesio.com/2011 /09114/virtual-
architecture/
MKERSION f IN SP RATION "Sight"
r" r i ig and mapped interfaces
Site recognition
pup tracking as a means of navigation fe, Navigation of content
VIDEO: http://www.fa odest stn co mil 670420/watch-
what-ha ens-if- oovie-s lasses-are-evi
m , ERS,O Ni i, SP RAT!O N Ringo Holographic Interface
Flu a-hoop like interface
Navigation of content
Data entry / Game play
VIDEO I: h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX
•
M , E , 3,0, / ,NsPRATION 3D Navigation with 2D platforms
3d storage navigation space
Visual grouping by subject and/or color
Organic navigation style
VIDEO I: httg://www.yout be.comiwatch 9 =r0 .•4
u4
VIDEO 2: h p://www.yo co m ANa t ?v= , xn ip7r
Organization of 2d icons l content
exilD6 ty (maybe too much?)
Personalization
VIDEO: h tp://www,ted.comitalksianand___a.garawala de
nos i bumptop
MN,F S ON / NISPIRATION .g,„„. 4 / ̀,/„, e 4
3D Organization of 2D Content
WO'
,soN i INsp RATION The Future of Firefighting
.............
:~W:1 Hand mapped interface
Layered Content
,/ Constant always availab e, easy o access, corner of user's FOV
On Demand — gestural interaction to initiate, menus to dig deeper
Alerts — pop-up style icons
VIDEO: tapillwww.youtube.comiwatch?v=QQA11122........L
.. . ......
rOE ,a0N INSP RATION Other examples
Radial menu
Scalable 3d virtualobjects
2d display of information
Floating interface
VIDEO: h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn,
r7/777/7
we" ''PO,00 o0 PZ4
......,:::::::::»
USER 1NT,„„„RA.CTON "Rooms" Scenario
Average Andrew:
• 34 years old
• Civil Engineer
• Sports enthusiast, fantasy football
Scenarios:
• Working at the office 4 message from co-worker comes in (alert)
• Select virtual "room" from living room; change from entertainment room to work room
• Open/access specific application from one room while in another room (i.e., open camera
app from the entertainment room)
OFF CE ROOM "Rooms 31
OFF CE ROOM "Rooms"
A
vex'. //// . . . . ...
,„ 4
OFF CE ROOM "Rooms"
*kw
OFF CE ROOM "Rooms
..... . ...
•
..stentit ori;tfi e;',ws
...
USER ,NITERA.CTON Navigating Rooms
;moo Scenarios:
Select a room for use
ffe Navigate from FrIt rtainment room to Work room
• r•////////////////
Physical Living Room Virtual Entertainment Room
;:i?:,;i;7;7;7;7;!;!;!:,,,,,,,,•• • • • • • • ....... • • • • :55,..V.V.V.V.,
•••••••;•,.,
USER ,NTERACT1ON Navigating Rooms
SELECT A ROOM FOR US
Work Room Entertainment Room
...............
USER ,NTERACT1ON Navigating Rooms
'AV GATE BETWEEN ROOM
777777
USER ,NTER, Selecting and/or Navigating Rooms
or. Demand: User inout to access menu system
o Gesture — i.e., hand motion up
o Button on Glasses or Pack
o Voice command
tye tracking
3D C,„„t„JST,„„„S Gesture to open icon based clusters
3D C,„„t„JST,„„„S Gesture to open icon based clusters
Provides quick access to non-functional rooms; different gesture to pull up comprehensive menu
Functional group of room based applications
Provides access to functional tools and applications while in another room; mini work station
00 Functional group of room based applications
Swipe through context specific rooms
.. ................................... .. ,,,,,,,,,,,,,,,,,,
. .
W.+
ROOM PREV1E W Swipe to navigate available rooms
Location specific rooms; rooms have previously been mapped to physical location
„OOM PREV1E N Swipe to navigate available rooms
Navigating aesthetic "skins” that have been mapped to the living room
HIE, ,R „,,HA„„ MENU SYSTEM Virtual touch pads
Navigate primary menu to access user defined rooms; rooms are a feature of the primary navigation menu
H1E„RCHAL MENU SYSTEM Input by proxy
777777
. .
........ . . . . . .
. .
CONSTANT RADIAL MENU Peripheral vision
Expandable menu always available in the upper right hand corner of user's field of view
•;;;;skhOiki:,
•
• • •
fr
•• •
CONsTAN7 RADIAL MENU Peripheral vision
Expands to reveal available rooms
•
;0050000'
PRE-MAPPED ME, S Based on physical location mapping
Projection based proxy input
•
PRE-MAPPED ME, S Based on physical location mapping
Virtual touch pad
PRE-MAPPED m::, Li Based on physical location mapping
More detailed navigation menu appears once the specific room is selected
USER ,NITERA.CTON Navigating Rooms
Scenario:
Select application for use while in a specific room
USER ,NITERA.CTON Navigating Rooms
Work Room at Home Specific Application (i.e., Camera)
DMPREHE„Si fE 'H.„„J,„„A HOOP MENU SYSTEM Open SportsCenter while in 'work' room
„,,
Access specific app while in entertainment room
Navigate existing rooms to find specific apps
„„.
g 0•0*. g
• ;:f •
Access specific app while in entertainment room
Map/copy apps into current room
Access specific app while in entertainment room
App becomes permanently mapped to entertainment room
JSE ,PPS Gesture as hot key for the most commonly used apps
Define common use apps; unique and intuitive gestures for each 'common use app'
USER 1NTERA.CTON Rooms
VVHA SAROOM?
A convenient grouping/organization of system tools and applications
Thetools/apps have a relationship that makes sense to the user
(supports the user's m nta
The rooms could be defined by: activity or goal, locationi.e,, work,
home, e c. time of day, etc.
Rooms are defined (created) by he user to support understandin
ease of use, and search efficiency
Rooms support navigation of the d iferent system tools and app !cations
Tools/apps not located within a specific room" shou d be readily
a ai rb e and easy to locate
,NT„„„,R, ,CT1ON Office Room at Home
0: //Av. •
USER ,NTERA...„,./07,0N Entertainment Room at Home
./..W/// ee-- xxxxeeeee effee effeeffeefee xxxxxxeeeee effeeffee
'' ,
•
iq]
USER ,NTERA,..,„,07,0N Entertainment Room at Home
4,4><4,4.4a0.44Venj,444,07:W
POIV4444r!,//n,04;
?.:40$'44%.,, 4 4;•$-';
7,;41<r:P e'Pr;
444;$P1-
::::gEgESEggg
„„„„„OfloilOtt-
.44,40:47,,,,,m444440:44f444400000
441,44ral ogtve
USER ,NTERA...„,./07,0N Entertainment Room at Home
•
zezelf/Xeg"
r;r4:4,1
emeememeeeee
V .,,,..•,, A0,,,,,w.,,4,44,,,„,,., , "pop
aSCUSSION Rooms
' ROOMS, EAS:
Users create rooms based on how they think features should be grouped
eature of the system)
-111 system provides pre-populated rooms based on a theme: activity based,
location based, time based, intelligence based, etc.
Combination of system and user defined rooms
,,„„,JSSION Next Steps
NEXT S i,t5dREAS OF Fa US:
Deeper dive on interaction methods for:
Primary and secondary navigation
Set a KA customizatior of menus, dashboards andother content
"Room setup and e-a-= res
Features AND furth r ap enab apps
Exploration and definition of toy B
Create workflows for primary tasks
Determine level of fidelity for next round of deliverables
'frPAgffw,, yew ;4'%gs%oPot,4%
Swipe the side (Sio • Spread hands apart ▪ Bring hands together
wrs;t, movements las ),)nosed to rde arm move
!•%, y
• Al aVe
• Puli hand back Swipe to the side (s ow)
• Hip hand over. sz Close hand • Siie to the sde fr-"-"a ri
Pinch- thumb to fore lint • Pause (hand, .finger,
Stab (Pont)
• we / 6( (“.Ao - Flip hang over
t Plovement
MMERS ,ON ,SRRATION Common Interaction & Input Gestures
Gesture auidethi
Intuitive
Ergonomic for a wide variety of body sizes and abilities
F"laid
Scalable / Discrete (when appropriate-
Cufturally accepted
.00:::.00fti.:00tifOpAvit.
MME, ,SON INSPIRATION The Aeon Project
Expanding radio menu
Icon based main menu
3d helix content management
Pop up 2d alerts
VIDEO: h tp,://v ww,yankodestn.comI2011/08/021 oin
be% ond-au emented-realit-
MK ,E, ,,S ON 7 INSPRATION Mediating Mediums — The digital 3d
2d and 3d objects dl splays
Mapping to 2d sue faces (real and virtual)
Site recognition
Visualizing / manipulating virtual objects
VIDEO: httgit,„vvywyankodesign.com/2011 /09114/virtual-
architecture/
MKERSION f INSP RATION "Sight"
* r=~lo tirng and mapped interfaces
Site recognition
tracking as a means of navigation
Navigation of content
VIDEO: http://www.fa stcod esigp .co mil 670420/wa tch-
what-ha ens-ifµ oovie swryiasses-are-evi
OV"
ERSJDN / 4NSP RATION Ringo Holographic Interface
Flu a-hoop like interface
Navigation of content
Data entry / Game play
VIDEO I: h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX
3d storage navigation space
Visual grouping by subject and/or color
Organic navigation style
VIDEO I: httg://www.you t be.comiwatch 9 = r 0 ,C4 % 6
u4
VIDEO 2: h (,.;ortilwatc; ?v=!', , xn ip7r
MNE, 3,0, / sPIRATION 3D Navigation with 2D platforms
.464Y ,zzZ,
M ,E, ,S,ON f NSPI RATIO N 3D Organization of 2D Content
Organization of 2d icons l content
F exilD6 ty (maybe too much?)
Personalization
VIDEO: h tp://www,ted.comitalksianand_a.garawala de
nos
,s/oNi INsp RATION The Future of Firefighting
Hand mapped interface
Layered Content
Constant always available, easy to access, corner of user's FOV
On Demand — gestural interaction to initiate, menus to dig deeper
Alerts — pop-up style icons
VIDEO: http://www.youtube.comiwatch?v=QBAnr2g
MK,E,S,ON INSP RATION Other examples
Radial menu
Scalable 3d virtualobjects
2d display of information
Floating interface
VIDEO: h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn,
, r 7 7 6'6
z
717
Core Technologies Scanning Fiber Projector
• 1 mm x 9mm • Low power consumption • Near zero weight • High-resolution RGB
• Natural 3D Cinematic Reality • Breakthrough technology solves 100+ year
old stereoscopic 3d problem • Proprietary Machine Vision Portfolio
• Breakthrough tech developed at NASA
confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
nfid sri 6
. /
/7 ''. '.ra .::. '.. ' '' ... .:..;:. :- ::?.... , ''''''
4,0 0.44//°4 / e
A /
/
////
/
/ /
A
7. 7 74.: • • / .././##:0
AO 7 • o ••%' 0';,.0 //4.
r 4r „.., im , r , ,„„/„„ , 7 v„
A d A % A /4 A // • r/ z ; , A
r4r,r „‹, ,
r, , , , , //4
M S17•/ V fj2', '/ SS
% r r,e 4, J't • • • • •
A0
confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
•
7 7,,„ , 7 r 27//, /77/
A /d z / , M
• Complete Wearable Computing Platform & Ecosystem
• Magic Glasstm See-Through Display
• Focus on Gaming/Entertainment • $500b+ Mobile Computing Market • Enabled By Proprietary
Ultralightweight projection And True Lightfield Technology
• Natural Blending Of Digital And Physical Worlds
confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
„, • Overview
. .................................
confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
Additional Game Applications
Ma
1
.
j.
0*
• 4/ / 4./
• • 4,4
e-55 Z5= OZ555: ////////: Ak/4/444.y.../~/...; /444.4,44.4..../.44/44.4/4,
•
- „„,,,„„„„, „,„ '' ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, , , . „..„A
4/11 f'A
01
•
•Wee•f(*, /We 7.... .4, '''''' ''''''' '''''''''''' ''''''''' ' ''''' '''''''''''''''''''' '''''''''''''''''''''''''' '''''' A
V;53., ,97///7•/A14,//////////..1.1.14446w. 44, ezeAvir.i.iiikir.,,totototov.e.ow........" %WV', ,
""" '''''''''''''''''' ''''''''''''''''''''''''''''''''''''''''''''''''''''
;>.
•
.V"
Virtual Mods Digi/Phys Blend
Dr. Grordborts Invaders • First ever true 3d/ lightfield interactive game • Existing cult fan base around Dr. G's awesome
ray guns • Invaders can expand into massively multi-player
franchise (ex: Halo) • Novel Physical/Digital Experience • Virtual Mods • Novel game engine concept virtual bots use
real Al in the world • User — character interaction is key • Stress tests and helps develop our SDK!
. . . wz. • • %. nyy, • :4;
: • •
„ „ . . . . . . . 4. • • • • • •
?;"
VLU N ,,,NsoRywAR
• Setmtrywigre System Attd Seasormetre
%old briitg ti.> life tile ni4c tha you have tway
n't(nit% nrld Ac
• Rod tfie. Averoto, add have tleLof your
yen,' own!
r411.0:,d 6. WEI
ENSORYWAIRE rIASS ES
z.
ic E P S
ENSORY E , TEM
MTN§ IOUS DESIGN STYLE
•
/„. r;// /4 „„„„„„„„
-....., \
\\— •••••••••••...............:::::::.:::::::.:•: \-:....;,ii:::i::::::.:..i.i.R.,:.:::::::.m
.: \ •
......,..:'.7.:::-ii::.:.
"'" ":,...,:. ''''.'•' '
.....s. ..; ''''
, \ ''\\
\
"%*,
...: •:: :;?,.,..: \
• .5 4'.
Strp Oi
Rad aloud from your Book Of Spollint
Sop Um-
Wave &aougyveaNI, Wand % 4.6 dltrigiu
motiom
SKt Thrtz'
Yon •very own tw.,41h wjrat!
The Book Of Spells
• Technology is magic • Wands that work! • Huge Magic Leap tentpole franchise potential • "iTunes" store for digital spells create, share,
sell • Physical and digital sales • Novel Physical/Digital Experience
SENSORY USER NT R CI101 magic lea
shidk
e rAP,S4?
0( ...$42, / p. 9 0. „.!. • ...9* • ...
Grocery S opping Scenario Workficr
A mother and her child go grocery shopping together, and decide to use Sensoryware to mak.e their experience more efficient, e f•i3ctive and enjoyable.
Scenario Workflow
Morn, with her daughter in tow, grabs a cart from the entrance of the grocery store.. A series of relevant apps launch automatical including:
Grocery first (or en zed by user defined criteria, dinner recpes)
Coupon book
Recipe book.
Recipe builder
Cost of shopping cart
.... .... . . . . . . ... . . . .
.... . . .. „,. •••:„. .„.„.•
Scenario Workflow
While in the produce section, morn weighs a food item on a scale. The price of the item is automatically entered into the .shopping cart cost totals Additional features of the system are seen in the background
The 'smart grocery list is automatically updated based on location (e.g. focused on fruits and vegetables in the produce section).
Food items on morn's list are visually hi. hiighted in the scene.
her virtLiai food items and Points are added to the child's score as she dentif
Workflow
The child launches a scavenger hunt ,ipp to make b& shopping experience more engaging end educational. The challenge is to locate food items from different countries around the
/ /
1 %• • r;" • •.• • • ;. • . ••
;••• eA % . • /
.... . . . . .....
•
•"'
Scene 2b
4
Scena10 Workflow
In the cereai aisle, mom salads a particular mrea! explore additional meladata, including:
Dietary restriction;:i
t\lutritional information si.ars)
R*of.luct revie,„Ais • odurA comparisons
Customer comments
Available coupons are pref.iented to her by Tbuc
...
0
ss•
0
•
Workflow
At the end of an aisle; a virtual Mario Bataii demonstrates a simple recipe b custorners the necessary ingredients are available in the end dap,
Scenario Workflow
A
f f f
.. . • . •••••••••••••••:,:,:••x,x.x.x
While in the we section of the grocery store, morn decides to search for a specific wine. A virtual map used to navigate to the desired wine..
While -walkng through the aisles, data appears attached to different wines, including
Recommendations from friends
Wines that appear on her personal wine list
.444444444444444444444444444444444444444444444444.144444,,,,,,,,,,,,,
it it it it it it it it it it it it
......66666666666666666666666666666666666666666666666666666666666666666666666666666666666e.466666666666.6.10:0" ...... . Me.,..5 666666666666e
Scenario Workflow
Morn concludes her sno ping experience by walking onto a Magic Leap checkout map, which rings up all the groceries on her list and mentions any items that may have been for
She then czmpletes her check- out through a virtual display ----no crt:3dit card necessary.
,,,,,,,,,,, vs,
• ••••••••• • ss,
Grocery S A A
S‘arAi-AA 7*-0 0." %AI"
Scenes inciuded:
Virtual bookstore (1 scene)
. urgicai procedure (4 scenes)
Yoga .1 scene)
Garnified exercise scene)
Garnifie worker ( scene)
04.
awnwrmw..vz.z.z.z.z.z4mAmr•z4A4.,v,v,vx,,vx.v,z,,v,vx.v..vx,,vx.v..vx,,vx.vx,,vx,
Workflow
Stella operi...3 Up her book totem to reveal an imrnersive virtual bookstore experience.
The virtual environment combines the convenience of an online txyAsiore with the experience of e environment.
;ggittglailik„1„,1_,
Scenario Workflow
A surgeon and his team, including a visiting virtual surgeon, conduct. a pre-operative planning session for an upcomng mitral valve replacement procedure.
The patient's pre-mapped anatomy is available in 3D for the teem to analyze during the planning.
..... ...... ....
Scenario Workflow
Duhng the procedure, the surgeon is able to reference the pre-mapped 3D heart for improving placement accuracy. Meanwhile, a medical student is able to observe virtually from her classroom..
The patient's information is readily available to confirm the pathology; and avoid any critical errors.
•
4. • 4444.:
Scenario Workflow
DUring a post-operative meetin the surgeon is able to describe how the surgery went using a cross section of Stella's virtual anatomy.
Stella's husband is able to join t meeting virtually whiie et work.
Scenario Workflow
When everyone leaves the hospital room, Steile is be to changer her environment to e more comfortable setting, the beach.
Stella and a friend join a virtual -oga dx.:;F; from the comfort of her
room,
Norkflow
Workflow
Stella enhances her indoor training with a virtual bng experience, where she can feet like she's biking outside on her favorite, route,s.
She is able to track important stat like ride time, distance traveled, and speed. A virtual avatar allow; her to compete with h& own personal best time,
Workflow
A landscaoir enhances hs job with a virtual game, where the is to follow a virtua mapped pattern.
F'onts are received .for accurately following the pattern and 'lifting certain score multipliers before he disappear.
SEs ‘-.A,,,RY\NA.;\E mactiC .
ditr4 a
K EY R D
litutefeW
&e 5 itelik rte
7;aa
. . ........
MC) USE
fjPER STONE
.,50-0/1 Wheel
R N GS
4 a
wh elahn, AAA/
'TINY TOTEMS"
/led- if,
Other ideas
• Plants - For high-dimensional representation of information, map content to familiar nature shapes. Natured encodes vast information in trees, grass, etc. Ex. let each person in an organization have a virtual "plant" they can tweak. They give the plant to the leader, and they encode the color, shape, leaves, flowers, etc. of the plant with their status. If overworked, could be withered, if unhappy leaves could fall, if no resources leaves turn brown, etc. Leader can put all the plants in a "garden." He gets high-bandwidth view of organization through general color of garden. Spotting problem/positive groups is easily graphically. The people
grow their own plants.
Other ideas, cont'd
• Plant as e-mail - Let e-mail be a tree. Branch is a person, leaves are messages. Old messages are brown and eventually fall to ground. Twigs, sub branches are determined by connectivity of CC's or something. User can easily "prune" branches from annoying people, or put those branches on the back of the tree.
Magic Leap: Pocket Totem Concept Virtual Plant
Pocket size (with Sensory Wear) Physical Totem
"Mini Pot"
"Fr
Virtual Plant will response to: Time Day or Night Sun light direction Temperature Attention -Voice -Virtual Water - Virtual Fertilizer --Tweet or Text messages from distance
Over Time a Virtual Plant will grow out
Magic Leap: Pocket Totem Concept
Virtual Plant
(with Smart Phone/Tablet)
Flower opens with a message when the product is ready. Builds up
anticipation through the process „.. ..„
Card Scenario
Capture Image, on a Card
••••••:‘,
Billboard Scenario
'Building size Giant Flower blooms ee/
Captiitelmage on, a Large fwilding size:
"""""" rd • , ..... • .
Tablet