Multitouch: FTIRMultitouch: FTIR

Jason MorrisonJason Morrisonjason.p.morrison@gmail.comjason.p.morrison@gmail.com

Matthew KampschmidtMatthew Kampschmidttalikan@gmail.comtalikan@gmail.com

More Multitouch from Jeff HanMore Multitouch from Jeff Han

Even More Multitouch!Even More Multitouch!

What is FTIR?What is FTIR?

What is FTIR?What is FTIR?

Frustrated Total Internal ReflectionFrustrated Total Internal Reflection

What is FTIR?What is FTIR?

Frustrated Total Internal ReflectionFrustrated Total Internal Reflection Say what, now?Say what, now?

http://cs.nyu.edu/~jhan/ftirsense/

……and multitouch?and multitouch?

What’s FTIR gotWhat’s FTIR gotto do with that?to do with that?

The Basic IdeaThe Basic Idea

Build a tableBuild a table Rear-project an image on itRear-project an image on it Mount infrared LEDs for FTIRMount infrared LEDs for FTIR Infrared camera to track fingersInfrared camera to track fingers

http://digitalstratum.com/programming/ftir_build

http://digitalstratum.com/programming/ftir_build

http://digitalstratum.com/programming/ftir_build

Related developmentsRelated developments

Single touchSingle touch– GesturingGesturing

More expensive multitouchMore expensive multitouch– iPhoneiPhone

FTIR hits a sweet FTIR hits a sweet spot:spot:

Cheap, large format,Cheap, large format,

multi-user installationsmulti-user installations

Table ConstructionTable Construction

Acrylic or polycarbonateAcrylic or polycarbonate InputInput

– Infrared LEDsInfrared LEDs– Compliant surfaceCompliant surface– Infrared cameraInfrared camera

OutputOutput– Digital projectorDigital projector– Diffusal surfaceDiffusal surface

Enabling TechnologyEnabling Technology

Direct tactile UIDirect tactile UI Intuitive gestures, ZUIsIntuitive gestures, ZUIs Concurrent multiple usersConcurrent multiple users Can be used right now! (kind of)Can be used right now! (kind of)

Areas for DevelopmentAreas for Development

Hardware questionsHardware questions– Compliant surfaceCompliant surface– LED interface optimizationLED interface optimization

Areas for DevelopmentAreas for Development

Software developmentSoftware development– Blob detection: Touchlib is good,Blob detection: Touchlib is good,

GPGPU is better?GPGPU is better?– LibrariesLibraries– Tools (VVVV, processing)Tools (VVVV, processing)– Bridges (FLOSC)Bridges (FLOSC)– AbstractionsAbstractions

Areas for DevelopmentAreas for Development

Gesture standardsGesture standards– FingerworksFingerworks

http://www.fingerworks.com/http://www.fingerworks.com/userguides.htmluserguides.html

– CommunityCommunityhttp://nuigroup.com/forums/http://nuigroup.com/forums/viewthread/95/viewthread/95/

Other interactive tablesOther interactive tables

http://www.iua.upf.es/mtg/reacTable/http://www.iua.upf.es/mtg/reacTable/

http://www.whitenoiseaudio.com/touchlib/http://www.whitenoiseaudio.com/touchlib/

Questions?Questions?

Jason MorrisonJason Morrisonjason.p.morrison@gmail.comjason.p.morrison@gmail.com

Matthew KampschmidtMatthew Kampschmidttalikan@gmail.comtalikan@gmail.com