Student: Jennifer Wong Advisor: Kris Mun

Interactive Spaces and Technology:

& a guide to working with the kinect.

2012SpS

b

p a c e

y

S p a c e

Interactive Spaces and Technology:

Connecting people through Physical Social Interaction and Virtual Space

table of contents

:: project introduction

1

:: research

10

:: technology “how to”

12

:: conclusion

13

project introcutionreason

#storefronts #vacancy # urban_street_scape #urban_development #kinect #virtual_spaces #tangibility

proposal brief Vacantstorefrontsarebecomingincreasinglypressing

problems,especiallyintoday’seconomicclimate.Astudydoneby

theReitveldAcademyinTheNetherlandsareidentifyingthatagood

numberofstorefrontsandretailspacesaroundtheworldarebeingleft

uninhabitedduetohighrentalratesandalessenedneedforaphysical

shoppresence.Manybusinessesareforcestoshutdownbecauseofa

lackofsalesduetonotonlyadownedeconomy,butalsoadecreasein

foottrafficinurbanareas.

Urbanareasareslowlyfadingbecauseofanincreaseinonline

communicationandmediaculture.AsWilliamMitchellnotedinhis

article,E-Bodies,themovementtotheweballowsforplaceandtime

AdressedupstorefrontwindowintheUKusedasawaytochangethestreetappearancetolookmorelivelyafteramajorityofthestoresclosed.

tobecomeincreasinglyunlimited.Moreindividualsarespendingtime

online,socializing,workingandpurchasingathome,andspending

moretimeentrenchedinthedigitalworldviatheirmobiledevices.

Walkingdownthestreets,youcanfindmultiplepeoplestaringdown

attheirdigitalcommunicationdevicesoversocializingwithindividuals

aroundthem.

Thisprojecthopestotakeadvantageoftheembeddedideaof

technologyinourlivesanduseittore-vitalizetheurbanstorefronts.By

takingthesevacantstorefrontsandinfusingthemwithcommunication

andinteractiontechnology,wecanturntheseabandonedspacesinto

atactilemodernvirtualspaceforsocialization.

Thisprojecttakesalookathowthenewandfuturetechnology

oftheMicrosoftKinectand3DProjectionHolographictechnologycan

createanimmersivesocialexperience.Thesedigitalspaceswillbe

linkedtoavirtualnetwork.Individualscanoccupythesevirtualsettings

andbecause‘virtualized’.A3Drepresentationofthemandanyother

individualsonthenetworkwillbebroadcastedoutsothatthesame

ThenumberofclosedandvacantstoresinNewYorkCity,thenumbershavebeensteadilyrisingthroughouttheyears.

socialgatheringcouldappearallaroundtheworldatthesametime,

bridgingspaces.

Anetworkofaudioandvisualsensorswillvirtualizeanindividual

andconnecttheminamoresocialandhumanisticwaycomparedto

themorecommononlinecommunicationssuchasChatRouletteand

SmallWorld,aFacebookapp.Individualswouldmeetinasocialsetting

intheirrealphysicalforms;beabletointeractwitheachother;and

manipulateeachothers’physicalspaces,creatingaphysical-virtual

socialexperience.

ThroughtheuseofthecapabilitiesofaKinect,aimagemapped

3Dmodelcanbecapturedandprojectedonasurfaceasa3Dimage.

Thenthroughtheuseofaudiosensorsanddevices,conversations

canberelayedthroughthenetworkinthesamemediumtheywere

delivered.Thenetworkofspaceswouldsimulateasingularroomwith

multipleindividualspresent.Theintentionistocreateatactileand

physicalvirtualsocialinteractionthroughthemergingofthephysical

andvirtualspheres.

diagram

** Idea:

To make the newly vacated spaces a space for social gathering among people from aroun the world. Reclaiming the urban street facades as areas that will be the beginning the engagement and communication with people from around the world.

Amsterdam Los AngelesShanghaiNew York

Virtual Enviornment in retail space connected on a worldwide network

idea diagram

** Idea:

To make the newly vacated spaces a space for social gathering among people from aroun the world. Reclaiming the urban street facades as areas that will be the beginning the engagement and communication with people from around the world.

Amsterdam Los AngelesShanghaiNew York

Virtual Enviornment in retail space connected on a worldwide network

composite

new technology

research

#kinect #holographic_imaging #head_tracking #hand_tracking #projection_techniques

“TheprototypeforMicrosoft’sKinectcameraandmicrophonefamouslycost$30,000.AtmidnightThursdaymorning,you’llbeabletobuyitfor$150asanXbox360peripheral.”

Camera TheKinect’scamerausesbothhardwareandsoftwaretogeneratetwodifferenttypesofimages.1:3DmovingimagescapturedbydepthsensorsusingreferencepointsthataremappedintothephysicalspacebytheKinect.TheKinectusesinfaredsensorssothatlightdoesnotaffectthe3Dimageproduced2:2Dimagesofthefieldofviewcapturedbyacamera,thatcanbelatermountedonthe3Dcapture

Firmware TheKinectusesalgorithmstoprocesstheincomingdatacaptured

Microsoft Kinectoverview

throughitsinfaredsensorstotranslatethedataintoa3Dmodel.Thisfirmwarecanalsodistinguishhumanbodiesthroughparts,joints,movement,andevenfaces. ThisishowtheKinectdistinguishestheinformaitonitrecievesinordertoreactappropriatelywhentherightgesturesaregiven.

ProducedbyArsTechnica:

TheKinectforWindowsSDK,abetaversionofwhichisalreadyavailabletodevelopers,isbeingpreparedforacommercialrolloutinearly2012.

Thecurrentbetaversionistargetedatacademics,enthu-siasts,andresearcherswhousethemotion-sensingcapabilitiesoftheKinectforXbox360technologytocreatenewapplications.Kinectappshavealreadypoppedupinhealthcare,education,andotherindustries,Microsoftnotedinanannouncementtoday.Despitebeingdesignedforvideogames,theKinect—whichhas600patentsbehindit—hasmovedbeyondthegamingworldbothbecauseofitsusefulnessanditsprice:theKinectletspeoplebuyadevicewith3Dmotioncapture,facialandvoicerecognition,microphones,depthsensors,andanRGBcamerafor$149.

Whilethesoftwaredevelopmentkitreleasedearlierthisyeartargetsnon-commercialprojects,Microsofttodaysaid“theKinectforWindowscommercialprogramwilllaunchearlynextyear,givingglobalbusinessesthetoolstheyneedtodevelopapplicationsonKinectthatcouldtaketheirbusinessesandindustriesinnewdirec-tions.”Microsoft’sannouncementdidnotdetailthetermsunderwhichtheKinectSDKwillbereleasedcommercially.

Microsoftofficialsalsodiscussedtheforthcomingcommer-cialSDKwiththeFinancialTimes,whichdetailstheMicrosoftpilotprograminvolving“morethan200companiesforuseoftheKinectacross25industries,fromhealthcaretoeducation,advertisingandtheautomotiveindustry.”

Forexample,Toyotadevelopedavirtualshowroomallowingcarstobeexploredwithgestures,andaSpanishtechnologygroupcalledTedesysisusingaKinectdevicelinkedtoaPCandmoni-tor,allowingsurgeons“towavetheirwaythroughpatientrecordsonscreenduringoperations,”theFinancialTimesnotes.Microsoft

Microsoft KinectSDK for windows article

XboxofficialAlexKipmantoldthepaper“12monthsfromnow,edu-cational,academicandcommercialapplicationswilllooknothinglikewhattheyaretoday.”

TheKinectforWindowsSDKbetaincludesdrivers,APIsforrawsensorstreamsandhumanmotiontracking,alongwithmorethan100pagesoftechnicaldocumentation.Itistargetedatdevel-operswhouseC++,C#,orVisualBasic.KinectapplicationsaredesignedtobeusedinconjunctionwithWindows7,andpresum-ablytheforthcomingWindows8willreceivethesametreatment.

------

TheindustrystandardofusingtheKinecthasincreased.ThepoweroftheKinectisslowlystartingtobeutilizedandintegratedintoalldifferentfields.

Holographic projection

programming4fun--YouTube

head tracking

JohnnyLee(johnnylee.net)

Johnnyhascreatedaprogramthat’sapieceofcodefordevel-operstoworkwithusingC#DirextX.Thesoftwareneedstoknowyourdisplayandsensorbarsizeandwillhelptrackthemotionofyourheadasyouweartheglasses.

Hisinstructions:

1.ConnectyourwiimotetoyourPCviaBluetooth.Ifyoudon’tknowhowtodothis,youcanfollowthistutorial.I’vebeentolditworkswithotherBluetoothdrivers,butIhavenottestedthemmyself.2.DownloadtheWiiDesktopVR(v02)sampleprogram.ReadtheRE-ADMEfileonprogramusageandconfiguration.Launchthe“WiiDesk-topVR.exe”inthemainfolder.Apotentiallymorestable/Vista/64-bitcompatibleversionhasbeencreatedbyAndreaLeganza.Therealsomaybemorevariantsontheweb.

TheCodeisbuiltupontheWiimotelibrary.

>Canusetheideaofstereoscopicdisplayswhenlookingatthescreenwiththeuseofshutter/polarizedglasses.Thisworksbetterwiththeheadtrackingsothatyougetasenseoftherealdepthandthechangeintheperception.

1. Technical stuff: Kinect.

>>fortheKinect,thelocationbechangedtoacornerasopposedtohavingthemasastraightonshotwhichwillprovidebetter3Dimagingtobeused.Thatwiththeuseofsomeothersoftwareandopenwareprograms,Iwouldbeabletocreatehandlesina3DenvironmenttomovetheKinectcaptured3Dmodel.

Tocreatea3Dobjectthatcanbemanipulated,Ishouldtrytheprojectionofthecompilationonablackperforatedscreen.OnecatchwouldbethatIwouldneedaprojectorwithahigherluminoutputtoaround3,000fromthenormal<2,000thatmostprojectorsget.Theincreaseincontrastratiowillmaketheshadowsappeardarkerthanifitweretobeprojectedontoascreengivingabetterfeelingofthedepthofanimage.

Project addition

2. Moveable floor.

>>ideaofthefloorbeingmadeupofindividual3dimensionalpixels,alsoknownasvoxels.Thesevoxelswouldcontaininformationandberesponsivetotheindividualsinvolvedinthecommunication.Thesevoxelswouldnotonlybeabletobemanipulatedbetweentheusersasaninteractionpiece,suchasmovingpiecesupanddown,changingcolorsorwavesthroughtheroom,butthesevoxelswouldbeabletobemanipulatedsothatseparateroomsandspacescouldbecreatedformoreprivateconversations.Theconstructionofspacesinthegivenareaiscompletelyleftopentotheindividualswithintheroom.

3. Sound.

>>twosolutionstothesounds,bothofwhichprovidesoundtosuchanamazingquality.Hedescribedthetwotypesofspatialaudiothatisavailable,wavefieldsynthesisandambisonics.Wavefieldsynthesisisasingularlongspeakerthatisabletoproducesoundathighspecificityand‘shoot’ittopointsofaroomsimilartoalaser.AmbisonicsistheuseofmultiplespeakersthataredelayedwithcertaintimingthatcanbecontrolledwithOSC(opensoundcontrolandcanuseOSC-ulator).

4. Interaction

>>themoreinteractionbetweentheindividualswitheachotherinadigitalbutyetphysicalsensewillstarttoinfluencetheusersideaofarealinteraction.Themainpurposeoftheprojectistopromotetheinteractionbetweenindividualsevenwithagreatamountofdistancebetweenthem.Theseinteractionsshouldcauseemotionsandresponsesfromtheindividualsastheycommunicatewitheachother.Theunderstandingofinteractionswillgreatlyaffectthesuccessorfailureofanypublicurbanproject.

technical

Before the progression of the project there are a few things I needed to look at and address:

How is this related/relevant to architecture?

Theuseofthetechnologyinordertoaffectthewayaroomfunctionsandbehaveswillchangethewayarchitectureisdesigned.Whenaspacetakesontheideaofbeingamultiuseroom,butremainsasis(asquareorrectangle),architecturebecomesthedesignofsomethingsosimpleanyprogramcanfit.Butwhentheprogramcanstarttoalterthespatialconditions,therearenowanewsetofvariablesthatarchitectscanstarttomanipulateandunderstandformakingmorehumanconnections.

Inthisproject,themanipulationofspaceisonlyonequalitythatwillchangethewayarchitectsseespaceasbeingmoretemporal.ThenextistheuseoftheKinecttoexpandroomsandspaceswithouthavingtoactuallyexpandthespaces.Theperceptionofalargerspacewillalreadychangethesocialconditionsthatmostpeopleareusedto.

How is this going to revive urban space?

Withmoreandmoreurbanspacesbecomelesshabitedbecauseoffewerinteractions.Bybringingadifferenttypeofinteractionintotheurbanspace,agreaterdrawofbeingabletocommunicatethroughafullbodyexperiencecanengagemoreindividuals.

Bytakingcommunicationoutofafullydigitalspaceandintoaphysicalspace,theinteractionsbetweenindividualswillstarttochangeanddrawinterestbecausethisphysicalhumanizationofpeopleinadigitalwaywillstarttobringpeopleoutfromtheirhidingspotsinourdigitaltechnologydrivenworld.

What is really real?

Realityisastateofperception,weknowthingsarerealbecausewehavebeentoldthingsarereal.Throughafullbody,communicationandexperientialinteraction,theonlythingthat

bigger picture questions

seperatesthattypeofdigitalinteractionfromaclaimed‘real’lifeinteractionistheabilitytotouchaphysicalbody.However,theentireexperience,emotion,andviewisarealone,astheyarethroughdigitalspacethatisnowtangible.Canyouprovethataninteractionlikethatisunreal?Whenpeopleareexposeddigitallybyshowingthemselvesastheyarewithrealvisiableactions,theyareasrealasanyoneelsecomparedtodigitalinteractionfrombehindanavatarorcomputerscreen.

What’s next?

Technology,especiallyonesthatelicitresponsesfromhumansareasteadygrowingtrendinsociety.Byaddressingthistrendearlyon,architectscanstarttogainabetterunderstandingofwhatallthismeanstotheprofession.TheKinectwillendupplayingamajorroleinmanyindustries,havingalreadybranchedouttothegaming,automobileandmuseumindustries.

ThefutureoftheKinectinarchitectureisincrediblebecauseitcanliterallycaptureapersonoranyspacein3Dtohaverecreatedina3Dsoftware.Thedevicecanliterallyturnthephysicalworldintoadigitalone,removingtheideaofdistancebetweenpeople,objectsandspaces.However,notonlyisdistancenolongerafactor,butbecausethedigitalisaccessibletherestrictionoftimeisnolongerandissue.

Inasense,formisnolongeranissueeitherinthedigitaltechage.Theincreaseinuseofmoveableandmaleablespacestofittheusersneedsandwantscanstarttohappen.Theabilitytochangeaspacewiththeclickofabuttonorthetouchofascreenwillrevolutionizethewaywehavetopercievewhatspatialdesignwillbecome.

max / mspUnderstanding Max/MSP

Thispieceofcodewasdesignedtooutputalivecamerafeedaswellasthe3Dcapturefeed.YouareabletocontrolthenumberofKinects,thedegreeoftilt,thenumberofdegreesofdepthandthetypeoffileoutput.

correct code design:

incorrect code design:

ThispieceofcodingwasanadditiontoPelletier’soriginalcodeIrecreatedontheleftside.However,Itriedtocreateaconnectiontoaddasecondconnecttothestream.

TheProblem:

ThelaptopwouldconfusedtheKinectswithbeing#1and#2.BecauseIwasusingaportsplitter,therewasnowaytodetermineifthisfileworkedwithoutgettingacomputerwithmoreUSBhubs.Theprogramwouldonlycaptureandstreamfromonecameraatatime,andneverfromthesameone.

code design for: adding a 3D model

Scale

position rotate

properties

connection your 3d model

3D model integratedonly worked with a duck preset model

project 3d imaging Tostartoffsimple,Myleshadrecommendedastyleof3Dprojectionimagingthatiscommon,simple,fastandcheap.Theuseoftwoperforatedmeshscreenslayeredinadarkroomwithaprojectiondirectedtowardsthesheets.

Duringthisexperimentation,therewereafewthingsthatInoticed,first,theprojectorneedstobeabletooutputhighlumensorelsetheprojectionwon’twork.Withouthighlumens,thecontrastbetweenthelighteranddarkerareasarenotaswelldefinedmakingitlookflat.

stereoscopic imaging ThefirstideaofStereoscopicImagingcametomewhiletalkingtoPerryHoberman:

Thisisthecheapoptiontobuya3DTV.Thesetupconsistsoftwoprojectors,asilverscreen,2circularpolarizingscreensoftheprojectors,apairofcircularpolarizingglassesandaMatroDualHead2Go-Analogsplitter.

TheresultingexperimentlettomemakingasilverscreenoutofChromeSprayPaintfromKrylon,buyingasetofcircularpolarizingfiltersandasetofglasses.

Unfortuantelythecomputerwasunabletosplittheimageproperlysowhenitcametoputtingitonthescreen,itwasn’tlineduporworkingproperly.ThisideastillonlyworksintheoryformeuntilIcangetthetwoimagesbeingsenttotheprojectorstocommunicatewitheachother.

technologyhow - toinstruction

#Kinect #attempted #future #new_design_spaces #repurposing #incorporation

basic hackinghttp://www.freenect.com/how-to-get-the-kinect-working-on-mac-os-x

OverthenextcoupleofdaysI’llpostspecificdetailsonthehacksoanyonefollowingthathasn’tdonemuchcomputerworkbeforelikemecandothiseasily.Ihopeitwillbeaseasyasfollowingtheinstructions,butit’snotabouttheinstructionsbutwhathappenswhenyoudofollowthem.

Step 1: Download XCode, CMake and GIT for Mac OS X

> XCodeshouldcomewithyourMacasthedevelopertoolsthatcomestandardnow.Ifyoudon’thaveit,youmayhavetobuyittogetit.

> NextCMakeisaneasydownload

> CMakeisanopen-sourcesystemthatallowsforbuildautomationwhichbasicallyallowsforyoutobuild,textandpackagethesoftware.

> Finally:GIT.

> GITisactuallyasourcecontrolmanagementsystemthatisveryinterestingandveryuseful.Thesystemwasdesignedsothatmultipledeveloperscouldcodeorfixpiecesofalargercodeatthesametime.Theprogramwillthentrackandtracewhatpartsofthecodehavechangedandmaketheaccordingchangesinthemaincode.Ofcoursethiscouldeventuallyendupharmingtheothercoderifyouchangedsomethingdrasticthatwillaffecttheirpieceofcode.However,thegreatthingisthatyoucantrackwhodidwhat,soyouknowwhat’schanged,whochangeditandtheycanevenincludewhytheychangedit.

Sotostarttheinstallationandhackingprocess,althoughIwon’tbeactuallywritingthehack,I’llbedoingallthisinTerminal.

Part I is the download of all the pre-made files onto the computer.

> git clone git://git.libusb.org/libusb.git

> git clone git://github.com/OpenKinect/libfreenect.git

Part II is the start of running all the pieces of the puzzle which is where I started to run into problems.

> cb libusb

Whichisthecreationofthelibusbfolderthatwillnowbeinyourhomeuserdirectory.Ifyou’rehavingtroublewithusingandfollowingwhat’sgoingoninterminal,whatIfoundthathelpsisifyouopenyouruserdirectorysothatyoucanseeallthefoldersinit.Itwillbeusefullaterifyougetlostandhaven’tgottenusedtothesyntaxyet.

> patch -p1<../libfreenect/platform/osx/libusb-osx-kinect.diff

> ./autogen.sh

> make

> sudo make install

Whichisthecreationofthelibusbfolderthatwillnowbeinyourhomeuserdirectory.

Nextyouwilladdinginthebuildfolderintotheoriginallibfreenectfolder.Soyoumovebackoutofthesequenceandthenstartmakingthebuild.

> cd ../libfreenect/c

> mkdir build

> cmake ..

> make && sudo make install

Thenthelastcommanwillhelpyouinstallallthefolderinsidethebuildfolder.Afterallofthis,yourfilesandfolderstructureshouldlooklkethefollowingimages:

**Itisincrediblyimportanttomakesurethatallthefilesliveinthecorrectfoldersbeforetryingtoruntheglvieworglpclviewcommands.Withoutproperplacementtherewillbenumerouserrorsthatwilloccur.

downloaded master files

libfreenect files

libusb files

operationTheoperationprocedureisasfollowsusingTERMINALontheMac.

cd libfreenect

cd build

cd bin

Withinthebin folder,thereareseveralusefulopperationsrelatedtoconnectingandusingtheKinectfor.

glpclview: Thisviewgivesyouthelivecameracapturemappedontothe3DmodelgeneratedfromtheKinect’sdepthsensor.

glview: Thisviewprovidesyouwithtwowindows,oneofthelivecameracaptureandthesecondofthedepthmapincolor.

record: ThiscommandwillstarttocaptureandrecordthefeedfromtheKinect.

regview: Thiscommandgivesyouthetestofthecameraview.

registration_test_depth_...: ThisseriesofdepthtestscancheckyourKinectandshowyouthe3Ddepthmapthatisgeneratedwiththedepthsensor.

tiltdemo: ThiscommandwilltestthetiltontheKinectandshowyoutherangeofmotion.

./ glview

Inordertoexitthevideofeedbackloop,youneedtopushctrl+‘C’

*PleasetakenotethatdependingonyourRAMandyourharddrivespace,thismayseverelyslowdownyourcomputerandinsomeinstancesyouwillhavetoterminatetheprograminordertostopthefoodback.Especiallywhenusingthe‘glpclview’.

Capturefromdepthsensorfromglview.

Capturefrommainvideofeedfromglview.

processingProcessing for the Kinect involves a great

amount of coding in C++ format.

Analyzing the understanding the information and coding written proved to

be very difficult because of the high level of programming language used.

Self manipulation of the code did not seem possible because of the extensive

coding and extensive number of attached files (aka objects) used to make the code

streamlined.

http://processing.org/

max / mspUsing Max/MSP by Cycling74 was the easiest and better program of the two.

The code had previously been assembled so there was a good base to work off of and to figure out the best way to

manipulate the previous design in order to achieve a specific function.

The Max/MSP design that was used provided most of the necessary objects and

sliders. What I added to the design was a extra package to the design that would allow me to import models to manipulate and place into the 3D space that the 3D

caputres would exsist in.

http://cycling74.com/

max / mspUnderstanding Max/MSP

MytrainingforMax/MSPcomesfromPerryHobermanandMylesSciotto.

ThedesignedmaterialusedtoconnectMax/MSPtotheKinectwasdesignedbyJean-MarcPelletier:

ThewaytocreateonMax/MSPissimple.Thedraganddropmenuonthesideoftheprogramletsyousetupallthebuttons,controls,jitterpackages,etc.

BypushingtheCMD+Eyoucantoggletheinterfacebetweeneditableandpresentationmode.

Someoftheshortcutsforcreatingtheelementsare:

b - bang(sendsasignal)

c - comment(addscommentsthatdon’taffectthedesign)

t -toggle(switch)

n-newobject

p-openobjectpalette

f-floatnumberbox

i-integernumberbox

m -message

l -live(interactivepiece)

j -jitterobject(addadditionalinformationonthejitterpackage)

x -commandmenu

Jitterpackagesarepre-writtencodepackagesspecificallycreatedtoexecuteaparticularfunction.Eachjitterpackagehasadifferentsetofattributesthatcanbeappliedtoit.Theseattributescanbeseeninthejitterpackagesmenuwindow.

projectconclusionfindings

#Kinect #Processing #attempted #future #new_design_spaces #repurposing #incorporation

wrap up MyresearchforthepastsemestermainlyfocusedaroundlearningandunderstandingcomputerprogramsthatwereabletocontroltheKinect.AlongwiththatIresearchedthecreationof3Dprojectionscreensandholograms.AlotoftheworkfocusedonmyexplorationonunderstandingthetechnologyandtheprogrammingpossibilitieswitheachprogramandtheKinect.Throughalotoftrialanderror,theexplorationhasleadmetoagreaterunderstandingofthebestwaystoutilizethetechnologyandincorporateitintothedesignprocesswiththespecificdetailsthatcomewithsettinguplargescaledigitalprojectstobebuiltinthephysical.

ThemajorprogramsthatIworkedwithweremainlyProcessingandMax/MSP,bothextensiveanddifficultprogramswiththeirowntypeof‘language’and‘style’.Processingwasthehardertounderstandofthetwo,usingalanguagesimilartoC++andJavaScript,whichrequiredalotmoreskilltotapintotheKinect.Max/MSP,however,wasdesignedasgraphicinterfaceutilizingpre-madepackagesforeasierandfastercodeassemblyandunderstanding.

WorkingwiththeKinecthasbeenabitofachallengebecauseoftheheavyamountofcomputingthatrequiredinordertoprocessthecameraand3Dspatialsensorcapturesandthenmappingthecameracaptureontothe3Dmap.Theprocessingpowerofthelaptopwasunabletohandlethecapacityneededtocreatethecompilation.Thismajorproblemrestrictedfurtherexplorationontheprojectbecauseofthelimitedresources,butcanbefurtherexploredatalaterdatewiththecorrectframeworkinMax/MSPalreadysetup.

Thissemester’sworthofresearchhasledtoabetterunderstandingofhowtoutilizethefunctionsoftheKinectinordertointegratethetechnologyintoaphysicalspace.TheexplorationoftheparametersandcapabilitiescanleadtofurtherdevelopmentsandintegrationoftheuseoftheKinectforfuturespaces.

http://142days.wordpress.com