Interrelativity.com Revelationary Computing, Proactive Displays, & The Experience UbiComp Project...

interrelativity.com

Revelationary Computing, Proactive Displays,

& The Experience UbiComp Project

Revelationary Computing, Proactive Displays,

& The Experience UbiComp Project

Joe McCarthyJoe McCarthy

Connector in ChiefConnector in Chief

Interrelativity, IncInterrelativity, Inc

11 January 2006

2interrelativity.com

OutlineOutline What’s the Problem?What’s the Problem?

ConvergenceConvergence Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online revelationOnline revelation

Proactive DisplaysProactive Displays

The Experience UbiComp ProjectThe Experience UbiComp Project

Future ExtensionsFuture Extensions


OverviewOverview

Interrelativity develops softwarethat integrates sensing and display technologies

with online personal contentand promotional content

to help people relate to one anotherin shared physical spaces

Bringing the best of virtual communities to physical spaces.


The ProblemThe Problem We are We are socialsocial: fundamental need : fundamental need

for a sense of belonging for a sense of belonging We are We are shyshy: 48% of US population : 48% of US population

is chronically shyis chronically shy We want to relate to and connect with others,We want to relate to and connect with others,

but are often unable or unwilling to do sobut are often unable or unwilling to do so EvenEven at times and places specifically designed to at times and places specifically designed to

encourage connections (“third places”)encourage connections (“third places”)


The Solution: Proactive Displays

The Solution: Proactive Displays

+

OnlineProfiles

Physical Tokens

+

LargeDisplays

BetterReal-worldInteractions

=


Convergence (1)Convergence (1) Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online revelationOnline revelation


What is RFID?What is RFID?

Si

Coil

Encapsulation

RFID Transponder

Radio frequency identification (RFID) is a generic term that is used to describe a system that transmits the identity (in the form of a unique serial number) of an object or person wirelessly, using radio waves. [RFID Journal]

[Roy Want, Intel]

ComputerRFID

Interrogator

RFIDTransponder

Energy

Clock

Data


RFID in Access ControlRFID in Access Control

Buildings

Ski resorts

Countries

Containers


RFID in Asset TrackingRFID in Asset Tracking

Livestock Salmon Pets

Beer kegs Airline luggageDocuments& Folders

At school

On the bus

At the park


RFID in HealthcareRFID in Healthcare

EquipmentMedications Patients

Blood Surgical sites


RFID in TransactionsRFID in Transactions

ExxonMobil SpeedPass

MasterCard PayPass

Illinois Tollway I-Pass PowerPay


RFID + Mobile PhonesRFID + Mobile Phones KDDIKDDI

RFID RFID readersreaders Active & PassiveActive & Passive

NTT DoCoMo n901iC FOMA®NTT DoCoMo n901iC FOMA® Sony FeliCa chip (+ surround sound, card scanner…)Sony FeliCa chip (+ surround sound, card scanner…)


RFID + PeopleRFID + People VeriChip (Applied Digital Solutions)VeriChip (Applied Digital Solutions)


Convergence (2)Convergence (2) Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online revelationOnline revelation


Digital SignageDigital Signage WalkwaysWalkways

Bristol, UK

Glasgow, Scotland

Times Square, NYC

NYC Subways


Digital SignageDigital Signage MallsMalls

Mall at Millenia, Orlando Las Vegas Sandton City, South Africa

DestiNY USA, Syracuse Flasma @ The Plaza, London


Digital SignageDigital Signage TransportationTransportation

Elevators

Bus stops (Mequon, WI)

Buses (Milwaukee, WI)

Train cars, Kiev

Chicago O’Hare

Basel Airport (CH)


Convergence (3)Convergence (3) Sensing technologies (RFID)Sensing technologies (RFID) Digital signageDigital signage Online (& offline) revelationOnline (& offline) revelation


Revelation in the Physical World

Revelation in the Physical World


Revelation in the Digital World

Revelation in the Digital World

Instant Messaging Instant Messaging

WeblogsWeblogs

Social Network SystemsSocial Network Systems

Newsgroups Newsgroups

eCommerceeCommerce

Online DatingOnline Dating


Revelationary ComputingRevelationary Computing Bridging the gap between digital & physical worldsBridging the gap between digital & physical worlds

Revealing Revealing digitaldigital representations of self representations of selfin shared spaces in the in shared spaces in the physicalphysical world world

Incorporating Incorporating physicalphysical world references world references into into digitaldigital representations of self representations of self


Revelation viaProactive Displays

Revelation viaProactive Displays

Displays + sensors (+ algorithms + policies + …)Displays + sensors (+ algorithms + policies + …) Public displays that can Public displays that can sensesense & & respondrespond appropriatelyappropriately

to the to the peoplepeople & & activitiesactivities taking place nearby taking place nearby Implicit, ambient, background (periphery)Implicit, ambient, background (periphery)

Issues:Issues: Context(s)Context(s)

Where should they go?Where should they go?

Content Content What should they show?What should they show?

ControlControl How will they know?How will they know?


Experience UbiComp Project

Experience UbiComp Project

Desire for Desire for mutual revelationmutual revelation show & tell about you & your workshow & tell about you & your work learn about others & their worklearn about others & their work

Restricted Restricted contextscontexts Paper / panel sessionsPaper / panel sessions Demo / poster sessionsDemo / poster sessions Reception / breaksReception / breaks

Available Available contentcontent Explicit: registration info Explicit: registration info Implicit: homepage data miningImplicit: homepage data mining

ControlControl Register, activate and wear tags during the conferenceRegister, activate and wear tags during the conference Opt out at any time (delete profile, discard tag)Opt out at any time (delete profile, discard tag)


RegistrationRegistration


ActivationActivation


Experience!Experience!AutoSpeakerID

Ticket2Talk

Neighborhood Window


NeighborhoodWindow

Ticket2Talk

Kiosk

AutoSpeakerID


AutoSpeakerIDAutoSpeakerID Keynote/Paper/Panel Q&A “augmentation”Keynote/Paper/Panel Q&A “augmentation”

RFID: antenna (microphone), tag (badge)RFID: antenna (microphone), tag (badge) Display photo, name, affiliationDisplay photo, name, affiliation Visual augmentation of common [oral] practiceVisual augmentation of common [oral] practice


AutoSpeakerIDAutoSpeakerID


Ticket2TalkTicket2Talk Coffee BreakCoffee Break

ExplicitlyExplicitly provided content provided content SingleSingle person (at a time) person (at a time)


Ticket2TalkTicket2Talk


Ticket2TalkTicket2Talk Queue Management: balancing freshness & fairnessQueue Management: balancing freshness & fairness

Tag recency: +Tag recency: + Ticket recency: -Ticket recency: - Minimize thrashing Minimize thrashing ““5 seconds of fame”5 seconds of fame”

NumTickets

terTicketCounNumTicketsw

iodTimeOutPer

agSeenTimeSinceTiodTimeOutPerwP

i

ii

,min2

1


Neighborhood WindowNeighborhood Window Demonstrations & Poster SessionDemonstrations & Poster Session

ImplicitImplicit content (mined from homepages) content (mined from homepages) GroupsGroups of people (& their words / phrases) of people (& their words / phrases)



Neighborhood WindowNeighborhood Window TouchGraph™ visualization toolTouchGraph™ visualization tool

People (picture, name)People (picture, name) Words from homepages (and/or interests)Words from homepages (and/or interests)

N “unique” words (TFIDF)N “unique” words (TFIDF) 2(N–1) “shared” words2(N–1) “shared” words

CrawlingCrawling Only within domainOnly within domain Issues: frames, size, languageIssues: frames, size, language

PhrasesPhrases NP = [adjective]* noun+ [PP]*NP = [adjective]* noun+ [PP]* PP = preposition NPPP = preposition NP


EvaluationEvaluation Post-conference surveyPost-conference survey

500 attendees500 attendees 200 participants (registered + activated)200 participants (registered + activated) 95 respondents (61 were participants)95 respondents (61 were participants)

PositivePositive NegativeNegative No Impact / No Impact / Mixed ImpactMixed Impact

NullNull

AutoSpeakerIDAutoSpeakerID 7070 66 1313 66

Ticket2TalkTicket2Talk 4040 33 3333 1919

Neighborhood Neighborhood WindowWindow

2121 22 3939 3333


ExperiencesExperiences AutoSpeakerIDAutoSpeakerID

50% of questioners’ tags detected50% of questioners’ tags detected Introductions: oral only, visual only, visual + oralIntroductions: oral only, visual only, visual + oral Spelling, intelligibility (international conference)Spelling, intelligibility (international conference)

Ticket2TalkTicket2Talk Conversations, awareness about new & oldConversations, awareness about new & old

Amarone, kitesurfing, scuba diving, PLAY StudioAmarone, kitesurfing, scuba diving, PLAY Studio

Neighborhood WindowNeighborhood Window Similar to T2T, though more of a novelty factor Similar to T2T, though more of a novelty factor

(and more noise)(and more noise) Common acquaintances (co-authors, conferences)Common acquaintances (co-authors, conferences) ““red bishops”red bishops”


Unanticipated ExperiencesUnanticipated Experiences AutoSpeakerIDAutoSpeakerID

Ticket2TalkTicket2Talk

Neighborhood WindowNeighborhood Window ““death valley”, UbiDavedeath valley”, UbiDave


Sample TicketsSample Tickets


Sample TicketsSample Tickets


Lessons LearnedLessons Learned Prepare for failurePrepare for failure

Networking issuesNetworking issues

Prepare for successPrepare for success No kiosks like more kiosks (5% vs. 50% vs. 95%)No kiosks like more kiosks (5% vs. 50% vs. 95%)

Don’t be overprotectiveDon’t be overprotective Expect unanticipated uses … within limitsExpect unanticipated uses … within limits

Design for noiseDesign for noise Expect noise, leverage it in the designExpect noise, leverage it in the design

Limits of “informed consent”Limits of “informed consent” Conflict between statistical paradigm and UI paradigmConflict between statistical paradigm and UI paradigm


Future Work: Application Extensions

Future Work: Application Extensions

AutoSpeakerIDAutoSpeakerID Additional sensorsAdditional sensors

(floor)(floor)

Ticket2TalkTicket2Talk Queue management (> 4 people)Queue management (> 4 people)

Neighborhood WindowNeighborhood Window Mining algorithmsMining algorithms VisualizationsVisualizations


New Sources of ContentNew Sources of Content RepositoriesRepositories

DevicesDevices


New ContextsNew Contexts Digital HomesDigital Homes

Implicit sharingImplicit sharingof digital mediaof digital media

Family / visitors’ photosFamily / visitors’ photos

Digital WorkplacesDigital Workplaces Knowledge managementKnowledge management

through serendipitythrough serendipity Nameless faces / faceless namesNameless faces / faceless names

Digital Digital ThirdThird Places… Places…


New ContextsNew Contexts The Great Good Place:The Great Good Place:

Cafes, Coffee Shops, Bookstores, Bars, Hair Salons, Cafes, Coffee Shops, Bookstores, Bars, Hair Salons, and Other Hangouts at the Heart of a Communityand Other Hangouts at the Heart of a Community

Ray OldenburgRay Oldenburg


Related WorkRelated Work HighwaysHighways

Alaris E-boards(www.alaris.net)


Looking forwardLooking forward Three key issues for Proactive DisplaysThree key issues for Proactive Displays

ContextContext Where should they go? Where should they go?

– Trust, desire to relate to others– Macro & micro

Content Content What should they show? What should they show?

– Type: images, text, video, audio, …– Storage: local vs. remote

ControlControl How will they know?How will they know?

– Implicit vs. explicit revelation– Anonymity vs. accountability


Policy, Legal & Ethical IssuesPolicy, Legal & Ethical Issues ContentContent

Copyright issuesCopyright issues OffensivenessOffensiveness

ContextsContexts LiabilityLiability Ownership of Sensor dataOwnership of Sensor data

Physical association with digital contentPhysical association with digital content Risks (& rewards)Risks (& rewards) AccountabilityAccountability


CollaboratorsCollaborators Experience UbiComp Project Experience UbiComp Project (Intel Research Seattle)(Intel Research Seattle)

InternsInterns David Nguyen (Nokia Research), David Nguyen (Nokia Research),

Al Rashid (Univ. Minnesota), Al Rashid (Univ. Minnesota), Suzi Soroczak (UW Information School)Suzi Soroczak (UW Information School)

EvaluationEvaluation David McDonald (UW Information School)David McDonald (UW Information School)

Interrelativity, Inc.Interrelativity, Inc. Khai Truong, Chief Technology OfficerKhai Truong, Chief Technology Officer


For more informationFor more information Joe McCarthyJoe McCarthy

[email protected]@interrelativity.com

Proactive DisplaysProactive Displays http://interrelativity.com/http://interrelativity.com/

UbiCompUbiComp http://www.ubicomp.orghttp://www.ubicomp.org

Thanks! … Questions?

Date post:	24-Dec-2015
Category:	Documents
Upload:	philomena-greer
View:	213 times
Download:	1 times