Post on 31-Mar-2015
transcript
EXPERIENCE SAMPLING
VASSILISJAVEDKHAN
PANOSMARKOPOULOS
THE METHOD AND ITS TOOLS
INDUSTRIALDESIGNDEPARTMENT 2290609
INDEX
• ESM: definition, uses & tools
• Why is there a need for another ES tool?
• ESRM & Reconexp
• Our plans for developing a better ES tool
INDUSTRIALDESIGNDEPARTMENT 3290609
ESM HISTORY
• Early 1970s pagers were introduced
• University of Chicago wanted to study “flow” experiences
• What were the most enjoyable moments of participants’ day
INDUSTRIALDESIGNDEPARTMENT 4290609
ESM DEFINITION
• A method to solicit respondents’ answers at random moments of the day[Hektner J.M., Schmidt J.A., Csikszentmihalyi M.,, Experience Sampling Method, Measuring the quality of everyday life, 2007, SAGE, ISBN 1412925576]
• ESM is a survey method, i.e. a way to collect self-reported data from participants that is executed over sustained periods of time
• Computerized ESM
INDUSTRIALDESIGNDEPARTMENT 5290609
WHERE/HOW ESM IS USED?
• Psychology & Social psychology• Feelings of people• Activities and what makes them happy
• Medical• Assessing the burden of different illnesses• The health consequences of stress
• Political• For evaluating policies
• HCI, UX & design• Assessing the experience of a service or a product• Eliciting requirements for a service or a product
INDUSTRIALDESIGNDEPARTMENT 6290609
ON MY WAY TO LEIDEN…
INDUSTRIALDESIGNDEPARTMENT 7290609
ON MY WAY TO LEIDEN…
• How accurate?• How easy?
INDUSTRIALDESIGNDEPARTMENT 8290609
INDUSTRIALDESIGNDEPARTMENT 9290609
INDUSTRIALDESIGNDEPARTMENT 10290609
INDUSTRIALDESIGNDEPARTMENT 11290609
DRAWBACKS & BENEFITS OF ESM
– Self-selection bias– Nonresponse and selective nonresponse– Obtrusive– High cost of implementation
+ Extremely rich data over time
(subjective +objective data)
INDUSTRIALDESIGNDEPARTMENT 12290609
RELATED TOOLS
• GENERIC• Academia
− MyExperience− D’PUIS− PMAT− ESP− PsychLab
• Commercial− Entyware by Techneos
• CUSTOM (for a single study)
INDUSTRIALDESIGNDEPARTMENT 13290609
MyExperience (beta) FEATURES
• XML Questionnaire development • Availability of several “sensors”
(GPS, device usage information)• Supports photo, video and audio
capture• Plug-in architecture• Windows Mobile devices
INDUSTRIALDESIGNDEPARTMENT 14290609
MyExperience XML example
INDUSTRIALDESIGNDEPARTMENT 15290609
FUTURE ES TOOL
• Why another tool?• Conditions are right: truly affordable
• Shortcomings of previous tools
• New methodological developments
INDUSTRIALDESIGNDEPARTMENT 16290609
CONDITIONS ARE RIGHT: More people have powerful devices
• “Globally, research house Ovum expects 171.9 million smartphones to ship this year, up 23% on 2008 and about 15% of the worldwide mobile phone market in 2009” [reuters.com]
http://www.appleinsider.com/articles/08/02/14/google_iphone_usage_shocks_search_giant.html
INDUSTRIALDESIGNDEPARTMENT 17290609
CONDITIONS ARE RIGHT: Internet on mobile devices is now affordable
INDUSTRIALDESIGNDEPARTMENT 18290609
PREVIOUS TOOLS’ SHORTCOMINGS
• Difficult to install• Too technical to
execute• Little support• Need of expensive
devices
INDUSTRIALDESIGNDEPARTMENT 19290609
NEW METHODOLOGICAL DEVELOPMENTS
• Providing feedback to participants improves their motivation [Hsieh, G., Li, I., Dey, A., Forlizzi, J., and Hudson, S. E. 2008. Using visualizations to increase compliance in experience sampling. UbiComp '08]
• Reconstruction of sampling day [Khan, V.J., Markopoulos, P., Eggen, B., de Ruyter, B., IJsselsteijn, W.A. (2008) Reconexp: A way to reduce the data loss of the Experiencing Sampling Method, MobileHCI '08]
• Defining inconvenient times [Isomursu, M., Tähti, M., Väinämö, S., and Kuutti, K. 2007. Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. Int. J. Hum.-Comput. Stud. 65, 4 (Apr. 2007), 404-418]
INDUSTRIALDESIGNDEPARTMENT 20290609
RECONEXP STUDY: OUR EXPERIENCE
• RECONSTRUCTING EXPERIENCE• A first tool supporting the ESRM method
INDUSTRIALDESIGNDEPARTMENT 21290609
GOAL
• Investigate communication needs of “busy” parents (under context)
• What information are “busy” parents willing to automatically exchange with each other during a typical day of theirs?
INDUSTRIALDESIGNDEPARTMENT 22290609
INDUSTRIALDESIGNDEPARTMENT 23290609
INDUSTRIALDESIGNDEPARTMENT 24290609
INDUSTRIALDESIGNDEPARTMENT 25290609
INDUSTRIALDESIGNDEPARTMENT 26290609
METHOD
• EXPERIENCE SAMPLING + DAY RECONSTRUCTION
INDUSTRIALDESIGNDEPARTMENT 27290609
+ DAY RECONSTRUCTION
INDUSTRIALDESIGNDEPARTMENT 28290609
RESULTS
• Busy parents are willing to automatically exchange information which will help them to:
• Infer the availability of partner
• Feel reassured about the well being of family members
• Help coordinate tasks in the evening
INDUSTRIALDESIGNDEPARTMENT 29290609
Frequency of chosen information statements
INDUSTRIALDESIGNDEPARTMENT 30290609
SITUATIONAL DATA ANALYSIS
INDUSTRIALDESIGNDEPARTMENT 31290609
SITUATIONAL DATA ANALYSIS
INDUSTRIALDESIGNDEPARTMENT 32290609
RECONEXP SUMMARY
• Supports personalization of available answers• Supports feedback to participants• Supports filling out unanswered queries
INDUSTRIALDESIGNDEPARTMENT 33290609
WHAT WOULD NEXT ES TOOL LOOK LIKE?
INDUSTRIALDESIGNDEPARTMENT 34290609
TOOL COMPONENTS
• Questionnaire Developer• Event triggering editor
• Choice of presentation medium (mobile | pc)
• Real time feedback to participants• Data analysis & Visualization tools• Notification manager (participant and researcher)• Methodology wizard• Experience granularity• Participant’s state of mind-based triggering of queries
• Emphasis is on mobile studies
INDUSTRIALDESIGNDEPARTMENT 35290609
INTERESTING?
• HTTP://ESRM.ID.TUE.NL
• p.markopoulos@tue.nl• v.j.khan@tue.nl
INDUSTRIALDESIGNDEPARTMENT 36290609
ESRM
• Experience Sampling and Reconstruction Method
• A method combining ESM with DRM
INDUSTRIALDESIGNDEPARTMENT 37290609
DAY RECONSTRUCTION
• DRM respondents first revive memories of the previous day by constructing a diary consisting of a sequence of episodes. Then they describe each episode by answering questions about the situation and about the feelings that they experienced, as in experience sampling.
[Kahneman, Daniel, Alan B. Krueger, David A. Schkade, Norbert Schwarz and Arthur A. Stone. 2004. “A Survey Method for Characterizing Daily Life Experience: The Day
Reconstruction Method.” Science. 306:5702, pp. 1776–780.]
• Shortcomings: data for one day, requires one-to-one access with
participant
INDUSTRIALDESIGNDEPARTMENT 38290609
PLATFORM?
Windows Mobile Blackberry iPhone Palm Nokia
INDUSTRIALDESIGNDEPARTMENT 39290609
CRITERIA
• Market share• Development tools• Cost• Form factor
INDUSTRIALDESIGNDEPARTMENT 40290609