Date post: | 07-Nov-2014 |
Category: |
Technology |
Upload: | uxpa-international |
View: | 806 times |
Download: | 12 times |
C(ollab) RITE How to run impactful iterative studies in a fast paced environment
Helena RoeberJhilmil Jain
#uxpa2013#crite
@jhilmiljain@helenaroeber
#androidux
C-RITE Impact
• User research insights are adopted quickly• Product team has clear sense of progress • Researchers and designers earn
understanding and respect for their work• Advocates for the user centered design
process are born
#uxpa2013 #crite #androidux
C-RITE• Iterative UX research method suitable for agile
environments
• From research to new design solution in 1 day
• 7 research sessions in 2 days
• Collaborative design workshop each day
• Prototype changes between day 1 and 2
• Can be repeated weekly
• Stakeholders collaborate in all UX phases
#uxpa2013 #crite #androidux
User Research Stages
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
#uxpa2013 #crite #androidux
ThePlayers
The Players and Their Roles
TheResearcher
#uxpa2013 #crite #androidux
Traditional Researcher Role
Research Analysis Design PrototypingReporting
&Prioritization
Planning & Recruiting
Researcher
TheDesigner
#uxpa2013 #crite #androidux
Reporting &
Prioritization
Planning & Recruiting
Engineers
Traditional Designer Role
Engineer
Research Analysis Design PrototypingReporting
&Prioritization
Planning & Recruiting
Designer Designer
Researcher
TheProduct
Manager
#uxpa2013 #crite #androidux
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
Traditional PM Role
Reporting &
Prioritization
Planning & Recruiting Research Analysis Design Prototyping
Reporting &
Prioritization
Planning & Recruiting
Designer Designer
Researcher
PM PM
TheEngineer
#uxpa2013 #crite #androidux
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
Traditional Engineering Role
Reporting &
Prioritization
Planning & Recruiting Research Analysis Design Prototyping
Reporting &
Prioritization
Planning & Recruiting
Designer Designer
Researcher
PM PM
Engineer
Collaboration in C-RITE
Research Analysis Design PrototypingReporting
&Prioritization
Planning & Recruiting
Designer
PM
Engineer
Researcher
Time Line - Traditional Usability
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
1-2 weeks 1-2 weeks 1/2 - 1week 1/2 -1week
3 - 6 weeks
#uxpa2013 #crite #androidux
Time Line - Traditional Usability
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
1- 2 weeks 1- 2 weeks 1/2 - 1week 1/2 -1week
4 - 8 weeks
#uxpa2013 #crite #androidux
1/2 - 1 week1/2 -1 week
Time Line - RITE
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
1 - 2 weeks 1 - 2 weeks
2 - 4 weeks
#uxpa2013 #crite #androidux
Time Line - C-RITE
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
1-2 weeks 2.5 days
1.5 - 2.5 weeks
#uxpa2013 #crite #androidux
Time Line - Cyclic C-RITE
Research AnalysisReporting
&Prioritization
Design PrototypingPlanning
& Recruiting
1 week 2.5 days
1.5 weeks
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
Example: TV Voice Search
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
1st TV Voice Search Design
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Research Timing
10:00 am 11:00 am 1:00 pm 2:00 pm10:00 am 11:00 am 1:00 pm
Day 1 Day 2
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Collaborative Analysis
10:00 am 11:00 am 1:00 pm 2:00 pm10:00 am 11:00 am 1:00 pm
Day 1 Day 2
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
Observation Board Example
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
User Goals Example
Observation ExampleGoal example
P1P1 P2P2Bob Lin Ali Nur Bob Lin Ali Nur
User knows what to say 2 1 2 2
The system understood user’s intent 5 3 1 1
The system doesn’t slow down user w unnecessary confirmations 4 4 2 2
User can easily tell where speech will work 2 2 2 2
User comfortable using their voice 4 4 4 4
Rating on a scale from 1- 5 1 = poor 5 = good
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
Collaborative Observation
#uxpa2013 #crite #androidux
• Re-call to count observations, analysis step reduced
• Disagreements about observations are resolved immediately
• Research protocol can be adjusted based on stakeholder feedback
• Researcher can explain what observations mean
• Small sample size discussion is obsolete
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Analysis
10:00 am 11:00 am 1:00 pm 2:00 pm10:00 am 11:00 am 1:00 pm
Day 1 Day 2
2:00 pm 3:00 pm
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
From Observation to Insight
Observation ExampleGoal example
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
Prioritizing Insights
Goal example
Insights
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Design Workshop
3:00 pm
Day 1
10:00 am 11:00 am 1:00 pm 2:00 pm 10:00 am 11:00 am 1:00 pm 2:00 pm
Day 2
6:30 pm5:30 pm
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
Design Workshop
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
Design Workshop Actions
Observation ExampleGoal example
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
Action Item Owners & Due Dates
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Design Workshop
#uxpa2013 #crite #androidux
• Turn panic into confidence
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Design Workshop
#uxpa2013 #crite #androidux
• Turn panic into confidence• Designers demonstrate problem solving skills
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Design Workshop
#uxpa2013 #crite #androidux
• Turn panic into confidence• Designers demonstrate problem solving skills• Engineers solve technical constraints
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Design Workshop
#uxpa2013 #crite #androidux
• Turn panic into confidence• Designers demonstrate problem solving skills• Engineers solve technical constraints• Researchers guide insight interpretation
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Design Workshop
#uxpa2013 #crite #androidux
• Turn panic into confidence• Designers demonstrate problem solving skills• Engineers solve technical constraints• Researchers guide insight interpretation• PM gives business and scheduling input
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
C-RITE Design Workshop
#uxpa2013 #crite #androidux
• Turn panic into confidence• Designers demonstrate problem solving skills• Engineers solve technical constraints• Researchers guide insight interpretation• PM gives business and scheduling input• Everyone participates in creative process
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
Before & After
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Reporting
Day 1
Send action items to team
Day 2
Send action items to team Short report
Day 3
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Prototyping
3:00 pm10:00 11:00 1:00 2:00
Day 2
6:30 pm
Day 1
10:00 11:00 1:00 2:00 5:30 pm
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Cycles
Week1 Week 2 Week 3
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Recruiting
• Create a panel of users that meet general recruitment criteria
• Panel members commit to availability at short notice on research days
• Each week, schedule panel members• Recruit for specific criteria when needed
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Room Design
• Comfortable seating for all to observe sessions
• Whiteboard to record observations, and drawing during design workshop
• Sunlight and windows is good for creativity
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Preparations
• Set expectations with all stakeholders beforehand about time commitment, collaboration and workshop format
• Decision makers need to participate in C-RITE studies and workshops
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
C-RITE Summary
#uxpa2013 #crite #androidux
• Iterative UX research method suitable for agile environments
• From research to new design solution in 1 day
• 7 research sessions in 2 days
• Collaborative design workshop each day
• Prototype changes between day 1 and 2
• Can be applied weekly
• Stakeholders collaborate in all UX phases
ResearchObservation & Analysis
Reporting &Prioritization Design Prototyping
Planning & Recruiting
Thank you
#uxpa2013 #crite #androidux
[email protected] @jhilmiljain
Appendix
Agile Methods: RITE
• Changes are made as soon as a problem is identified, sometimes after 1 session
• 1-2 sessions a day. Breaks between sessions long enough to make changes
• 1-2 weeks of sessions
• Requires stakeholder attendance and participation
Medlock, Wixon, Fulton, Terrano and Romero, UPA, 2002
#uxpa2013 #crite #androidux
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
Agile Methods: KRUG + RITE
• 4 participants over 2 days, at least 1 hour between sessions to make changes
• Researcher sends out observations and recommendations 30 min after last session
• Team debrief of observations and action items on day 2, 1 hour after last session
• No collaborative design workshop
McGinn, Chen, Journal of Usability Studies, 2013
Research Analysis Reporting &Prioritization Design Prototyping
Planning & Recruiting
Agile Methods: PULSE
• 3 participants, 1 day every week
• Analysis and write-up of results by researcher within 2 days
• No collaborative analysis and design workshop
Konno, Agile 2012
Research Analysis Reporting &Prioritization Design Implementation
Planning & Recruiting
Variations We’ve Tried
• C-RITE Remote• If time zones allow, stakeholders participate through ‘Hangouts’
• Sessions are recorded and watched with time delay
• Next day debriefs and design workshops for incompatible time zones
• C-RITE Diary Studies• In-lab diary kick-offs and debriefs are run in C-RITE format
• Researcher analyzes and summarizes diary data for debrief and design workshop