Getting to know you: User research fundamentals anyone can use

Getting to know you User research fundamentals anyone can use

Karen L. Bachmann Research & Analysis Practice Lead, Perficient XD @karenbachmann #stc14

© 2014 K. Bachmann

User Research Fundamentals – STC Summit 2014

What we will cover

•  What user research is. •  The fundamentals of planning and conducting user

research. •  Types of user research. •  Inputs that can help guide effective user research. •  How to identify and recruit the right participants. •  Alternatives when getting direct access to users is

challenging. •  How present the compelling findings that support

design and inform needed changes.

© 2014 K. Bachmann


User research in the development life cycle

3

•  User Research •  Task Analysis •  Environment Analysis

•  UI Design Prototypes •  Usability Requirements

•  UI Functional Prototypes •  Screen Elements, Interactions, and Behaviors

•  User Interface

Analysis Design Development Testing Maintenance

Usability Testing

© 2014 K. Bachmann


USER RESEARCH What user research is Why is it essential What you learn about users

4

?

© 2014 K. Bachmann


What user research is

•  The foundation of user experience

•  Essentially, it’s asking users about themselves in a constructive and focused way.

•  “The process of learning about ordinary users by observing them in action” (Hackos and Redish)

•  Requires more than just scientific principles and data gathering techniques; it requires empathy

•  An ongoing process because the information is subject to change over time

5

© 2014 K. Bachmann


What we learn from user research

•  User needs and expectations

•  Contexts of use

•  Behaviors, triggers, and influences

•  Motivations and attitudes

•  Demographics, background, experience, knowledge, and other characteristics

•  A clear picture of real and distinct users

6

© 2014 K. Bachmann


User research…

•  …does not identify an “average” user, but can help develop composites (personas, profiles, types)

•  …requires empathy, not just scientific principles and data gathering techniques

•  …is subject to change over time as users change and their expectations grow

7

© 2014 K. Bachmann


Why do user research

•  To understand and share current user experiences

•  To distinguish between user needs and user wants

•  To anticipate user reactions to and the chances for success with a particular development effort

•  To increase the likelihood of a project’s success before starting development through shared understanding

•  To identify all possible users of the product as concretely as possible

8

© 2014 K. Bachmann


What user research should answer

9

User Research

Who

What How Why

Where When (How, Why)

?

© 2014 K. Bachmann


Example Case: PD Intranet Site

•  Intranet portal for professional development and training

•  International consumer package goods company

•  Users include a wide range of functions: back office staff (HR, IT, etc.), production and warehouse staff, sales teams, drivers

•  Supporting a new program for increasing training access to allow 3 WBT and 1 ILT each year

10

© 2014 K. Bachmann


PLANNING USER RESEARCH Review inputs Plan for a study Identify goals for a successful study Identify and recruit the best participants possible

11

© 2014 K. Bachmann


Steps to conduct user research

•  Plan research •  Determine what you want and need to learn from

users •  Determine who your desired users are •  Determine what user activities you need to support •  Determine the research method •  Develop questions that you need to know about

the users and their processes •  Conduct research •  Present results

12

© 2014 K. Bachmann


Writing a research plan

•  WHY: What you want to learn – study goals

•  WHO: Groups of users you need to talk to

•  WHAT: Specific information to discuss

•  HOW: Methods to use at each phase of development

•  WHEN: Session schedule

•  WHERE: Location of session

13

Email me for a copy of my plan template

© 2014 K. Bachmann


WHY: Setting goals for a study

•  Stakeholder understanding

•  Business goals and constraints

•  Market expectations

•  Technical goals and constraints

14

© 2014 K. Bachmann


Steps to conduct user research

•  Stakeholder •  Provide opportunities

for employee growth •  Promote consistent

pride in brand and culture

•  Market expectations •  Competitors offer

training – may lure employees

•  Business goals and constraints •  Need to implement in

6 months •  Budget $$$

•  Technical goals and constraints •  Update technology •  Move to RWD

15

© 2014 K. Bachmann


WHY: Types of information to learn

•  Types of users •  Industry experience •  Job experience •  Roles •  Computer experience •  Education and training

•  Expectations and influences

•  Attitudes and motivations

•  Times for interactions •  Working conditions

(environment, platform) •  Usage constraints •  Satisfaction with current

conditions •  Perspective on changes

to current conditions •  User goals and

requirements

16

© 2014 K. Bachmann


Activity: Set a goal for the study Example: Understand the platform different types of users use to

access the intranet today.

17

© 2014 K. Bachmann


WHO: Go-to sources about users

•  Users themselves

•  Direct interactions

•  Indirect interactions

•  The immediate managers of users

•  The upper management (the people who are paying for a project, but possibly farther removed)

•  Surrogate users

•  Industry and group publications and organizations

•  Social networks

18

© 2014 K. Bachmann


WHO: Selecting participants

•  Understand the most significant group of users

•  Highest priority

•  Most frequent users

•  Engage as many as feasible

•  1 user > no users

•  Combine methods to reach more users

•  Surrogate users > no users of the perfect profile

19

© 2014 K. Bachmann


WHAT: Example types of plans

•  Interview plan

•  Guide vs. Script

•  Questions and probes

•  Survey plan and questions

•  Activity guide

•  Usability test plan

•  Task scenarios

•  Test data and other inputs

•  Questions

20

© 2014 K. Bachmann


HOW: Moderating the session

•  Be nice and empathetic

•  Recognize they are experts and allow them to introduce new topics

•  Ask questions and pursue ideas as they emerge

•  Don’t guide, correct, or defend

•  Encourage any final thoughts and suggestions

•  Thank participants!

21

© 2014 K. Bachmann


HOW: After the session

•  Allow time between sessions to jot down key observations while fresh

•  Discussion observations with note taker and any observers

•  Don’t draw conclusions or make recommendations (or do so with caveats)

•  Send a thank you note if appropriate

•  Send out any honorarium

22

© 2014 K. Bachmann


WHEN & WHERE

•  Accommodate your test participants’ availability

•  In a lab environment

•  Within the user’s environment

•  Remotely via screen sharing and conference call

•  Anywhere you can meet users

•  Times match your user’ availability

•  Be flexible

23

© 2014 K. Bachmann


Thoughts on session logistics

•  Observers •  Level of access to users and visibility during test •  Relationship to participants (supervisors? peers?) •  Ground rules for interaction •  Buy-in and involvement

•  Recording •  Handwritten notes •  Screen movies to capture movements •  Audio and video of participant •  Permissions to use audio, video, or name

24

© 2014 K. Bachmann


TYPES OF RESEARCH Overview of types of user research Picking the mix that works for you and your users

25

© 2014 K. Bachmann


Example techniques & degrees of separation •  Industry research •  SME interviews •  Usage tracking •  Feedback from users •  Surveys and questionnaires •  Social networks •  Focus groups •  Diary studies •  Interviews •  Usability testing •  Observations •  Site visits

26 In

tera

ctio

n w

ith re

al u

sers

Distant

Direct

© 2014 K. Bachmann


Activity: Select approach to reach the following types of users •  HR personnel •  Regional sales managers •  Warehouse stockers •  Delivery drivers

27

© 2014 K. Bachmann


ANALYSIS Identify significant findings Present them in a compelling way

28

© 2014 K. Bachmann


Align findings to study goals

•  Categorize findings so that all stakeholders understand how what you learn answers the questions they had

•  Document thoroughly where study goals were not met and why

•  Identify any surprise insights that were not anticipated, but turned out to be very significant

29

© 2014 K. Bachmann


Reporting

•  Share your findings •  Focus on significant conclusions and provide

recommendations •  1-2 pages (no “Big Honkin' Report”) •  Bullets and lists are good •  Skip the report and do affinity diagramming/K-J

analysis •  Tailor formality to your audience

•  Recognize the limits of your data •  Summarize study for readers outside the project

30

© 2014 K. Bachmann


Understanding users

•  Complete profiles of all users and any composites for design

•  User personas

•  User and usability requirements

•  User artifacts (such as forms, documentation, and similar)

•  Screener for usability test recruiting

31

© 2014 K. Bachmann


Understanding important activities

•  Process, not tools

•  Task models and work flows

•  Journey and experience maps

•  Scenarios

•  Stories about how users perform activities in their own world currently

•  Users’ models for interacting with content, tools, and other people in performing their actions

32

© 2014 K. Bachmann


Understanding context of use

•  The conditions that users will face when using the end product

•  The users’ physical environment

•  The users’ platform

•  “Noise” in the communication

33

© 2014 K. Bachmann


Where the analysis takes you…

User Goals Users Activities Context

Not necessarily the same as… §  Stakeholder understanding §  Business goals and constraints §  Market expectations §  Technical goals and constraints

34

© 2014 K. Bachmann


Activity: Highlight a key observation Review excerpts from Anton’s interview and note comments that

support the study goals.

35

© 2014 K. Bachmann


Example Case: PD Intranet Site

36

“I've been with the company for 8 years now. I've seen initiatives like this before. It would be great if it worked this time, but... [laughs]. For the warehouse team, it's tough to get some of them to use the intranet at all.”

“I have a smart phone, but I use it for calls and emails only. Some texts from my family. I have big hands, so browsing the web on such a small screen is too much of a hassle.”

“I use YouTube on my home laptop because I've found some great videos on assembling remote controlled plane kits, my hobby. I also have started to use Pinterest because my wife told me about some boards on RC planes.”

“Will I be able to help my team plan their training?”

© 2014 K. Bachmann


Making user research part of the plan

•  Know the objections and have answers for them

•  Prepare a formal request

•  Provide cost analysis of savings from solid user analysis in similar projects

•  Look for ways to integrate user analysis in existing processes

•  Prepare management for plan changes

37

© 2014 K. Bachmann


I hope you got that “nugget” that helps!

Thank you!

38

© 2014 K. Bachmann


“Ten years from now many of the information you learn at the conference will be out of date, the only thing will last is the relationship you build today.” ~ CamMi Pham

So let’s connect: [email protected] @karenbachmann www.linkedin.com/pub/karen-bachmann/4/a/884/

39

© 2014 K. Bachmann


About me Karen Bachmann, the Research & Analysis Practice Lead with Perficient, helps clients deliver usable products that support how users need and expect to interaction with information and perform their tasks. Karen is a member of STC, UXPA, and ACM SIGCHI. She is a former manager of the Usability & User Experience community and is an Associate Fellow of STC.

She lives with 6 ferrets and a cat, who view her and the other human in the house as necessary, although hard-to-train, staff.

Got treats?

40

© 2014 K. Bachmann


User and task analysis references

•  M. Coe. Human Factors for Technical Communicators.

•  J.T. Hackos and J.C. Redish. User and Task Analysis for Interface Design.

•  T. Mandel. The Elements of User Interface Design.

•  J. Nielsen. Usability Engineering.

•  B. Shneiderman. Designing the User Interface: Strategies for Effective Human-Computer Interaction.

•  I. Young. Mental Models.

41

© 2014 K. Bachmann


Usability requirements references •  C. Courage, K. Baxter. Understanding Users: A Practical Guide to User

Requirements - Methods, Tools, and Techniques. •  J. Jubner. “Setting Usability Requirements.” http://

www.deltamethod.net/hb_WR5_UsabilityReq.htm •  S. Lauesen, H. Younessi. “Six Styles for Usability Requirements.” http://

www.itu.dk/~slauesen/Papers/SixStyles.pdf •  E. Smith, A. Siochi. “Software Usability Requirements by Evaluation.”

http://www.acm.org/~perlman/hfeshci/Abstracts/88:264-266.html •  W. Quesenbery. “5Es of Usability.” http://www.wqusability.com/ •  Usability Net (A European Union Project). “Requirements.” http://

www.usabilitynet.org/tools/mainrequirements.htm •  Xerox Corporation. “How to Develop Usability Goals.” Usability SIG

website: http://www.stcsig.org/usability/resources/toolkit/toolkit.html

42

© 2014 K. Bachmann


Usability testing references •  C. Barnum. Usability Testing Essentials: Ready, Set...Test! •  J.S. Dumas, J.C. Redish. Practical Guide to Usability Testing. •  J. Nielsen. Usability Engineering. •  J.S. Dumas, J.C. Redish. Practical Guide to Usability Testing. •  J. Rubin, D. Chisnell. Handbook of Usability Testing: How to

Plan, Design, and Conduct Effective Tests, 2nd Edition. •  D. Stone, C. Jarrett, M. Woodroffe, S. Minocha. User Interface

Design and Evaluation. •  K. Summers, M. Summers. Creating Websites that Work.

43

© 2014 K. Bachmann


Usability testing references •  C. Barnum. Usability Testing Essentials: Ready, Set...Test! •  J. Dumas, D. Chisnell. Handbook of Usability Testing: How to

Plan, Design, and Conduct Effective Tests, 2nd Ed. •  S. Krug. Don’t Make Me Think: A Common Sense Approach to

Web Usability. •  S. Krug. Rocket Surgery Made Easy: The Do-It-Yourself Guide

to Finding and Fixing Usability Problems. •  J. Nielsen. Usability Engineering. •  D. Stone, C. Jarrett, M. Woodroffe, S. Minocha. User Interface

Design and Evaluation. •  K. Summers, M. Summers. Creating Websites that Work.

44

© 2014 K. Bachmann


User survey references

•  D.A. Dillman. Mail and Internet Surveys: The Tailored Design Method.

•  A.N. Oppenheim. Questionnaire Design, Interviewing and Attitude Measurement.

•  P. Salant and D.A. Dillman. How to Conduct Your Own Survey.

45

© 2014 K. Bachmann


Organizations and resources

•  STC Usability & User Experience: http://www.stcsig.org/usability/

•  User Experience Professionals’ Association: http://upassoc.org/

•  ACM SIGCHI: http://www.sigchi.org/

•  Human Factors and Ergonomics Society: http://www.hfes.org/

46

Date post:	27-Jan-2015
Category:	Design
Upload:	karen-bachmann
View:	103 times
Download:	0 times