How Autodesk creates better digital experiences with UserTesting

#UTwebinar @UserTesting

Lisa Seaman

User Experience Manager, Autodesk

UserTesting’s on demand customer insights platform enables companies to create powerful products and exceptional customer experiences.

#UTwebinar

We Partner With Thousands Of Customers

#UTwebinar

Across All Platforms, At All Stages Of Development

Watchcustomersinteractwith:

DESKTOP SMARTPHONETABLET

WEBSITES APPS&PROGRAMS

PROTOTYPES&WIREFRAMES

SURVEYS PHYSICALPRODUCTS

Anywhere people interact with your brand:

ATHOME ATASTORE ONTHEGO

On any pla6orm or device:

#UTwebinar

8

Lisa Seaman User Experience Manager, Autodesk

Lisa Seaman, User Experience Manager at Autodesk, is a customer advocate at heart. She uses A/B testing, usability studies, web analytics, and customer comments to evaluate websites and find opportunities to make them work better. She has worked in the user experience and web analytics space for over 12 years and her past stomping grounds include WhichTestWon, Sun Microsystems, and Outward Bound.

@BoulderLisaS

#UTwebinar

© 2016 Autodesk © 2016 Autodesk © 2016 Autodesk

Lisa Seaman User Experience Manager @BoulderLisaS

UserTesting Webinar, February 2017

How Autodesk creates better digital experiences with UserTesting

@BoulderLisaS #UTwebinar

1.  We meant well 2.  Sometimes you want to convince 3.  Comparison studies 4.  A/B testing pairs well with UserTesting 5.  + 4 tips!

Case Studies

@BoulderLisaS #UTwebinar

We meant well…

Pricing

Pricing

We meant well, but through UserTesting we learned that it’s still confusing

@BoulderLisaS

I am in a SPRINT and don’t have enough time

Tip #1: Use more ratings, written, and

multiple choice questions

@BoulderLisaS

Sometimes you want to learn, and sometimes you want to convince @BoulderLisaS

UserTesting video clips can help make a convincing case for change @BoulderLisaS

What should I

test?

Tip #2: Read customer comments or talk to tech

support. Run tests on tasks that customers tell you about or that you are

concerned about.

@BoulderLisaS

For comparison studies, consider swapping the order of tasks

@BoulderLisaS

Quotes – What is this a picture of?

“canal”

Image A

“channel”

“sea port”

“dam concept”

“a series of water locks”

Image B

“water reservoir”

“a park”

“urban design, lighting poles, streets, houses, empty plots, a

reservoir”

Quotes – Which image do you like better?

“Image A lends more focus to the concept.”

“It is better to infer from Image A what is

represented by it.”

“Looks much more realistic.”

“It’s more complex, has more details.”

Image A Image B

Which image did people prefer?

23%

77%

Like A better Like B better

Users who saw A first, then B

§  Image B was easier to understand after seeing image A

50% 50%

Like A better Like B better

Users who saw B first, then A

Swapping the order of tasks allows you to learn more and not be misled

For comparison studies, swap the order of tasks to learn more

@BoulderLisaS

For a comparison study where half the people see

A then B, and the other half see B then A, can I do

that in one test?

Tip #3: Use two separate tests to do a

comparison study.

@BoulderLisaS

If you do a/b testing, add a UserTesting study

@BoulderLisaS

Experiences for AutoCAD LT

Exp A radio button

Exp B vertical stack Exp C horizontal boxes

A UserTesting study pairs well with an A/B test; add qual to your quant

@BoulderLisaS

Too many participants are

young….

Tip #4: Use two groups to get an even split of ages or browsers or genders

within one test.

@BoulderLisaS

Case Studies 1.  Evaluate usability (We meant well…) 2.  Make a convincing case for change 3.  Comparison study 4.  A/B testing pairs well with UserTesting

Summary

@BoulderLisaS

Tips 1.  In a hurry? Use more ratings, written, and multiple choice questions. 2.  Looking for test ideas? Read customer comments or talk to tech support. 3.  For a comparison study, swap the order of tasks and use two separate tests. 4.  Want more older participants? Use two groups to get an even split of ages (or

browsers or genders) within one test.

Thanks! Q&A?

@BoulderLisaS

© 2016 Autodesk. All rights reserved.

Autodesk and the Autodesk logo are registered trademarks or trademarks of Autodesk, Inc., and/or its subsidiaries and/or affiliates in the USA and/or other countries. All other brand names, product names, or trademarks belong to their respective holders. Autodesk reserves the right to alter product and services offerings, and specifications and pricing at any time without notice, and is not responsible for typographical or graphical errors that may appear in this document.