Pilot test

Group 6

Pilot test

We conducted 2 tests with the same person.

• Test 1: Blindfolded• Test 2: User A (one of 4 users in our protocol)

Data collecting:• Webcam• SNAGIT • Notes • Timing

Test 1: Tasks performed

• Our aim was to do a full test with different product selection and completion of process tasks on both sites.

• Too difficult for the user to use the screen reader, i.e. problems with controls.

Test 1: Data collected

Unable to complete the tasks:• Inexperience with controls.• The reader’s voice too low.

• We skipped testing of site 1.

• Conclusion: We want to test the websites with a blind person, who is familiar with using a screen reader + supply an acceptable sound level.

Test 2: Tasks performed

Site 1:• Task 1-4: Different selection/ completion tasks.• Task 5: Describe each page.

Site 2:• Task 1-4: Different selection/ completion tasks.• Task 5: Describe each page.

Test 2: Data, Site 1

What did the user think?

Positive:

• Easy selection/delivery information/confirmation process

Negative:

• Can’t navigate through the process line.

• Needs a final ”Thank you” page to confirm, that the data has been sent successfully.

Test 2: Data, Site 2

What did the user think?

Positive:

• Easy selection/delivery information/confirmation process

• Can navigate through the process line.

• The ”Thank you”-page

Conclusion: The user liked Site 2 better.

Test 2: Overall problems

Besides the problems on Site 1:

• The user didn’t get the purpose of the website – thought it was the company’s main website.

• The user misses pictures of the products + categories.

• The categories are not completely self-explanatory.

• Design: Looks unfinished, amateur-like, does not look like a regular supermarket (Welcome page).

• Buttons: Don’t look like buttons, look like ”marked text”.

What is good on the website?

• The process is simple and easy.

• The navigation is easy.

• Text on buttons – no doubt about where they take you.

What will we change in the protocol?

• For task 1-4 we asked the user to think-aloud + we were timing the tasks: wasn’t thought through: thinking-aloud slowed the process down.

• Briefing/ debriefing: We are considering making specific answer options/ scales, so that the data will be easier to compare.

• Data collecting: Maybe use dictaphone instead?

What will we change on the website?• Work on the design/text on ”Welcome page”: The purpose

must be obvious + the website must seem professional.

• Redesign buttons – must look more clickable.

• Try to make the categories more self-explanatory.

• Add pictures.

• Correct the HTML: Some HTML was read by the screen reader.