Post on 19-Jan-2016
description
transcript
Usability Test ReportUsability Test Report
““Elementary School Math Club” Elementary School Math Club”
in UTOPIAin UTOPIA
By I-Fan Chou
OverviewOverview
IntroductionIntroduction ObjectivesObjectives Test ProcedureTest Procedure Task DesignTask Design Participant ProfileParticipant Profile Results & SummaryResults & Summary Problems & RecommendationsProblems & Recommendations ConclusionConclusion
IntroductionIntroduction
Elementary School Math ClubElementary School Math Club (ESMC) is a sub (ESMC) is a sub Website under UTOPIA protocol. Website under UTOPIA protocol.
ESMC provides five activities forESMC provides five activities for PreK-3 PreK-3 and and
4-84-8 elementary school teachers or parents to elementary school teachers or parents to use as lesson plans.use as lesson plans.
ESMC is designed for ESMC is designed for math educatorsmath educators and and parentsparents with elementary school kids in order to with elementary school kids in order to stimulate children’s mathematical curiosity. stimulate children’s mathematical curiosity.
ObjectivesObjectives
Assessed the performance of target Assessed the performance of target users using the current ESMC Websiteusers using the current ESMC Website
Detected any problems focusing on: Detected any problems focusing on: Navigation SystemNavigation System Interface DesignInterface Design Labeling/languageLabeling/language
OverviewOverview
IntroductionIntroduction ObjectivesObjectives Test ProcedureTest Procedure Task DesignTask Design Participant ProfileParticipant Profile Results & SummaryResults & Summary Problems & RecommendationsProblems & Recommendations ConclusionConclusion
Test ProcedureTest Procedure
IRB consent form & Self-report IRB consent form & Self-report background questionnairebackground questionnaire
Performance evaluation: Performance evaluation: 10 tasks10 tasks (“Think aloud”, timed, and video/audio recorded)(“Think aloud”, timed, and video/audio recorded)
Interview Interview (Audio recorded)(Audio recorded)
OverviewOverview
IntroductionIntroduction ObjectivesObjectives Test ProcedureTest Procedure Task DesignTask Design Participant ProfileParticipant Profile Results & SummaryResults & Summary Problems & RecommendationsProblems & Recommendations ConclusionConclusion
Task DesignTask Design
Task 1Task 1: Locate ESMC with navigation : Locate ESMC with navigation systemsystem Task 2Task 2: Locate ESMC with search : Locate ESMC with search functionfunction Task 3Task 3: Find the “About” information of : Find the “About” information of ESMCESMC Task 4Task 4: Go to “Math Mobile” section: Go to “Math Mobile” section
Task Design (cont’d)Task Design (cont’d)
Task 5Task 5: Find “Lesson Duration”: Find “Lesson Duration” Task 6Task 6: Find curriculum plan for lesson: Find curriculum plan for lesson Task 7Task 7: Download lesson kit to the : Download lesson kit to the desktopdesktop Task 8Task 8: Find “Distributive Law”: Find “Distributive Law” Task 9Task 9: Find “Materials” info: Find “Materials” info Task 10Task 10 : Send questions to ESMC : Send questions to ESMC
Participant ProfileParticipant Profile
1010 participants: participants: 88 math teachers for PreK-3 or 4-8 math teachers for PreK-3 or 4-8 22 parents with elementary school kids parents with elementary school kids 99 females; females; 11 male male
Test Participants (n=10)
Male 1
Female 9
Age 26 ~ 35 6
Participant Profile (cont’d)Participant Profile (cont’d)
All participants have basic Web capabilitiesAll participants have basic Web capabilities 55 out of 10 have visited UTOPIA protocol out of 10 have visited UTOPIA protocol 77 participants have used online tutorial tools participants have used online tutorial tools
Test Participants (n=10)
Average time of surfing online daily
½~1 hour
Visited UTOPIA 5
Used online tutorial tools
7
OverviewOverview
IntroductionIntroduction ObjectivesObjectives Test ProcedureTest Procedure Task DesignTask Design Participant ProfileParticipant Profile Results & SummaryResults & Summary Problems & RecommendationsProblems & Recommendations ConclusionConclusion
Results & SummaryResults & Summary
60%60% of the tasks had errors happened of the tasks had errors happened 40%40% of the participants completed tasks of the participants completed tasks
without making errorswithout making errors Task 3Task 3 (70%) and (70%) and Task 10Task 10 (80%) had lower (80%) had lower
success rate than any other tasks success rate than any other tasks T3: Find the “About” information of ESMCT3: Find the “About” information of ESMC T10: T10: Send questions to ESMCSend questions to ESMC
Confusion of universal navigation bar Confusion of universal navigation bar between between ESMCESMC and UTOPIA and UTOPIA
Results & Summary (cont’d)Results & Summary (cont’d)
Task 2Task 2 (117.5 sec.) has the longest time (117.5 sec.) has the longest time span in average for the participants to span in average for the participants to completecomplete
T2: Locate ESMC with search functionT2: Locate ESMC with search function
Problems in search functionProblems in search function
DemoDemo
OverviewOverview
IntroductionIntroduction ObjectivesObjectives Test ProcedureTest Procedure Task DesignTask Design Participant ProfileParticipant Profile Results & SummaryResults & Summary Problems & RecommendationsProblems & Recommendations ConclusionConclusion
Problems & Problems & RecommendationsRecommendations
Navigation SystemNavigation System Hard to locate ESMCHard to locate ESMC
Role settings vs. Local navigation barRole settings vs. Local navigation bar URL is not easy for memorizingURL is not easy for memorizing Bread crumb links do not help muchBread crumb links do not help much
Search results are sorted by categories Search results are sorted by categories add “Sort by relevance” function will helpadd “Sort by relevance” function will help
Confusion of universal navigation bar Confusion of universal navigation bar Move “About” and “Help/FAQ” of UTOPIA upMove “About” and “Help/FAQ” of UTOPIA up
Problems & Problems & Recommendations (cont’d)Recommendations (cont’d)
Interface DesignInterface Design Entrance pageEntrance page
““That’s the huge problem, it’s misleading!” That’s the huge problem, it’s misleading!” ““Tell me what is this, don’t make me click on everything Tell me what is this, don’t make me click on everything
to find out what it is” to find out what it is” Tool tips will help!Tool tips will help!
ConsistencyConsistency FontsFonts
“ “It’s really It’s really smallsmall, and no body wants to read that!” , and no body wants to read that!”
ColorColor Orange linksOrange links?? Blue headersBlue headers??
Problems & Problems & Recommendations (cont’d)Recommendations (cont’d)
Labeling/languageLabeling/language Not Teacher friendly languageNot Teacher friendly language
Not TEKS language Not TEKS language ex. Platonic Solids ex. Platonic Solids Geometric SolidGeometric Solid ““I’ve never seen platonic solid until I saw here.”I’ve never seen platonic solid until I saw here.”
Too complicatedToo complicated Not straightforwardNot straightforward Too much redundant information Too much redundant information
Vague labeling termsVague labeling terms The Math The Math Math(ematical) Concepts/ Math FormulaMath(ematical) Concepts/ Math Formula Number Paths, Guess the number-magic trick, The Human Number Paths, Guess the number-magic trick, The Human
Counting Machine, A Math MuralCounting Machine, A Math Mural
ConclusionConclusion
Modify the search function to serve Modify the search function to serve users’ searching behaviorusers’ searching behavior
Improve the navigation to locate ESMC Improve the navigation to locate ESMC from UTOPIAfrom UTOPIA
Decrease the confusion of universal Decrease the confusion of universal navigation barnavigation bar
Match the Interface design with target Match the Interface design with target user’s expectationuser’s expectation
Conclusion (cont’d)Conclusion (cont’d)
Improve consistency between entrance Improve consistency between entrance page and inside pagespage and inside pages
Change vague termsChange vague terms Add tool tips when users move the Add tool tips when users move the
mouse over the graphicsmouse over the graphics Revise the language to match TEKS Revise the language to match TEKS
languagelanguage Enlarge the fonts; deduct the content Enlarge the fonts; deduct the content
Any Questions?Any Questions?