23
FINAL FINAL SI622: Team Knetwit April 17, 2009
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
FINAL SI622: Team Knetwit April 17, 2009
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
• Knetwit.com is a knowledge sharing website that allows users to join classes, share notes with other users, and also provides the option to create study groups within these classes.
– Find note – Upload note – Request note – Store – Comment – Message – Leaderboards – Study Groups – Flashcards
• Incentives – Koin – Knowledge points – Community points
Introduction to Knetwit
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Methods
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Interaction Diagram • Helped provide a high-level understanding of the the systemʼs hierarchy. • Showed the complexity of the siteʼs architecture and all possible pathways
through the system.
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Personas & Scenarios • Generated personas & scenarios individually
• Target population: college students, registered Knetwit users
• Rationalized situations in which Knetwit features could be used by undergraduate and graduate students
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Comparative Evaluation • Compared to 5 knowledge sharing websites and Ctools
• Analysis revealed additional insight – Aesthetic design – Social networking – Organization
• Direct feature comparison
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Heuristic Evaluation • Four individual evaluations using Nielsenʼs 10 Usability Heuristics (1994) • Personas and scenarios as reference for likely interactions on the site • Begin to focus on specific issues related to usability
1. Visibility of system status 2. Match between system and the real world 3. User control and freedom 4. Consistency and standards 5. Error prevention 6. Recognition rather than recall 7. Flexibility and efficiency of use 8. Aesthetic and minimalist design 9. Help users recognize, diagnose, and recover from errors 10. Help and documentation
Severity Rating Scale 0= Do not agree that this is a usability problem 1= Cosmetic problem, fix only id extra time is available 2= Minor usability problem, low priority 3= Major usability problem; important to fix 4= Usability catastrophe; imperative to fix
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
User Survey • 28 Questions
– Demographics – Usage Patterns – Popular Features
• Knetwit admins sent survey to the user base • Users volunteered without incentive. • 65 respondents, 184 abandon
• Resulted in great demographic data, discovery of power users and preferences in feature discrimination
• Open-ended questions
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Usability Testing • Pilot to debug the test • 5 undergraduate college students of varying ages and majors • 8 tasks that users would likely attempt on Knetwit • Moderator • Data Logger • Users encouraged to verbalize and explain behaviors • Camtasia screen capture and audio recording
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Findings and Recommendations
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Find a Note Findings: • Main functionality of the site • Survey shows that 85% of survey participants use the Find Note feature.
• 62% of survey users stated that the “Do not upload” • During usability testing 3 of 5 (60%) failed the task to find and download a
note.
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Find a Note Findings: • Searching Capability
– No control of freedom (#3) – Search renders a broad range of
results that do not closely match the original search criteria
• Join a Course – No control of freedom (#3) – Lacks flexibility and efficiency of use
(#7) – Users are required to join courses in
order to view course notes. – Difficult to select a course section if
a user does not know the exact year and term that the course was offered
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Find a Note Recommendations: • Standardize the database to pull course lists from universities. This will
enhance the usability of the “Find a Note” feature. – Minimize user confusion and frustration – Avoid inconsistent naming conventions – Prevent course duplication
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Upload a Note Finding: • Slight error rate
– 1 of 5 users failed the task
• Large task time range – 40 – 320 seconds (4 minute 40 second range)
• Users noticed lack of organization in course list – No standard course names – Confusing pagination
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Upload a Note Recommendation: • Use a scrollable menu for course lists
• Use AJAX or similar technology to generate contextual course lists – Reduces guesswork and confusion
• Organize course list by subject
• Remove “Join” before course names
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Aesthetics and Layout
Finding: • 4 of 5 users tested found the layout to be “busy” or “cluttered” • Aesthetics affects usability because the visual design promotes or hinders
successful completion of a task • Users like color scheme and tabbed navigation at the top of the screen
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Aesthetics and Layout Recommendation: • Apply the tabbed navigation design to user profile page • Move the 8 tabbed boxes to the top of user dashboard • Allow for same functionality with less visual noise • Keep the color scheme and graphics.
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Social Networking Findings: • Facebook 96%, MySpace 46%, Twitter 27%, Digg 18%, Delicious 13%
• Feature Usage - Find note 85%, Upload note 61%, 26%, Study groups, 26% Store, 24% Invite friends, 19% Comments, 17% Messages, 15% Requests
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Social Networking Recommendations: • Add features that allow students to rate courses or professors or ask
course questions. • Add a calendar feature that allows students to add events related to
specific courses (ex. Test, study groups meetings, etc)
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Incentives & Ethics Findings • Survey showed that Koin is an incentive (75%); 67% plan to redeem Koin
at store
• Survey showed gap between people taking notes by hand (74%) and likelihood of transcription (27%)
• One user in user testing had problems with the ethics of Knetwit
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Incentives & Ethics Recommendations: • More research into ethics and incentives • Add more information about ethics in the FAQ and keep the site as
academic and transparent as possible • Better incentivize note transcription • Better incentivize adding friends from Facebook • Be sure that incentives are on par with other websites
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
Strengths • Generally, users liked the idea of the being able to share and
collaborate with students online. • Knetwit offers a wide range of functionality that provides college
students collaborative learning tools. • Knetwit developers are quick to implement new features.
User Quote:
FINAL
Introduction
Interaction Diagram
Personas & Scenarios
Comparative Evaluation
Heuristic Evaluation
User Survey
Usability Testing
Findings & Recommendations
Incentives & Ethics
Strengths
Comments
• Questions/ Comments?
Comments