Handbook of usability testing howto plan design

Gathering Biometric Data 6. Identify Co-Researchers, Assistants, and Observers 6. Timekeeper 6. Additional Testing Roles 6. Test Observers 7. Find and Select Participants 7. Characterize Users 7. Visualize the Test Participant 7. Differentiate between Purchaser and End User 7. Look for Information about Users 7. Requirements and Specification Documents 7.

Structured Analyses or Marketing Studies 7. Product Manager Marketing 7. Competitive Benchmarking and Analysis Group 7. Define the Criteria for Each User Group 7. Define Expertise 7. Specify Requirements and Classifiers for Selection 7. Document the User Profile 7. Divide the User Profile into Distinct Categories 7. Consider a Matrix Test Design 7. Determine the Number of Participants to Test 7. Write the Screening Questionnaire 7.

Review the Profile to Understand Users' Backgrounds 7. Identify Specific Selection Criteria 7. Formulate Screening Questions 7. Organize the Questions in a Specific Order 7. Develop a Format for Easy Flow through the Questionnaire 7. Test the Questionnaire on Colleagues and Revise It 7.

Consider Creating an "Answer Sheet" 7. Find Sources of Participants 7. Internal Participants 7. Qualified Friends and Family 7. Web Site Sign-Up 7. Existing Customers from In-House Lists 7. Existing Customers through Sales Representatives 7. Societies and Associations 7.

Craigslist 7. College Campuses 7. Market Research Firms or Recruiting Specialists 7. Employment Agencies 7. Newspaper Advertisements 7. Screen and Select Participants 7. Screening Considerations 7. Conduct Screening Interviews 7. Go through the Questions in the Questionnaire 7. Expect to Make Tradeoffs 7. Schedule and Confirm Participants 7. Compensate Participants 7. Protect Participants' Privacy and Personal Information 8. Prepare Test Materials 8. Guidelines for Observers 8.

Orientation Script 8. Keep the Tone of the Script Professional, but Friendly 8. Keep the Speech Short 8. Write the Orientation Script Out 8. Make Introductions 8. Offer Refreshments 8. Explain Why the Participant Is Here 8. Describe the Testing Setup 8. Explain What Is Expected of the Participant 8. Explain Any Unusual Requirements 8. Ask for Any Questions 8.

Background Questionnaire 8. Test the Questionnaire 8. Decide How to Administer the Questionnaire 8. Data Collection Tools 8. Decide What Type of Information to Collect 8. Select a Data Collection Method 8. Fully Automated Data Loggers 8. Online Data Collection 8. User-Generated Data Collection 8. Manual Data Collection 8.

Other Data Collection Methods 8. Nondisclosures, Consent Forms, and Recording Waivers 8. Pre-Test Questionnaires and Interviews 8. Discover Attitudes and First Impressions 8. Learn about Whether Participants Value the Product 8. Prototypes or Products to Test 8.

Task Scenarios 8. Sequence the Task Scenarios in Order 8. Match the Task Scenarios to the Experience of the Participants 8. Avoid Using Jargon and Cues 8. Give Participants the Tasks to Do 8. Reading Task Scenarios to the Participants 8. Optional Training Materials 8. Ensure Minimum Expertise 8.

Get a View of the User after Experiencing the Product 8. What Are the Benefits of Prerequisite Training? Some Common Questions about Prerequisite Training 8. Post-Test Questionnaire 8. Design the Questions and Responses for Simplicity and Brevity 8.

Use the Pilot Test to Refine the Questionnaire 8. Common Question Formats 8. Likert Scales 8. Semantic Differentials 8.

Fill-In Questions 8. Checkbox Questions 8. Branching Questions 8. Debriefing Guide 9. Conduct the Test Sessions 9. Guidelines for Moderating Test Sessions 9. Moderate the Session Impartially 9. Treat Each New Participant as an Individual 9. Advantages of the "Thinking Aloud" Technique 9. Disadvantages of the "Thinking Aloud" Technique 9.

How to Enhance the "Thinking Aloud" Technique 9. Probe and Interact with the Participant as Appropriate 9. Assist the Participants Only as a Last Resort 9. When to Assist 9. How to Assist 9. Checklists for Getting Ready 9. Checklist 1: A Week or So before the Test 9.

Take the Test Yourself 9. Conduct a Pilot Test 9. Revise the Product 9. Request a Temporary "Freeze" on Development 9. Checklist 2: One Day before the Test 9. Assemble All Written Test Materials 9. Check on the Status of Your Participants 9.

Double-Check the Test Environment and Equipment 9. Checklist 3: The Day of the Test 9. Prepare Yourself Mentally 9. Greet the Participant 9. Read the Orientation Script and Set the Stage 9. Move to the Testing Area and Prepare to Test 9. Start Recordings 9. Set Decorum for Observers in the Room 9. Debrief the Participant 9. Close the Session 9. Organize Data Collection and Observation Sheets 9. Debrief with Observers 9. Provide Adequate Time between Test Sessions 9.

Prepare for the Next Participant 9. When to Intervene 9. When to Deviate from the Test Plan 9. What Not to Say to Participants Debrief the Participant and Observers Why Review with Participants and Observers? Techniques for Reviewing with Participants Where to Hold the Participant Debriefing Session Basic Debriefing Guidelines Advanced Debriefing Guidelines and Techniques The Manual Method The Video Method Audio Record the Debriefing Session Reviewing Alternate Designs How to Implement the "Devil's Advocate" Technique Example of the "Devil's Advocate" Technique Reviewing and Reaching Consensus with Observers Why Review with Observers?

Between Sessions At the End of the Study Analyze Data and Observations Compile Data Begin Compiling Data as You Test Organize Raw Data Summarize Data Summarize Performance Data Task Accuracy Task Timings Summarize Preference Data Compile and Summarize Other Measures Summarize Scores by Group or Version Analyze Data Identify User Errors and Difficulties Conduct a Source of Error Analysis Prioritize Problems Analyze Differences between Groups or Product Versions Using Inferential Statistics Report Findings and Recommendations What Is a Finding?

Shape the Findings Draft the Report Why Write a Report? Organize the Report Executive Summary Method Results Findings and Recommendations Discussion Develop Recommendations Ignore Political Considerations for the First Draft Be Thorough Make Supporting Material Available to Reviewers Refine the Report Format Create a Highlights Video or Presentation Cautions about Highlights Steps for Producing a Highlights Video Consider the Points You Want to Make Pick the Clips Review Timing and Organization Draft Titles and Captions Review and Wrap 3.

More filters. Sort order. Feb 26, Sharmeen rated it it was amazing. There are many resources about user testing available on the internet but nothing can beat this guide. I bought it when I was a fresh graduate in Industrial design.

It still helps me when I need to organise User testing sessions. A really clear guide to usability testing, excellent reference book. Dec 20, Tree rated it really liked it. If you have time for only one book on user testing, this is the one without a doubt. Very practical and does bot waste any time. Was able to complete my first user testing way easier with the help of this book.

Recommend read! May 24, Marc rated it liked it Shelves: professional-readings. This is a very process-specific book, but it's basic applications go beyond needing to do full-our usability testing. It's a good source for examining your own workplace's workflows and provides ways of identifying bottlenecks and other problems.

Jan 12, Emily H. If you're going to conduct a usability test, you really need to read this book first. A lot of it is commonsense, yes, but if you read this book you'll save yourself tons of time and money because you'll experience many fewer bumps in the testing road.

It's very practical and very easy to read. Apr 04, Bonnie rated it it was amazing. This was assigned reading for a course I was taking - it was an easy read in colloquial language - not a stuffy textbook at all. Apr 08, Sara S. Over a decade old but still a good resource. As textbooks go, this was very readable and practical. Nov 14, Sarah hong marked it as to-read. Sorry, I will read it. Jan 25, Monika rated it it was amazing. This is hands down the best book on usability testing I've read.

To be fair, you will most likely get the most out of this book if you're a novice, as I was. Definitely worth a purchase. Jun 02, Jeremy rated it it was ok. The book was ok. It provides a fundamental understanding of usability testing. Brad Kratochvil rated it really liked it Oct 22, Chris Branch rated it liked it Feb 23, Patrice rated it really liked it Aug 03, Dave rated it liked it May 25, Liz rated it really liked it Jun 18, Mathieu Kittel-Hudon rated it liked it Jun 03, Kunshiro rated it it was amazing May 12, Liza rated it liked it Jun 22, Jonathan andrew rated it it was amazing Jan 15, Taylor rated it liked it Mar 24, Mary rated it really liked it Jan 04, Reed rated it really liked it Nov 06, Jane rated it liked it Feb 11, Ryan Finch rated it it was ok Sep 05, Andy rated it really liked it Mar 31, Gaby Prado rated it it was amazing Jan 06,