To the front pageThe Interaction Designer's Coffee Break - Weekly postings and quarterly articles about interaction design  
  To the front pageSign inTo the frontpageSearch in GUUUI postingsAbout GUUUI  
   
 

POSTING

Five users in a test is not enough

The discussion about how many users is enough for a usability test has been going on for years. Research by Jakob Nielsen and Tom Landauer showing that tests with five users will reveal an average of 85% usability problems has been seen as a proof that five is enough.

According to Laura Faulker, Nielsen and Laudauer's prediction is right. Five users will reveal 85% usability problems - on average. In a study, she found that problems found with five users range from nearly 100% down to only 55%. Thus, relying on a single set of five users, we run the risk that nearly half the problems could be missed.

Dr. Eric Schaffer concludes that "…for a routine usability test run 12 people for each segment. For an important one where the stakes are high run 30. If resources are really tight, you can drop to five-six per segment, but this is bad."

Links:

Henrik Olsen - July 01, 2004

See also: Usability testing (34) 

 

COMMENTS TO THIS POSTING

 
There are no comments to this posting.

Browse GUUUI postings

Methods and the design process

Prototyping and wireframing (35)  Usability testing (34)  Cost-justification and ROI (19)  The design process (13)  Personas (13)  Requirement Analysis (12)  Card sorting (8)  Eye-tracking (10)  Implementing user-centred design (8)  Web log analysis (7)  Expert reviews (6)  Site and flow diagramming (4)  Use Cases (3) 

Design elements

Navigation (48)  Search (24)  Web page design (23)  Text (14)  Links (12)  Forms (12)  Guidelines and Standards (10)  Site design (8)  Ads (6)  Error handling (5)  Sections (5)  Shopping Charts (5)  Design patterns (5)  Help (2)  Home pages (2)  E-mails (1)  Personalization (1)  Print-freindly (1)  Sitemaps (1) 

General aspects

E-commerce (21)  Visual design (15)  Persuasive design (13)  Information architecture (11)  Accessibility (11)  Search engines (7)  Credibility, Trust and Privacy (6)  Web applications (2)  Intranets (1) 

Technology

Flash (6)  Javascript (3)  URLs (3)  Browsers (2)  Download time (2)  Web standards (2) 

Humor

Funny tools and games (10)  Cartoons (9)  Bad designs (7)  Fun with Jakob Nielsen (7)  Fun music and videos (4)  Misc humor (4)  Designs with humor (3)  Fun posters (2)  Funny 404 pages (2) 

Ressource types

Research (95)  Tips and guidelines (67)  Tools (53)  Books (33)  Cases and Examples (13)  Interviews (11)  Primers (11)  GUUUI articles (9)  Online books (4)  Posters (5)  Glossaries (3)  People and organisations (2) 

Information sources

Blogs (11)  Websites (10)  Discussion lists (4)  News (3)  Newsletters (3)  Online magazines (3)  Wikis (1) 

 

 
     
  To the front pageSign inTo the frontpageSearch in GUUUI postingsAbout GUUUI