Estimating Sample Size for Usability Testing

Abstract: One strategy used to assure that an interface meets user requirements is to conduct usability testing. When conducting such testing one of the unknowns is sample size. Since extensive testing is costly, minimizing the number of participants can contribute greatly to successful resource management of a project. Even though a significant number of models have been proposed to estimate sample size in usability testing, there is still not consensus on the optimal size. Several studies claim that 3 to 5 users suffice to uncover 80% of problems in a software interface. However, many other studies challenge this assertion. This study analyzed data collected from the user testing of a web application to verify the rule of thumb, commonly known as the “magic number 5”. The outcomes of the analysis showed that the 5-user rule significantly underestimates the required sample size to achieve reasonable levels of problem detection.

Saved in:
Bibliographic Details
Main Authors: Cazañas,Alex, de San Miguel,Andre, Parra,Esther
Format: Digital revista
Language:English
Published: Universidad UTE 2017
Online Access:http://scielo.senescyt.gob.ec/scielo.php?script=sci_arttext&pid=S1390-65422017000100172
Tags: Add Tag
No Tags, Be the first to tag this record!