"The best way to measure usability is by testing how well a product or prototype supports real clinical work."

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 

Can Usability Be Measured?

Paul Smith, Ph.D.
October 2006

What do you do when you have feedback that your product (oximeter, infusion pump, glucose monitor, etc.) is hard to use? It is not "user friendly". Perhaps there is a view in the press that a competitor's product is simpler. Maybe engineering is recommending a set of changes to improve usability.

How can you know that the investment necessary to make these changes will have the desired impact on usability? Often, there are conflicting opinions among the product development team on the changes needed to make your product more usable. You need a way to measure usability.

The best way to measure usability is by testing how well a product or prototype supports real clinical work. The usability test asks a sample of real users to perform (or simulate) real clinical tasks using your device while an observer measures their performance.

How well users perform tasks is measured by task success, time and accuracy. You know that product changes will have the desired impact on usability if they meet preset test objectives for these measures. An example of a test objective is: 8 of 10 representative users must be successful on the critical system tasks without assistance and in less time than with the primary competitor.

Care must be taken in setting the objectives. If possible, avoid armchair estimates such as "I think this task should take 20 minutes." Source your objectives by measuring the task success, time and accuracy of the current product version, or a competitor, or an alternative design.

Setting objectives generates additional value in that they help focus the product development team on what aspects of the product are critical for good usability. The team are all working toward the same goals. There is a consensus that "We need to do these things well."



[see other articles]

 

 

 
what we dowho we arewhy choose ushuman factors and medicinenews
Tel: 800-639-7941