|
Authors: | Effie Lai-Chong Law |
Group: | Communication Systems |
Type: | Article |
Title: | Evaluating the Downstream Utility of User Tests and Examining the Developer Effect: A Case Study |
Year: | 2006 |
Month: | October |
Pub-Key: | elaw06g |
Journal: | International Journal of Human-Computer Interaction (IJHCI) |
Volume: | 21 |
Number: | 2 |
Pages: | 147-172 |
Keywords: | donwstream utility, usability evaluation |
Abstract: | We report a case study on evaluating the downstream utility of user tests performed on a digital library with reference to the developer effect. ‘Downstream Utility’ is defined as the effectiveness with which the resolution to a usability problem is implemented, and ‘Developer Effect’ is defined as developers’ bias towards fixing usability problems with particular characteristics. To measure the effectiveness of the user tests, we analyze the actual impacts of fixing or not-fixing the usability problems identified. To address a theoretical void in studying the persuasive power of usability evaluation results, we employ Information Integration Theory. We investigate six research questions that predict the persuasiveness of different qualities of usability problems to induce fixes and the effectiveness of such fixes. Multi-perspective data have been collected from usability specialists, the development team of the digital library, and its old as well as new users. Implications for reporting usability problems and future research are inferred. |
Resources: | [BibTeX] |