Determining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problems

dc.contributor.authorAndre, Terence Scotten
dc.contributor.committeecochairHartson, H. Rexen
dc.contributor.committeecochairWilliges, Robert C.en
dc.contributor.committeememberRueb, Justin D.en
dc.contributor.committeememberKleiner, Brian M.en
dc.contributor.committeememberDingus, Thomas A.en
dc.contributor.departmentIndustrial and Systems Engineeringen
dc.date.accessioned2014-03-14T20:09:26Zen
dc.date.adate2000-04-17en
dc.date.available2014-03-14T20:09:26Zen
dc.date.issued2000-04-03en
dc.date.rdate2001-04-17en
dc.date.sdate2000-04-12en
dc.description.abstractThe need for cost-effective usability evaluation has led to the development of methodologies to support the usability practitioner in finding usability problems during formative evaluation. Even though various methods exist for performing usability evaluation, practitioners seldom have the information needed to decide which method is appropriate for their specific purpose. In addition, most methods do not have an integrated relationship with a theoretical foundation for applying the method in a reliable and efficient manner. Practitioners often have to apply their own judgment and techniques, leading to inconsistencies in how the method is applied in the field. Usability practitioners need validated information to determine if a given usability evaluation method is effective and why it should be used instead of some other method. Such a desire motivates the need for formal, empirical comparison studies to evaluate and compare usability evaluation methods. In reality, the current data for comparing usability evaluation methods suffers from a lack of consistent measures, standards, and criteria for identifying effective methods. The work described here addresses three important research activities. First, the User Action Framework was developed to help organize usability concepts and issues into a knowledge base that supports usability methods and tools. From the User Action Framework, a mapping was made to the Usability Problem Inspector; a tool to help practitioners conduct a highly focused inspection of an interface design. Second, the reliability of the User Action Framework was evaluated to determine if usability practitioners could use the framework in a consistent manner when classifying a set of usability problems. Third, a comprehensive comparison study was conducted to determine if the Usability Problem Inspector, based on the User Action Framework, could produce results just as effective as two other inspection methods (i.e., the heuristic evaluation and the cognitive walkthrough). The comparison study used a new comparison approach with standards, measures, and criteria to prove the effectiveness of methods. Results from the User Action Framework reliability study showed higher agreement scores at all classification levels than was found in previous work with a similar classification tool. In addition, agreement using the User Action Framework was stronger than the results obtained from the same experts using the heuristic evaluation. From the inspection method comparison study, results showed the Usability Problem Inspector to be more effective than the heuristic evaluation and consistent with effectiveness scores from the cognitive walkthrough.en
dc.description.degreePh. D.en
dc.identifier.otheretd-04122000-09440030en
dc.identifier.sourceurlhttp://scholar.lib.vt.edu/theses/available/etd-04122000-09440030/en
dc.identifier.urihttp://hdl.handle.net/10919/26788en
dc.publisherVirginia Techen
dc.relation.haspartandre.pdfen
dc.rightsIn Copyrighten
dc.rights.urihttp://rightsstatements.org/vocab/InC/1.0/en
dc.subjectHuman-Computer Interactionen
dc.subjectUsability Evaluation Methodsen
dc.subjectEvaluation Effectivenessen
dc.subjectUsability Inspectionen
dc.titleDetermining the Effectiveness of the Usability Problem Inspector: A Theory-Based Model and Tool for Finding Usability Problemsen
dc.typeDissertationen
thesis.degree.disciplineIndustrial and Systems Engineeringen
thesis.degree.grantorVirginia Polytechnic Institute and State Universityen
thesis.degree.leveldoctoralen
thesis.degree.namePh. D.en

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
andre.pdf
Size:
2.26 MB
Format:
Adobe Portable Document Format