Breakdowns in complex systems often occur as a result of system elements interacting in unanticipated ways. In systems with human operators, human-automation interaction associated with both normative and erroneous human behavior can contribute to such failures. Model-driven design and analysis techniques provide engineers with formal methods tools and techniques capable of evaluating how human behavior can contribute to system failures. This paper presents a novel method for automatically generating task analytic models encompassing both normative and erroneous human behavior from normative task models. The generated erroneous behavior is capable of replicating Hollnagel's zero-order phenotypes of erroneous action for omissions, jumps, repetitions, and intrusions. Multiple phenotypical acts can occur in sequence, thus allowing for the generation of higher order phenotypes. The task behavior model pattern capable of generating erroneous behavior can be integrated into a formal system model so that system safety properties can be formally verified with a model checker. This allows analysts to prove that a human-automation interactive system (as represented by the model) will or will not satisfy safety properties with both normative and generated erroneous human behavior. We present benchmarks related to the size of the statespace and verification time of models to show how the erroneous human behavior generation process scales. We demonstrate the method with a case study: the operation of a radiation therapy machine. A potential problem resulting from a generated erroneous human action is discovered. A design intervention is presented which prevents this problem from occurring. We discuss how our method could be used to evaluate larger applications and recommend future paths of development. (C) 2012 Elsevier Ltd. All rights reserved.
Generating phenotypical erroneous human behavior to evaluate human-automation interaction using model checking
Creators
Matthew L. Bolton - Ames Research Center
Ellen J. Bass - University of Virginia
Radu I. Siminiceanu - National Institute of Aerospace
Publication Details
International journal of human-computer studies, v 70(11), pp 888-906
Publisher
Elsevier
Number of pages
19
Grant note
TI 5LM009462 / National Library of Medicine (NLM); United States Department of Health & Human Services; National Institutes of Health (NIH) - USA; NIH National Library of Medicine (NLM)
NCC1002043; NNA10DE79C / NASA; National Aeronautics & Space Administration (NASA)
T15LM009462 / NATIONAL LIBRARY OF MEDICINE; United States Department of Health & Human Services; National Institutes of Health (NIH) - USA; NIH National Library of Medicine (NLM)
Resource Type
Journal article
Language
English
Academic Unit
Information Science
Web of Science ID
WOS:000310049200007
Scopus ID
2-s2.0-84866397181
Other Identifier
991019292223404721
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool: