Logo image
Framework to Support Scenario Development for Human-Centered Alerting System Evaluation
Journal article   Open access   Peer reviewed

Framework to Support Scenario Development for Human-Centered Alerting System Evaluation

Matthew L. Bolton, Sinan Goeknur and Ellen J. Bass
IEEE transactions on human-machine systems, v 43(6), pp 595-607
01 Nov 2013
url
https://doi.org/10.1109/thms.2013.2283399View
Published, Version of Record (VoR)Open Access (License Unspecified) Open
url
https://doi.org/10.1109/THMS.2013.2283399View
Published, Version of Record (VoR) Open

Abstract

Computer Science Computer Science, Artificial Intelligence Computer Science, Cybernetics Science & Technology Technology
The purpose of the framework introduced here is to support the development of evaluation scenarios that are capable of assessing system level performance while considering the system, the humans that interact with it, and the environment. The following five step framework is presented and applied to a pilot self separation task: 1) identify entities critical to system design, development, and operation and define their goals and properties as they relate to the system being studied; 2) define a subset of functionality for evaluation (define an execution sequence); 3) map entity properties to the execution sequence to identify independent variables; 4) translate entity goals into a set of system goals that can be used to identify dependent measures; and 5) iterate through each step to ensure the models produced are internally consistent.

Metrics

6 Record Views
7 citations in Scopus

Details

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Collaboration types
Domestic collaboration
Web of Science research areas
Computer Science, Artificial Intelligence
Computer Science, Cybernetics
Logo image