Logo image
Error Analysis in an Automated Narrative Information Extraction Pipeline
Journal article

Error Analysis in an Automated Narrative Information Extraction Pipeline

Josep Valls-Vargas, Jichen Zhu and Santiago Ontanon
IEEE transactions on computational intelligence and AI in games, v 9(4), pp 342-353
01 Dec 2017

Abstract

Computer Science Computer Science, Artificial Intelligence Computer Science, Software Engineering Science & Technology Technology
In this paper, we present our method for automatically extracting narrative information of characters and their narrative roles from natural language stories. In our corpus of 15 unannotated folk tales, our Voz system identifies 87% of the characters in the stories and correctly assigns 68% of the character roles. To better understand the sources of error in our system, we present an analytical methodology to study how the error is introduced by different modules and how it propagates through the pipeline. This methodology allows us to identify the bottleneck with the largest impact on the final error, which might be different from the module with the largest individual error in isolation. Our methodology can be applied to a wide variety of similar information extraction pipelines.

Metrics

14 Record Views
5 citations in Scopus

Details

InCites Highlights

Data related to this publication, from InCites Benchmarking & Analytics tool:

Web of Science research areas
Computer Science, Artificial Intelligence
Computer Science, Software Engineering
Logo image