Logo image
Benchmarking sentiment analysis methods for large-scale texts: A case for using continuum-scored words and word shift graphs
Preprint   Open access

Benchmarking sentiment analysis methods for large-scale texts: A case for using continuum-scored words and word shift graphs

Andrew J Reagan, Brian Tivnan, Jake Ryland Williams, Christopher M Danforth and Peter Sheridan Dodds
arXiv.org
07 Sep 2016
url
https://doi.org/10.48550/arxiv.1512.00531View
Preprint (Author's original)arXiv.org - Non-exclusive license to distribute Open

Abstract

Computer Science - Computation and Language
The emergence and global adoption of social media has rendered possible the real-time estimation of population-scale sentiment, bearing profound implications for our understanding of human behavior. Given the growing assortment of sentiment measuring instruments, comparisons between them are evidently required. Here, we perform detailed tests of 6 dictionary-based methods applied to 4 different corpora, and briefly examine a further 20 methods. We show that a dictionary-based method will only perform both reliably and meaningfully if (1) the dictionary covers a sufficiently large enough portion of a given text's lexicon when weighted by word usage frequency; and (2) words are scored on a continuous scale.

Metrics

4 Record Views

Details

Logo image