Conference proceeding
The Citations of Papers with Conflicting Reviews and Confident Reviewers
17TH INTERNATIONAL CONFERENCE ON SCIENTOMETRICS & INFORMETRICS (ISSI2019), VOL II, pp.2411-2417
01 Jan 2019
Abstract
Disagreement is essential for knowledge growth in science. However, disagreement in peer review is usually regarded as a sign of unreliability in existing studies. The predictive role of disagreement for potentially impactful discoveries was rarely explored. Reviewer expertise has been proved to have effects on review strictness and outcomes, but reviewers' added-value on paper quality remains unclear. In this paper, we examined the predictive effects of disagreement and confidence of reviewers on citations of reviewed papers. Using a dataset of 489 papers submitted ICRL 2017, we found that predictive effects of disagreement and confidence on citations. Among accepted papers, the papers with higher review ratings tend to receive more citations and the disagreement cannot predict citations. However, among rejected papers with more than ten citations, the ratings they received cannot predict their citations, but the disagreement level of their reviewers does. Similar opposite findings were also seen regarding confidence. Accepted papers reviewed by confident reviewer tend to have more citations but rejected papers might not benefit from confident reviewers.
Metrics
8 Record Views
Details
- Title
- The Citations of Papers with Conflicting Reviews and Confident Reviewers
- Creators
- Jiangen He - Drexel Univ, Dept Informat Sci, Philadelphia, PA 19104 USAChaomei Chen - Drexel Univ, Dept Informat Sci, Philadelphia, PA 19104 USA
- Contributors
- G Catalano (Editor)C Daraio (Editor)M Gregori (Editor)H F Moed (Editor)G Ruocco (Editor)
- Publication Details
- 17TH INTERNATIONAL CONFERENCE ON SCIENTOMETRICS & INFORMETRICS (ISSI2019), VOL II, pp.2411-2417
- Conference
- 17TH INTERNATIONAL CONFERENCE ON SCIENTOMETRICS & INFORMETRICS (ISSI2019), VOL II, 17th
- Series
- Proceedings of the International Conference on Scientometrics and Informetrics
- Publisher
- Int Soc Scientometrics & Informetrics-Issi
- Number of pages
- 7
- Grant note
- 1633286 / National Science Foundation; National Science Foundation (NSF) 2019 Eugene Garfield Doctoral Dissertation Scholarship Award
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Information Science (Informatics)
- Identifiers
- 991019170460404721
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Web of Science research areas
- Computer Science, Interdisciplinary Applications
- Information Science & Library Science