Conference proceeding
Purpose-oriented metrics to assess researcher quality
21ST INTERNATIONAL CONFERENCE ON SCIENCE AND TECHNOLOGY INDICATORS (STI 2016), pp.1310-1314
01 Jan 2016
Abstract
This paper contributes, illustrates, and evaluates a purpose-oriented method to assess quality of researchers. It is in selection processes such as recruitment that assessing the quality of researchers becomes necessary. Because quality is fitness for use, we contend that assessing the quality of researchers depends on references of quality imposed by the purpose of the selection process that motivates the need for assessment (henceforth target selection process). Our purpose-oriented method meets all requirements from The Leiden Manifesto for Research Metrics. We illustrate the method acquiring quality references form exemplars of researchers. These exemplars are presented as curriculum vitae of researchers (CVs) labeled as fit or unfit to target selection processes (i.e., binary quality assessment). We show two different target selection processes. The first considers fit researchers who are successful in collaborative endeavors, and thus are expected to succeed in collaborative research. The second considers fit researchers who are successful in solo endeavors, and thus are expected to succeed in solo research. We demonstrate that, on average, a classifier trained with data using quality references for a specific purpose (i.e., tailored to the peculiarities of their context) is more accurate than a purpose-independent classifier that does not consider the context of its target selection process.
Metrics
22 Record Views
Details
- Title
- Purpose-oriented metrics to assess researcher quality
- Creators
- Kedma Duarte - Univ Fed Santa Catarina, Grad Program Knowledge Engn & Management, Florianopolis, SC, BrazilRosina Weber - Drexel Univ, Coll Comp & Informat, Philadelphia, PA 19104 USARoberto C. S. Pacheco - Univ Fed Santa Catarina, Grad Program Knowledge Engn & Management, Florianopolis, SC, Brazil
- Contributors
- Rafols (Editor)J MolasGallart (Editor)E CastroMartinez (Editor)R Woolley (Editor)
- Publication Details
- 21ST INTERNATIONAL CONFERENCE ON SCIENCE AND TECHNOLOGY INDICATORS (STI 2016), pp.1310-1314
- Conference
- 21ST INTERNATIONAL CONFERENCE ON SCIENCE AND TECHNOLOGY INDICATORS (STI 2016), 21st
- Publisher
- Univ Politecnica Valencia
- Number of pages
- 5
- Grant note
- Brazilian's Goias Research Foundation (FAPEG) 201310267000099 / University of the State of Goias (UEG)
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Information Science (Informatics)
- Identifiers
- 991019170558304721
InCites Highlights
These are selected metrics from InCites Benchmarking & Analytics tool, related to this output
- Collaboration types
- Domestic collaboration
- International collaboration
- Web of Science research areas
- Social Sciences, Interdisciplinary