Book chapter
Multiple Testing for IR and Recommendation System Experiments
Advances in Information Retrieval, pp 449-457
01 Jan 2024
Abstract
While there has been significant research on statistical techniques for comparing two information retrieval (IR) systems, many IR experiments test more than two systems. This can lead to inflated false discoveries due to the multiple-comparison problem (MCP). A few IR studies have investigated multiple comparison procedures; these studies mostly use TREC data and control the familywise error rate. In this study, we extend their investigation to include recommendation system evaluation data as well as multiple comparison procedures that controls for False Discovery Rate (FDR).
Metrics
8 Record Views
1 citations in Scopus
Details
- Title
- Multiple Testing for IR and Recommendation System Experiments
- Creators
- Ngozi Ihemelandu - Boise State UniversityMichael D. Ekstrand - Drexel University
- Publication Details
- Advances in Information Retrieval, pp 449-457
- Series
- Lecture Notes in Computer Science
- Publisher
- Springer Nature Switzerland; Cham
- Resource Type
- Book chapter
- Language
- English
- Academic Unit
- Information Science (Informatics)
- Scopus ID
- 2-s2.0-85189304765
- Other Identifier
- 991021868728804721