Journal article
Advancing reliable synthetic video detection: Insights from the SAFE challenge
Forensic science international. Digital investigation (Online), v 57, 302120
01 Jun 2026
Abstract
The proliferation of generative video technologies has intensified the need for reliable methods to detect and characterize synthetic media. To address this challenge, we organized the SAFE: Synthetic Video Detection Challenge, co-located with the Authenticity and Provenance in the Age of Generative AI (APAI) Workshop at ICCV 2025. The competition invited participants to develop and evaluate algorithms capable of distinguishing real from synthetic videos under fully blind evaluation conditions with over 600 submissions from 12 teams over a 90 day span. Hosted on the Hugging Face platform, the challenge comprised two primary tasks: (1) detection of synthetic video content generated by diverse state-of-the-art models, and (2) detection of synthetic content following common post-processing operations such as resizing, re-compression, motion blur and others. The challenge data consisted of 13 modern high quality synthetic video models with generated content matched to real videos from 21 diverse and challenge sources, all adding up to 20 h of 6000 video samples. This paper describes the challenge design, dataset construction, evaluation methodology, and outcomes, offering insights into the generalization and robustness of contemporary synthetic video detection methods. Our findings highlight measurable progress in cross-generator generalization but also persistent vulnerabilities to post-processing artifacts. https://safe-video-2025.dsri.org.
Metrics
1 Record Views
Details
- Title
- Advancing reliable synthetic video detection: Insights from the SAFE challenge
- Creators
- Kirill Trapeznikov - Systems and Technology Research (United States)Gabriel Mancino-Ball - Systems and Technology Research (United States)Jonathan Li - Systems and Technology Research (United States)Paul Cummer - Systems and Technology Research (United States)Jai Aslam - Systems and Technology Research (United States)Danial Samadi Vahdati - Drexel UniversityTai Nguyen - Drexel UniversityMatthew C. Stamm - Drexel UniversityPeter Bautista - Aptima (United States)Michael Davinroy - Aptima (United States)Laura Cassani - Aptima (United States)Jill Crisman - UL Research Institutes
- Publication Details
- Forensic science international. Digital investigation (Online), v 57, 302120
- Publisher
- Elsevier
- Number of pages
- 9
- Grant note
- ULRI Digital Safety Research Institute
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- Electrical and Computer Engineering
- Web of Science ID
- WOS:001837484700001
- Scopus ID
- 2-s2.0-105045294911
- Other Identifier
- 991022200655104721