Logo image
Trustworthy Image Authentication using Forensic Knowledge Graphs
Preprint   Open access

Trustworthy Image Authentication using Forensic Knowledge Graphs

Tai D Nguyen and Matthew C Stamm
ArXiv.org
22 Jun 2026
url
https://doi.org/10.48550/arXiv.2606.23917View
Preprint (Author's original) Open arXiv.org - Non-exclusive license to distribute

Abstract

Computer Science - Computer Vision and Pattern Recognition
Advances in generative AI have made image falsification highly realistic, demanding trustworthy authentication systems. Existing forensic detectors can target certain forgery types but lack interpretability, while vision-language models (VLMs) provide explanations but cannot exploit forensic traces for reliable detection. We propose Forensic Knowledge Graphs (FKGs), a unified framework that integrates forensic evidence extraction, structured reasoning, and human-interpretable explanation. Our FKG structure encodes forensic traces along with their causal dependencies and links to scene content. To generate accurate FKGs, we introduce a novel forensic authentication network and an Iterative Context Refinement strategy that guides VLMs to produce faithful, grounded explanations. We also present FKG-50K, a dataset of 50,000 realistic forgeries with ground-truth FKGs. Experiments demonstrate that FKG outperforms both forensic detectors and VLMs in detection, forgery identification and localization, and forensic justification.

Metrics

1 Record Views

Details

Logo image