Logo image
Back
Unmasking Puppeteers: Leveraging Biometric Leakage to Expose Impersonation in AI-based Videoconferencing
Conference proceeding   Open access

Unmasking Puppeteers: Leveraging Biometric Leakage to Expose Impersonation in AI-based Videoconferencing

Danial Samadi Vahdati, Tai Duc Nguyen, Koki Nagano, David Luebke, Orazio Gallo, Ekta Prashnani and Matthew Stamm
39th Conference on Neural Information Processing Systems, NeurIPS 2025, v 38, pp 124644-124659
2025
DOI: https://doi.org/10.52202/085713-3755
url
https://doi.org/10.52202/085713-3755View
Published, Version of Record (VoR) Open Open Access (License Unspecified)

Abstract

AI-based talking-head videoconferencing systems reduce bandwidth by sending a compact pose-expression latent and re-synthesizing RGB at the receiver—but this latent can be “puppeteered,” letting an attacker hijack a victim’s likeness in real time. Because every frame is synthetic, deepfake and synthetic video detectors fail outright. To address this security problem, we exploit a key observation: the pose expression latent inherently contain biometric information of the driving identity. Therefore, we introduce the first biometric leakage defense without ever looking at the reconstructed RGB video: a pose-conditioned, large-margin contrastive encoder that isolates persistent identity cues inside the transmitted latent while cancelling transient pose and expression. A simple cosine test on this disentangled embedding flags illicit identity swaps as the video is rendered. Our experiments on multiple talking-head generation models show that our method consistently outperforms existing puppeteering defenses, operates in real-time, and shows strong generalization to out-of-distribution scenarios. Our code and trained models are available at https://github.com/MISLresearch/Unmasking-Puppeteers-Neurips25

Metrics

1 Record Views

Details

Logo image