Logo image
Back
Defending Low-Bandwidth Talking Head Videoconferencing Systems From Real-Time Puppeteering Attacks
Conference proceeding

Defending Low-Bandwidth Talking Head Videoconferencing Systems From Real-Time Puppeteering Attacks

Danial Samadi Vahdati, Tai Duc Nguyen and Matthew C. Stamm
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp 983-992
Jun 2023
DOI: https://doi.org/10.1109/CVPRW59228.2023.00105

Abstract

Bandwidth Benchmark testing Biometrics (access control) Head Real-time systems Receivers Video conferencing
Talking head videos have gained significant attention in recent years due to advances in AI that allow for the synthesis of realistic videos from only a single image of the speaker. Recently, researchers have proposed low bandwidth talking head video systems for use in applications such as videoconferencing and video calls. However, these systems are vulnerable to puppeteering attacks, where an attacker can control a synthetic version of a different target speaker in real-time. This can be potentially used spread misinformation or committing fraud. Because the receiver always creates a synthetic video of the speaker, deepfake detectors cannot protect against these attacks. As a result, there are currently no defenses against puppeteering in these systems. In this paper, we propose a new defense against puppeteering attacks in low-bandwidth talking head video systems by utilizing the biometric information inherent in the facial expression and pose data transmitted to the receiver. Our proposed system requires no modifications to the video transmission system and operates with low computational cost. We present experimental evidence to demonstrate the effectiveness of our proposed defense and provide a new dataset for benchmarking defenses against puppeteering attacks.

Metrics

12 Record Views
1 citations in Scopus

Details

Logo image