English
Related papers

Related papers: Detecting Lip-Syncing Deepfakes: Vision Temporal T…

200 papers

It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the faces of celebrities…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Pavel Korshunov , Sebastien Marcel

Although current deep learning-based face forgery detectors achieve impressive performance in constrained scenarios, they are vulnerable to samples created by unseen manipulation methods. Some recent works show improvements in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Alexandros Haliassos , Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

With the rapid development of deep learning techniques, the generation and counterfeiting of multimedia material are becoming increasingly straightforward to perform. At the same time, sharing fake content on the web has become so simple…

Multimedia · Computer Science 2022-09-19 Davide Salvi , Brian Hosler , Paolo Bestagini , Matthew C. Stamm , Stefano Tubaro

The recent renaissance in generative models, driven primarily by the advent of diffusion models and iterative improvement in GAN methods, has enabled many creative applications. However, each advancement is also accompanied by a rise in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Sanjay Saha , Rashindrie Perera , Sachith Seneviratne , Tamasha Malepathirana , Sanka Rasnayaka , Deshani Geethika , Terence Sim , Saman Halgamuge

Real-time deepfake, a type of generative AI, is capable of "creating" non-existing contents (e.g., swapping one's face with another) in a video. It has been, very unfortunately, misused to produce deepfake videos (during web conferences,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zhixin Xie , Jun Luo

With the rapid development of generation model, AI-based face manipulation technology, which called DeepFakes, has become more and more realistic. This means of face forgery can attack any target, which poses a new threat to personal…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yuyang Sun , Zhiyong Zhang , Changzhen Qiu , Liang Wang , Zekai Wang

Lip synchronization, known as the task of aligning lip movements in an existing video with new input audio, is typically framed as a simpler variant of audio-driven facial animation. However, as well as suffering from the usual issues in…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Antoni Bigata , Rodrigo Mira , Stella Bounareli , Michał Stypułkowski , Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

Deepfake videos are causing growing concerns among communities due to their ever-increasing realism. Naturally, automated detection of forged Deepfake videos is attracting a proportional amount of interest of researchers. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yunzhuo Chen , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

While the abuse of deepfake technology has caused serious concerns recently, how to detect deepfake videos is still a challenge due to the high photo-realistic synthesis of each frame. Existing image-level approaches often focus on single…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Daichi Zhang , Fanzhao Lin , Yingying Hua , Pengju Wang , Dan Zeng , Shiming Ge

Detecting forgery videos is highly desirable due to the abuse of deepfake. Existing detection approaches contribute to exploring the specific artifacts in deepfake videos and fit well on certain data. However, the growing technique on these…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Harry Cheng , Yangyang Guo , Tianyi Wang , Qi Li , Xiaojun Chang , Liqiang Nie

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

Due to the widespread use of smartphones with high-quality digital cameras and easy access to a wide range of software apps for recording, editing, and sharing videos and images, as well as the deep learning AI platforms, a new phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Nikhil Sontakke , Sejal Utekar , Shivansh Rastogi , Shriraj Sonawane

In today's era of digital misinformation, we are increasingly faced with new threats posed by video falsification techniques. Such falsifications range from cheapfakes (e.g., lookalikes or audio dubbing) to deepfakes (e.g., sophisticated AI…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Shruti Agarwal , Liwen Hu , Evonne Ng , Trevor Darrell , Hao Li , Anna Rohrbach

In this paper, we introduce MINTIME, a video deepfake detection approach that captures spatial and temporal anomalies and handles instances of multiple people in the same video and variations in face sizes. Previous approaches disregard…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Davide Alessandro Coccomini , Giorgos Kordopatis Zilos , Giuseppe Amato , Roberto Caldelli , Fabrizio Falchi , Symeon Papadopoulos , Claudio Gennaro

The rapid development of facial manipulation techniques has aroused public concerns in recent years. Following the success of deep learning, existing methods always formulate DeepFake video detection as a binary classification problem and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Zhihao Gu , Yang Chen , Taiping Yao , Shouhong Ding , Jilin Li , Feiyue Huang , Lizhuang Ma

The fast evolution and widespread of deepfake techniques in real-world scenarios require stronger generalization abilities of face forgery detectors. Some works capture the features that are unrelated to method-specific artifacts, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Hanqing Zhao , Wenbo Zhou , Dongdong Chen , Weiming Zhang , Nenghai Yu

With the rapid advancement of generative AI, multimodal deepfakes, which manipulate both audio and visual modalities, have drawn increasing public concern. Currently, deepfake detection has emerged as a crucial strategy in countering these…

Sound · Computer Science 2024-05-16 Yang Hou , Haitao Fu , Chuankai Chen , Zida Li , Haoyu Zhang , Jianjun Zhao

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

Sound · Computer Science 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua

Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attributes, and adversarial perturbation-based spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Zhixi Cai , Kalin Stefanov , Abhinav Dhall , Munawar Hayat

While the significant advancements have made in the generation of deepfakes using deep learning technologies, its misuse is a well-known issue now. Deepfakes can cause severe security and privacy issues as they can be used to impersonate a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Hasam Khalid , Shahroz Tariq , Minha Kim , Simon S. Woo