English
Related papers

Related papers: Emotions Don't Lie: An Audio-Visual Deepfake Detec…

200 papers

The task of deepfakes detection is far from being solved by speech or vision researchers. Several publicly available databases of fake synthetic video and speech were built to aid the development of detection methods. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Pavel Korshunov , Haolin Chen , Philip N. Garner , Sebastien Marcel

As artificial intelligence becomes more and more ingrained in daily life, we present a novel system that uses deep learning for music recommendation and emotion-based detection. Through the use of facial recognition and the DeepFace…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Swetha Kambham , Hubert Jhonson , Sai Prathap Reddy Kambham

Recent advances in technology for hyper-realistic visual and audio effects provoke the concern that deepfake videos of political speeches will soon be indistinguishable from authentic video recordings. The conventional wisdom in…

Human-Computer Interaction · Computer Science 2024-01-17 Matthew Groh , Aruna Sankaranarayanan , Nikhil Singh , Dong Young Kim , Andrew Lippman , Rosalind Picard

The COVID pandemic has led to the wide adoption of online video calls in recent years. However, the increasing reliance on video calls provides opportunities for new impersonation attacks by fraudsters using the advanced real-time…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Hui Guo , Xin Wang , Siwei Lyu

The development of powerful deep learning technologies has brought about some negative effects to both society and individuals. One such issue is the emergence of fake media. To tackle the issue, we have organized the Trusted Media…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Weiling Chen , Sheng Lun Benjamin Chua , Stefan Winkler , See-Kiong Ng

Deepfake is a deep learning-based technique that makes it easy to change or modify images and videos. In investigations and court, visual evidence is commonly employed, but these pieces of evidence may now be suspect due to technological…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Kundan Patil , Shrushti Kale , Jaivanti Dhokey , Abhishek Gulhane

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

The recent emergence of deepfakes has brought manipulated and generated content to the forefront of machine learning research. Automatic detection of deepfakes has seen many new machine learning techniques, however, human detection…

Human-Computer Interaction · Computer Science 2024-08-28 Nicolas M. Müller , Karla Pizzi , Jennifer Williams

Deepfakes powered by advanced machine learning models present a significant and evolving threat to identity verification and the authenticity of digital media. Although numerous detectors have been developed to address this problem, their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Viacheslav Pirogov , Maksim Artemev

Deep-learning-based technologies such as deepfakes ones have been attracting widespread attention in both society and academia, particularly ones used to synthesize forged face images. These automatic and professional-skill-free face…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 YuYang Sun , ZhiYong Zhang , Isao Echizen , Huy H. Nguyen , ChangZhen Qiu , Lu Sun

With the proliferation of Audio Language Model (ALM) based deepfake audio, there is an urgent need for generalized detection methods. ALM-based deepfake audio currently exhibits widespread, high deception, and type versatility, posing a…

Media forensics has attracted a lot of attention in the last years in part due to the increasing concerns around DeepFakes. Since the initial DeepFake databases from the 1st generation such as UADFV and FaceForensics++ up to the latest…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Ruben Tolosana , Sergio Romero-Tapiador , Julian Fierrez , Ruben Vera-Rodriguez

Multimodal generative models are rapidly evolving, leading to a surge in the generation of realistic video and audio that offers exciting possibilities but also serious risks. Deepfake videos, which can convincingly impersonate individuals,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Hannah Lee , Changyeon Lee , Kevin Farhat , Lin Qiu , Steve Geluso , Aerin Kim , Oren Etzioni

The widespread application of AIGC contents has brought not only unprecedented opportunities, but also potential security concerns, e.g., audio-visual deepfakes. Therefore, it is of great importance to develop an effective and generalizable…

Multimedia · Computer Science 2025-11-25 Fan Nie , Jiangqun Ni , Jian Zhang , Bin Zhang , Weizhe Zhang , Bin Li

In this paper, we propose a new method to expose AI-generated fake face images or videos (commonly known as the Deep Fakes). Our method is based on the observations that Deep Fakes are created by splicing synthesized face region into the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Xin Yang , Yuezun Li , Siwei Lyu

Our paper focuses on making use of deep neural network models to accurately predict the range of human emotions experienced during watching movies. In this certain setup, there exist three clear-cut input modalities that considerably…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Sogand Mehrpour Mohammadi , Meysam Gouran Orimi , Hamidreza Rabiee

Automated vision-based score estimation models can be used as an alternate opinion to avoid judgment bias. In the past works the score estimation models were learned by regressing the video representations to the ground truth score provided…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Hiteshi Jain , Gaurav Harit , Avinash Sharma

There is strong interest in the generation of synthetic video imagery of people talking for various purposes, including entertainment, communication, training, and advertisement. With the development of deep fake generation models,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Qiaomu Miao , Sinhwa Kang , Stacy Marsella , Steve DiPaola , Chao Wang , Ari Shapiro

User emotion analysis toward videos is to automatically recognize the general emotional status of viewers from the multimedia content embedded in the online video stream. Existing works fall in two categories: 1) visual-based methods, which…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Chenchen Li , Jialin Wang , Hongwei Wang , Miao Zhao , Wenjie Li , Xiaotie Deng

Despite the abundance of current researches working on the sentiment analysis from videos and audios, finding the best model that gives the highest accuracy rate is still considered a challenge for researchers in this field. The main…

Sound · Computer Science 2024-12-13 Antonio Fernandez , Suzan Awinat