English
Related papers

Related papers: A Deep Learning Approach for Multimodal Deception …

200 papers

In the last few years, several techniques for facial manipulation in videos have been successfully developed and made available to the masses (i.e., FaceSwap, deepfake, etc.). These methods enable anyone to easily edit faces in video…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Nicolò Bonettini , Edoardo Daniele Cannas , Sara Mandelli , Luca Bondi , Paolo Bestagini , Stefano Tubaro

AI models might use deceptive strategies as part of scheming or misaligned behaviour. Monitoring outputs alone is insufficient, since the AI might produce seemingly benign outputs while their internal reasoning is misaligned. We thus…

Machine Learning · Computer Science 2025-02-06 Nicholas Goldowsky-Dill , Bilal Chughtai , Stefan Heimersheim , Marius Hobbhahn

Deepfakes are synthetic media generated using deep generative algorithms and have posed a severe societal and political threat. Apart from facial manipulation and synthetic voice, recently, a novel kind of deepfakes has emerged with either…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Vinaya Sree Katamneni , Ajita Rattani

Recent advances in content generation technologies (widely known as DeepFakes) along with the online proliferation of manipulated media content render the detection of such manipulations a task of increasing importance. Even though there…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Polychronis Charitidis , Giorgos Kordopatis-Zilos , Symeon Papadopoulos , Ioannis Kompatsiaris

Multimodal generative models are rapidly evolving, leading to a surge in the generation of realistic video and audio that offers exciting possibilities but also serious risks. Deepfake videos, which can convincingly impersonate individuals,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Hannah Lee , Changyeon Lee , Kevin Farhat , Lin Qiu , Steve Geluso , Aerin Kim , Oren Etzioni

Recently, image manipulation has achieved rapid growth due to the advancement of sophisticated image editing tools. A recent surge of generated fake imagery and videos using neural networks is DeepFake. DeepFake algorithms can create fake…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Naciye Celebi , Qingzhong Liu , Muhammed Karatoprak

With the arrival of several face-swapping applications such as FaceApp, SnapChat, MixBooth, FaceBlender and many more, the authenticity of digital media content is hanging on a very loose thread. On social media platforms, videos are widely…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Akash Kumar , Arnav Bhavsar

This paper presents a novel deep neural network (DNN) for multimodal fusion of audio, video and text modalities for emotion recognition. The proposed DNN architecture has independent and shared layers which aim to learn the representation…

Computer Vision and Pattern Recognition · Computer Science 2019-07-09 Juan D. S. Ortega , Mohammed Senoussaoui , Eric Granger , Marco Pedersoli , Patrick Cardinal , Alessandro L. Koerich

The rise of deepfake technology brings forth new questions about the authenticity of various forms of media found online today. Videos and images generated by artificial intelligence (AI) have become increasingly more difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Benjamin Carter , Nathan Dilla , Micheal Callahan , Atuhaire Ambala

Audio-visual deepfake detection scrutinizes manipulations in public video using complementary multimodal cues. Current methods, which train on fused multimodal data for multimodal targets face challenges due to uncertainties and…

Multimedia · Computer Science 2024-01-12 Heqing Zou , Meng Shen , Yuchen Hu , Chen Chen , Eng Siong Chng , Deepu Rajan

We present a novel approach for the detection of deepfake videos using a pair of vision transformers pre-trained by a self-supervised masked autoencoding setup. Our method consists of two distinct components, one of which focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Sayantan Das , Mojtaba Kolahdouzi , Levent Özparlak , Will Hickie , Ali Etemad

Currently, the rapid development of computer vision and deep learning has enabled the creation or manipulation of high-fidelity facial images and videos via deep generative approaches. This technology, also known as deepfake, has achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Lixia Ma , Puning Yang , Yuting Xu , Ziming Yang , Peipei Li , Huaibo Huang

Most work on automated deception detection (ADD) in video has two restrictions: (i) it focuses on a video of one person, and (ii) it focuses on a single act of deception in a one or two minute video. In this paper, we propose a new ADD…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Chongyang Bai , Maksim Bolonkin , Judee Burgoon , Chao Chen , Norah Dunbar , Bharat Singh , V. S. Subrahmanian , Zhe Wu

In this paper, we consider the use of deep neural networks in the context of Multiple-Input-Multiple-Output (MIMO) detection. We give a brief introduction to deep learning and propose a modern neural network architecture suitable for this…

Machine Learning · Statistics 2017-06-06 Neev Samuel , Tzvi Diskin , Ami Wiesel

Recent advances in AI technology have made the forgery of digital images and videos easier, and it has become significantly more difficult to identify such forgeries. These forgeries, if disseminated with malicious intent, can negatively…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Chia-Mu Yu , Ching-Tang Chang , Yen-Wu Ti

Fake portrait video generation techniques have been posing a new threat to the society with photorealistic deep fakes for political propaganda, celebrity imitation, forged evidences, and other identity related manipulations. Following these…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Umur Aybars Ciftci , Ilke Demir , Lijun Yin

Advances in computer vision and deep learning have blurred the line between deepfakes and authentic media, undermining multimedia credibility through audio-visual forgery. Current multimodal detection methods remain limited by unbalanced…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zihan Xiong , Xiaohua Wu , Lei Chen , Fangqi Lou

Sophisticated instrumentation for AI systems might have indicators that signal misalignment from human values, not unlike a "check engine" light in cars. One such indicator of misalignment is deceptiveness in generated responses. Future AI…

Artificial Intelligence · Computer Science 2025-09-18 Gerard Boxo , Ryan Socha , Daniel Yoo , Shivam Raval

Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detection remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Chunlei Peng , Huiqing Guo , Decheng Liu , Nannan Wang , Ruimin Hu , Xinbo Gao

The proliferation of videos generated by diffusion models has raised increasing concerns about information security, highlighting the urgent need for reliable detection of synthetic media. Existing methods primarily focus on image-level…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xiaohong Liu , Xiufeng Song , Huayu Zheng , Lei Bai , Xiaoming Liu , Guangtao Zhai