English
Related papers

Related papers: A Deep Learning Approach for Multimodal Deception …

200 papers

Multimodal manipulations (also known as audio-visual deepfakes) make it difficult for unimodal deepfake detectors to detect forgeries in multimedia content. To avoid the spread of false propaganda and fake news, timely detection is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

The fast and continuous growth in number and quality of deepfake videos calls for the development of reliable detection systems capable of automatically warning users on social media and on the Internet about the potential untruthfulness of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Luca Bondi , Edoardo Daniele Cannas , Paolo Bestagini , Stefano Tubaro

In the era of rapid digitalization and artificial intelligence advancements, the development of DeepFake technology has posed significant security and privacy concerns. This paper presents an effective measure to assess the visual realism…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Luka Dragar , Peter Peer , Vitomir Štruc , Borut Batagelj

Social media platforms like Twitter, Facebook, and Instagram have facilitated the spread of misinformation, necessitating automated detection systems. This systematic review evaluates 36 studies that apply machine learning (ML) and deep…

Machine Learning · Computer Science 2025-06-24 Yunchong Liu , Xiaorui Shen , Yeyubei Zhang , Zhongyan Wang , Yexin Tian , Jianglai Dai , Yuchen Cao

Face manipulation technology is advancing very rapidly, and new methods are being proposed day by day. The aim of this work is to propose a deepfake detector that can cope with the wide variety of manipulation methods and scenarios…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Davide Cozzolino , Alessandro Pianese , Matthias Nießner , Luisa Verdoliva

Online multi-object tracking is a fundamental problem in time-critical video analysis applications. A major challenge in the popular tracking-by-detection framework is how to associate unreliable detection results with existing tracks. In…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Long Chen , Haizhou Ai , Zijie Zhuang , Chong Shang

Deepfake is a deep learning-based technique that makes it easy to change or modify images and videos. In investigations and court, visual evidence is commonly employed, but these pieces of evidence may now be suspect due to technological…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Kundan Patil , Shrushti Kale , Jaivanti Dhokey , Abhishek Gulhane

The goal of this work is to enhance balanced multimodal understanding in audio-visual large language models (AV-LLMs) by addressing modality bias without additional training. In current AV-LLMs, audio and video features are typically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Chaeyoung Jung , Youngjoon Jang , Jongmin Choi , Joon Son Chung

Synthetically-generated audios and videos -- so-called deep fakes -- continue to capture the imagination of the computer-graphics and computer-vision communities. At the same time, the democratization of access to technology that can create…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Shruti Agarwal , Tarek El-Gaaly , Hany Farid , Ser-Nam Lim

Recent deep learning based video synthesis approaches, in particular with applications that can forge identities such as "DeepFake", have raised great security concerns. Therefore, corresponding deep forensic methods are proposed to tackle…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Gengxing Wang , Jiahuan Zhou , Ying Wu

One of the key factors of enabling machine learning models to comprehend and solve real-world tasks is to leverage multimodal data. Unfortunately, annotation of multimodal data is challenging and expensive. Recently, self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Elad Amrani , Rami Ben-Ari , Daniel Rotman , Alex Bronstein

While Vision-Language Models (VLMs) and Multimodal Large Language Models (MLLMs) have shown strong generalisation in detecting image and video deepfakes, their use for audio deepfake detection remains largely unexplored. In this work, we…

Sound · Computer Science 2026-01-05 Akanksha Chuchra , Shukesh Reddy , Sudeepta Mishra , Abhijit Das , Abhinav Dhall

Deep learning has enabled realistic face manipulation (i.e., deepfake), which poses significant concerns over the integrity of the media in circulation. Most existing deep learning techniques for deepfake detection can achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Bosheng Yan , Chang-Tsun Li , Xuequan Lu

Detecting video deepfakes has become increasingly urgent in recent years. Given the audio-visual information in videos, existing methods typically expose deepfakes by modeling cross-modal correspondence using specifically designed…

Multimedia · Computer Science 2026-04-13 Zihe Wei , Yuezun Li

Deepfakes are the result of digital manipulation to forge realistic yet fake imagery. With the astonishing advances in deep generative models, fake images or videos are nowadays obtained using variational autoencoders (VAEs) or Generative…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Davide Coccomini , Nicola Messina , Claudio Gennaro , Fabrizio Falchi

Despite the great impact of lies in human societies and a meager 54% human accuracy for Deception Detection (DD), Machine Learning systems that perform automated DD are still not viable for proper application in real-life settings due to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Mateus Karvat Camara , Adriana Postal , Tomas Henrique Maul , Gustavo Paetzold

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

Deep learning models have achieved excellent recognition results on large-scale video benchmarks. However, they perform poorly when applied to videos with rare scenes or objects, primarily due to the bias of existing video datasets. We…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Haodong Duan , Yue Zhao , Kai Chen , Yuanjun Xiong , Dahua Lin

Recent advances in video manipulation techniques have made the generation of fake videos more accessible than ever before. Manipulated videos can fuel disinformation and reduce trust in media. Therefore detection of fake videos has garnered…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Shehzeen Hussain , Paarth Neekhara , Malhar Jere , Farinaz Koushanfar , Julian McAuley

The detection of digital face manipulation in video has attracted extensive attention due to the increased risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yuhang Lu , Touradj Ebrahimi