English
Related papers

Related papers: A Deep Learning Approach for Multimodal Deception …

200 papers

Deepfake detection is a long-established research topic vital for mitigating the spread of malicious misinformation. Unlike prior methods that provide either binary classification results or textual explanations separately, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Xiao Guo , Xiufeng Song , Yue Zhang , Xiaohong Liu , Xiaoming Liu

Video forgery attack threatens the surveillance system by replacing the video captures with unrealistic synthesis, which can be powered by the latest augment reality and virtual reality technologies. From the machine perception aspect,…

Multimedia · Computer Science 2022-12-27 Chenhui Zhao , Xiang Li , Rabih Younes

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

The development of technologies for easily and automatically falsifying video has raised practical questions about people's ability to detect false information online. How vulnerable are people to deepfake videos? What technologies can be…

Human-Computer Interaction · Computer Science 2023-04-11 Emilie Josephs , Camilo Fosco , Aude Oliva

Conspicuous progression in the field of machine learning and deep learning have led the jump of highly realistic fake media, these media oftentimes referred as deepfakes. Deepfakes are fabricated media which are generated by sophisticated…

Machine Learning · Computer Science 2023-04-05 Aniruddha Tiwari , Rushit Dave , Mounika Vanamala

Inaccuracies in polygraph tests often lead to wrongful convictions, false information, and bias, all of which have significant consequences for both legal and political systems. Recently, analyzing facial micro-expressions has emerged as a…

The recent emergence of machine-manipulated media raises an important societal question: how can we know if a video that we watch is real or fake? In two online studies with 15,016 participants, we present authentic videos and deepfakes and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Matthew Groh , Ziv Epstein , Chaz Firestone , Rosalind Picard

In this paper, we present a deep learning based multimodal system for classifying daily life videos. To train the system, we propose a two-phase training strategy. In the first training phase (Phase I), we extract the audio and visual…

Sound · Computer Science 2023-05-03 Lam Pham , Trang Le , Cam Le , Dat Ngo , Weissenfeld Axel , Alexander Schindler

In the digital age, the emergence of deepfakes and synthetic media presents a significant threat to societal and political integrity. Deepfakes based on multi-modal manipulation, such as audio-visual, are more realistic and pose a greater…

Sound · Computer Science 2024-08-08 Vinaya Sree Katamneni , Ajita Rattani

Text-based misinformation permeates online discourses, yet evidence of people's ability to discern truth from such deceptive textual content is scarce. We analyze a novel TV game show data where conversations in a high-stake environment…

Computation and Language · Computer Science 2024-04-09 Sanchaita Hazra , Bodhisattwa Prasad Majumder

Recent advances in artificial intelligence make it progressively hard to distinguish between genuine and counterfeit media, especially images and videos. One recent development is the rise of deepfake videos, based on manipulating videos…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Rashmiranjan Das , Gaurav Negi , Alan F. Smeaton

Automated deception detection (ADD) from real-life videos is a challenging task. It specifically needs to address two problems: (1) Both face and body contain useful cues regarding whether a subject is deceptive. How to effectively fuse the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Mingyu Ding , An Zhao , Zhiwu Lu , Tao Xiang , Ji-Rong Wen

Deepfakes are synthetically generated images, videos or audios, which fraudsters use to manipulate legitimate information. Current deepfake detection systems struggle against unseen data. To address this, we employ three different deep…

Computer Vision and Pattern Recognition · Computer Science 2021-02-12 Sohail Ahmed Khan , Alessandro Artusi , Hang Dai

The rapid advancement in deep learning makes the differentiation of authentic and manipulated facial images and video clips unprecedentedly harder. The underlying technology of manipulating facial appearances through deep generative…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Sm Zobaed , Md Fazle Rabby , Md Istiaq Hossain , Ekram Hossain , Sazib Hasan , Asif Karim , Khan Md. Hasib

Automated systems that detect deception in high-stakes situations can enhance societal well-being across medical, social work, and legal domains. Existing models for detecting high-stakes deception in videos have been supervised, but…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Leena Mathur , Maja J Matarić

The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous studies on detecting artificial intelligence-generated fake videos only utilize visual modality or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

Detecting deception by human behaviors is vital in many fields such as custom security and multimedia anti-fraud. Recently, audio-visual deception detection attracts more attention due to its better performance than using only a single…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Zhaoxu Li , Zitong Yu , Nithish Muthuchamy Selvaraj , Xiaobao Guo , Bingquan Shen , Adams Wai-Kin Kong , Alex Kot

Whether an interviewee's honest and deceptive responses can be detected by facial expression signals in videos has been debated and requires further research. We developed deep learning models enabled by computer vision to extract temporal…

Human-Computer Interaction · Computer Science 2026-05-19 Hung-Yue Suen , Kuo-En Hung , Che-Wei Liu , Yu-Sheng Su , Han-Chih Fan

One of the most pressing challenges for the detection of face-manipulated videos is generalising to forgery methods not seen during training while remaining effective under common corruptions such as compression. In this paper, we examine…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Alexandros Haliassos , Rodrigo Mira , Stavros Petridis , Maja Pantic

In this paper, we propose to utilize Automated Machine Learning to adaptively search a neural architecture for deepfake detection. This is the first time to employ automated machine learning for deepfake detection. Based on our explored…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ping Liu , Yuewei Lin , Yang He , Yunchao Wei , Liangli Zhen , Joey Tianyi Zhou , Rick Siow Mong Goh , Jingen Liu