English
Related papers

Related papers: AVTENet: A Human-Cognition-Inspired Audio-Visual T…

200 papers

Deepfake technology has given rise to a spectrum of novel and compelling applications. Unfortunately, the widespread proliferation of high-fidelity fake videos has led to pervasive confusion and deception, shattering our faith that seeing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhongjie Ba , Qingyu Liu , Zhenguang Liu , Shuang Wu , Feng Lin , Li Lu , Kui Ren

The development of technologies for easily and automatically falsifying video has raised practical questions about people's ability to detect false information online. How vulnerable are people to deepfake videos? What technologies can be…

Human-Computer Interaction · Computer Science 2023-04-11 Emilie Josephs , Camilo Fosco , Aude Oliva

Event classification is inherently sequential and multimodal. Therefore, deep neural models need to dynamically focus on the most relevant time window and/or modality of a video. In this study, we propose the Multi-level Attention Fusion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mathilde Brousmiche , Jean Rouat , Stéphane Dupont

Research on the detection of AI-generated videos has focused almost exclusively on face videos, usually referred to as deepfakes. Manipulations like face swapping, face reenactment and expression manipulation have been the subject of an…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Omran Alamayreh , Mauro Barni

The rapid development of deep learning and generative AI technologies has profoundly transformed the digital contact landscape, creating realistic Deepfake that poses substantial challenges to public trust and digital media integrity. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ying Xu , Marius Pedersen , Kiran Raja

The rapid advancement in deep learning makes the differentiation of authentic and manipulated facial images and video clips unprecedentedly harder. The underlying technology of manipulating facial appearances through deep generative…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Sm Zobaed , Md Fazle Rabby , Md Istiaq Hossain , Ekram Hossain , Sazib Hasan , Asif Karim , Khan Md. Hasib

Audio-visual deepfake detection typically employs a complementary multi-modal model to check the forgery traces in the video. These methods primarily extract forgery traces through audio-visual alignment, which results from the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Fangda Wei , Miao Liu , Yingxue Wang , Jing Wang , Shenghui Zhao , Nan Li

Deepfakes are AI-generated media in which the original content is digitally altered to create convincing but manipulated images, videos, or audio. Among the various types of deepfakes, lip-syncing deepfakes are one of the most challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

This research addresses the challenge of developing a universal deepfake detector that can effectively identify unseen deepfake images despite limited training data. Existing frequency-based paradigms have relied on frequency-level…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Chuangchuang Tan , Yao Zhao , Shikui Wei , Guanghua Gu , Ping Liu , Yunchao Wei

Deepfakes generated by advanced generative models have rapidly posed serious threats, yet existing audiovisual deepfake detection approaches struggle to generalize to unseen manipulation methods. To address this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Hyemin Boo , Eunsang Lee , Jiyoung Lee

Deeplearning has been used to solve complex problems in various domains. As it advances, it also creates applications which become a major threat to our privacy, security and even to our Democracy. Such an application which is being…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Rahul U , Ragul M , Raja Vignesh K , Tejeswinee K

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

Fake videos represent an important misinformation threat. While existing forensic networks have demonstrated strong performance on image forgeries, recent results reported on the Adobe VideoSham dataset show that these networks fail to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Tai D. Nguyen , Shengbang Fang , Matthew C. Stamm

We address multimodal deepfake detection requiring both robustness and interpretability by proposing FakeHunter, a unified framework that combines memory guided retrieval, a structured Observation-Thought-Action reasoning loop, and adaptive…

Multimedia · Computer Science 2025-09-11 Chen Chen , Runze Li , Zejun Zhang , Pukun Zhao , Fanqing Zhou , Longxiang Wang , Haojian Huang

We propose a new deep network for audio event recognition, called AENet. In contrast to speech, sounds coming from audio events may be produced by a wide variety of sources. Furthermore, distinguishing them often requires analyzing an…

Multimedia · Computer Science 2017-01-05 Naoya Takahashi , Michael Gygli , Luc Van Gool

Deep-fake videos, generated through AI face-swapping techniques, have gained significant attention due to their potential for impactful impersonation attacks. While most research focuses on real vs. fake detection, attributing a deep-fake…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Wasim Ahmad , Yan-Tsung Peng , Yuan-Hao Chang , Gaddisa Olani Ganfure , Sarwar Khan

Multimodal deepfakes involving audiovisual manipulations are a growing threat because they are difficult to detect with the naked eye or using unimodal deep learningbased forgery detection methods. Audiovisual forensic models, while more…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

The task of deepfakes detection is far from being solved by speech or vision researchers. Several publicly available databases of fake synthetic video and speech were built to aid the development of detection methods. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Pavel Korshunov , Haolin Chen , Philip N. Garner , Sebastien Marcel

Video forgery detection is becoming an important issue in recent years, because modern editing software provide powerful and easy-to-use tools to manipulate videos. In this paper we propose to perform detection by means of deep learning,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-30 Dario D'Avino , Davide Cozzolino , Giovanni Poggi , Luisa Verdoliva

Unsupervised video object learning seeks to decompose video scenes into structural object representations without any supervision from depth, optical flow, or segmentation. We present VONet, an innovative approach that is inspired by MONet.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Haonan Yu , Wei Xu