English
Related papers

Related papers: Contextual Cross-Modal Attention for Audio-Visual …

200 papers

Event classification is inherently sequential and multimodal. Therefore, deep neural models need to dynamically focus on the most relevant time window and/or modality of a video. In this study, we propose the Multi-level Attention Fusion…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Mathilde Brousmiche , Jean Rouat , Stéphane Dupont

In the digital age, Deepfake present a formidable challenge by using advanced artificial intelligence to create highly convincing manipulated content, undermining information authenticity and security. These sophisticated fabrications…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Subhram Dasgupta , Janelle Mason , Xiaohong Yuan , Olusola Odeyomi , Kaushik Roy

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

While the significant advancements have made in the generation of deepfakes using deep learning technologies, its misuse is a well-known issue now. Deepfakes can cause severe security and privacy issues as they can be used to impersonate a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Hasam Khalid , Shahroz Tariq , Minha Kim , Simon S. Woo

In recent years, deepfakes (DFs) have been utilized for malicious purposes, such as individual impersonation, misinformation spreading, and artists style imitation, raising questions about ethical and security concerns. In this survey, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Hong-Hanh Nguyen-Le , Van-Tuan Tran , Dinh-Thuc Nguyen , Nhien-An Le-Khac

With the rapid advancement of generative AI, multimodal deepfakes, which manipulate both audio and visual modalities, have drawn increasing public concern. Currently, deepfake detection has emerged as a crucial strategy in countering these…

Sound · Computer Science 2024-05-16 Yang Hou , Haitao Fu , Chuankai Chen , Zida Li , Haoyu Zhang , Jianjun Zhao

With the rapid development of artificial intelligence technology, the application of deepfake technology in the audio field has gradually increased, resulting in a wide range of security risks. Especially in the financial and social…

Sound · Computer Science 2024-12-13 Yangguang Feng

Audio DeepFakes allow the creation of high-quality, convincing utterances and therefore pose a threat due to its potential applications such as impersonation or fake news. Methods for detecting these manipulations should be characterized by…

Sound · Computer Science 2022-10-13 Piotr Kawa , Marcin Plata , Piotr Syga

Deepfakes pose a significant threat to digital media security, with current detection methods struggling to generalize across different manipulation techniques and datasets. While recent approaches combine CNN-based architectures with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Pavan C Shekar , Pawan Soni , Vivek Kanhangad

Multimodal deepfakes can exhibit subtle visual artifacts and cross-modal inconsistencies, which remain challenging to detect, especially when detectors are trained primarily on curated synthetic forgeries. Such synthetic dependence can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sahibzada Adil Shahzad , Ammarah Hashmi , Junichi Yamagishi , Yusuke Yasuda , Yu Tsao , Chia-Wen Lin , Yan-Tsung Peng , Hsin-Min Wang

Face forgery by deepfake is widely spread over the internet and has raised severe societal concerns. Recently, how to detect such forgery contents has become a hot research topic and many deepfake detection methods have been proposed. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Hanqing Zhao , Wenbo Zhou , Dongdong Chen , Tianyi Wei , Weiming Zhang , Nenghai Yu

Altered and manipulated multimedia is increasingly present and widely distributed via social media platforms. Advanced video manipulation tools enable the generation of highly realistic-looking altered multimedia. While many methods have…

The proliferation of multi-modal fake news on social media poses a significant threat to public trust and social stability. Traditional detection methods, primarily text-based, often fall short due to the deceptive interplay between…

Cryptography and Security · Computer Science 2025-08-11 Junhao He , Tianyu Liu , Jingyuan Zhao , Benjamin Turner

Most deepfake detection methods focus on detecting spatial and/or spatio-temporal changes in facial attributes and are centered around the binary classification task of detecting whether a video is real or fake. This is because available…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhixi Cai , Shreya Ghosh , Abhinav Dhall , Tom Gedeon , Kalin Stefanov , Munawar Hayat

With the continuous improvements of deepfake methods, forgery messages have transitioned from single-modality to multi-modal fusion, posing new challenges for existing forgery detection algorithms. In this paper, we propose AVT2-DWF, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Rui Wang , Dengpan Ye , Long Tang , Yunming Zhang , Jiacheng Deng

Deepfakes is a branch of malicious techniques that transplant a target face to the original one in videos, resulting in serious problems such as infringement of copyright, confusion of information, or even public panic. Previous efforts for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Zekun Sun , Yujie Han , Zeyu Hua , Na Ruan , Weijia Jia

Multimodal manipulations (also known as audio-visual deepfakes) make it difficult for unimodal deepfake detectors to detect forgeries in multimedia content. To avoid the spread of false propaganda and fake news, timely detection is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

We address multimodal deepfake detection requiring both robustness and interpretability by proposing FakeHunter, a unified framework that combines memory guided retrieval, a structured Observation-Thought-Action reasoning loop, and adaptive…

Multimedia · Computer Science 2025-09-11 Chen Chen , Runze Li , Zejun Zhang , Pukun Zhao , Fanqing Zhou , Longxiang Wang , Haojian Huang

Self-supervised representations excel at many vision and speech tasks, but their potential for audio-visual deepfake detection remains underexplored. Unlike prior work that uses these features in isolation or buried within complex…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Dragos-Alexandru Boldisor , Stefan Smeu , Dan Oneata , Elisabeta Oneata

Audio deepfakes represent a growing threat to digital security and trust, leveraging advanced generative models to produce synthetic speech that closely mimics real human voices. Detecting such manipulations is especially challenging under…

Sound · Computer Science 2025-05-01 Andrea Di Pierno , Luca Guarnera , Dario Allegra , Sebastiano Battiato