中文
相关论文

相关论文: Contextual Cross-Modal Attention for Audio-Visual …

200 篇论文

Facial manipulation by deep fake has caused major security risks and raised severe societal concerns. As a countermeasure, a number of deep fake detection methods have been proposed recently. Most of them model deep fake detection as a…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Aakash Varma Nadimpalli , Ajita Rattani

Current deepfake detection models achieve state-of-the-art performance on pristine academic datasets but suffer severe spatial attention drift under real-world compound degradations, such as blurring and severe lossy compression. To address…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Minh-Khoa Le-Phan , Minh-Hoang Le , Trong-Le Do , Minh-Triet Tran

All current benchmarks for multimodal deepfake detection manipulate entire frames using various generation techniques, resulting in oversaturated detection accuracies exceeding 94% at the video-level classification. However, these…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Juho Jung , Sangyoun Lee , Jooeon Kang , Yunjin Na

This perspective calls for scholars across disciplines to address the challenge of audio deepfake detection and discernment through an interdisciplinary lens across Artificial Intelligence methods and linguistics. With an avalanche of tools…

声音 · 计算机科学 2024-11-12 Vandana P. Janeja , Christine Mallinson

The audio-visual event localization task requires identifying concurrent visual and auditory events from unconstrained videos within a network model, locating them, and classifying their category. The efficient extraction and integration of…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Xiang He , Xiangxi Liu , Yang Li , Dongcheng Zhao , Guobin Shen , Qingqun Kong , Xin Yang , Yi Zeng

Multi-modal face anti-spoofing (FAS) aims to detect genuine human presence by extracting discriminative liveness cues from multiple modalities, such as RGB, infrared (IR), and depth images, to enhance the robustness of biometric…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Jun-Xiong Chong , Fang-Yu Hsu , Ming-Tsung Hsu , Yi-Ting Lin , Kai-Heng Chien , Chiou-Ting Hsu , Pei-Kai Huang

This paper reviews the state-of-the-art in deepfake generation and detection, focusing on modern deep learning technologies and tools based on the latest scientific advancements. The rise of deepfakes, leveraging techniques like Variational…

密码学与安全 · 计算机科学 2025-01-14 Arash Dehghani , Hossein Saberi

In this new digital era, social media has created a severe impact on the lives of people. In recent times, fake news content on social media has become one of the major challenging problems for society. The dissemination of fabricated and…

多媒体 · 计算机科学 2023-03-14 Ashima Yadav , Shivani Gaba , Haneef Khan , Ishan Budhiraja , Akansha Singh , Krishan Kant Singh

Automatic deception detection is an important task that has gained momentum in computational linguistics due to its potential applications. In this paper, we propose a simple yet tough to beat multi-modal neural model for deception…

计算与语言 · 计算机科学 2018-03-21 Gangeshwar Krishnamurthy , Navonil Majumder , Soujanya Poria , Erik Cambria

The increasing popularity of social media promotes the proliferation of fake news. With the development of multimedia technology, fake news attempts to utilize multimedia contents with images or videos to attract and mislead readers for…

多媒体 · 计算机科学 2019-08-14 Peng Qi , Juan Cao , Tianyun Yang , Junbo Guo , Jintao Li

Recognizing multiple labels of images is a fundamental but challenging task in computer vision, and remarkable progress has been attained by localizing semantic-aware image regions and predicting their labels with deep convolutional neural…

计算机视觉与模式识别 · 计算机科学 2017-12-21 Tianshui Chen , Zhouxia Wang , Guanbin Li , Liang Lin

Recent advances in synthetic speech have made audio deepfakes increasingly realistic, posing significant security risks. Existing detection methods that rely on a single modality, either raw waveform embeddings or spectral based features,…

The landscape of social media content has evolved significantly, extending from text to multimodal formats. This evolution presents a significant challenge in combating misinformation. Previous research has primarily focused on single…

多媒体 · 计算机科学 2024-09-04 Zhe Fu , Kanlun Wang , Wangjiaxuan Xin , Lina Zhou , Shi Chen , Yaorong Ge , Daniel Janies , Dongsong Zhang

In this paper, we present a multi-modal online person verification system using both speech and visual signals. Inspired by neuroscientific findings on the association of voice and face, we propose an attention-based end-to-end neural…

计算机视觉与模式识别 · 计算机科学 2018-11-28 Suwon Shon , Tae-Hyun Oh , James Glass

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

多媒体 · 计算机科学 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

With the rapid development of speech synthesis and voice conversion technologies, Audio Deepfake has become a serious threat to the Automatic Speaker Verification (ASV) system. Numerous countermeasures are proposed to detect this type of…

音频与语音处理 · 电气工程与系统科学 2024-01-11 Yinlin Guo , Haofan Huang , Xi Chen , He Zhao , Yuehai Wang

The rapid evolution of deepfake technology, particularly in instruction-guided image editing, threatens the integrity of digital images by enabling subtle, context-aware manipulations. Generated conditionally from real images and textual…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Tuan Nguyen , Naseem Khan , Issa Khalil

Audio deepfakes generated by modern TTS and voice conversion systems are increasingly difficult to distinguish from real speech, raising serious risks for security and online trust. While state-of-the-art self-supervised models provide rich…

声音 · 计算机科学 2026-02-03 Zhili Nicholas Liang , Soyeon Caren Han , Qizhou Wang , Christopher Leckie

Audio DeepFakes are utterances generated with the use of deep neural networks. They are highly misleading and pose a threat due to use in fake news, impersonation, or extortion. In this work, we focus on increasing accessibility to the…

声音 · 计算机科学 2022-10-13 Piotr Kawa , Marcin Plata , Piotr Syga

Anomaly detection is a fundamental problem in data mining field with many real-world applications. A vast majority of existing anomaly detection methods predominately focused on data collected from a single source. In real-world…

机器学习 · 计算机科学 2019-08-13 Yuening Li , Ninghao Liu , Jundong Li , Mengnan Du , Xia Hu