中文
相关论文

相关论文: Leveraging large multimodal models for audio-video…

200 篇论文

Most deepfake detection methods focus on detecting spatial and/or spatio-temporal changes in facial attributes and are centered around the binary classification task of detecting whether a video is real or fake. This is because available…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Zhixi Cai , Shreya Ghosh , Abhinav Dhall , Tom Gedeon , Kalin Stefanov , Munawar Hayat

Audio-visual deepfake detection typically employs a complementary multi-modal model to check the forgery traces in the video. These methods primarily extract forgery traces through audio-visual alignment, which results from the…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Fangda Wei , Miao Liu , Yingxue Wang , Jing Wang , Shenghui Zhao , Nan Li

Current Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misalignment of their knowledge and…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Peipeng Yu , Jianwei Fei , Hui Gao , Xuan Feng , Zhihua Xia , Chip Hong Chang

In the digital age, the emergence of deepfakes and synthetic media presents a significant threat to societal and political integrity. Deepfakes based on multi-modal manipulation, such as audio-visual, are more realistic and pose a greater…

声音 · 计算机科学 2024-08-08 Vinaya Sree Katamneni , Ajita Rattani

The threat of Audio-Video (AV) forgery is rapidly evolving beyond human-centric deepfakes to include more diverse manipulations across complex natural scenes. However, existing benchmarks are still confined to DeepFake-based forgeries and…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Shuhan Xia , Peipei Li , Xuannan Liu , Dongsen Zhang , Xinyu Guo , Zekun Li

With the rapid development of deepfake technology, simply making a binary judgment of true or false on audio is no longer sufficient to meet practical needs. Accurately determining the specific deepfake method has become crucial. This paper…

音频与语音处理 · 电气工程与系统科学 2025-09-11 Li Wang , Junyi Ao , Linyong Gan , Yuancheng Wang , Xueyao Zhang , Zhizheng Wu

The rapid advancement of Audio Large Language Models (ALLMs) has enabled cost-effective, high-fidelity generation and manipulation of both speech and non-speech audio, including sound effects, singing voices, and music. While these…

Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attributes, and adversarial perturbation-based spatio-temporal…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhixi Cai , Kalin Stefanov , Abhinav Dhall , Munawar Hayat

The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous studies on detecting artificial intelligence-generated fake videos only utilize visual modality or…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

Automatic Deception Detection has been a hot research topic for a long time, using machine learning and deep learning to automatically detect deception, brings new light to this old field. In this paper, we proposed a voting-based method…

机器学习 · 计算机科学 2024-03-18 Lana Touma , Mohammad Al Horani , Manar Tailouni , Anas Dahabiah , Khloud Al Jallad

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

声音 · 计算机科学 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua

With the continuous improvements of deepfake methods, forgery messages have transitioned from single-modality to multi-modal fusion, posing new challenges for existing forgery detection algorithms. In this paper, we propose AVT2-DWF, the…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Rui Wang , Dengpan Ye , Long Tang , Yunming Zhang , Jiacheng Deng

Significant advancements made in the generation of deepfakes have caused security and privacy issues. Attackers can easily impersonate a person's identity in an image by replacing his face with the target person's face. Moreover, a new…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Hasam Khalid , Minha Kim , Shahroz Tariq , Simon S. Woo

With the rapid development of speech synthesis and voice conversion technologies, Audio Deepfake has become a serious threat to the Automatic Speaker Verification (ASV) system. Numerous countermeasures are proposed to detect this type of…

音频与语音处理 · 电气工程与系统科学 2024-01-11 Yinlin Guo , Haofan Huang , Xi Chen , He Zhao , Yuehai Wang

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

计算机视觉与模式识别 · 计算机科学 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

As synthetic media, including video, audio, and text, become increasingly indistinguishable from real content, the risks of misinformation, identity fraud, and social manipulation escalate. This survey traces the evolution of deepfake…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Ping Liu , Qiqi Tao , Joey Tianyi Zhou

As AI-generated content (AIGC) thrives, deepfakes have expanded from single-modality falsification to cross-modal fake content creation, where either audio or visual components can be manipulated. While using two unimodal detectors can…

多媒体 · 计算机科学 2024-10-28 Cai Yu , Peng Chen , Jiahe Tian , Jin Liu , Jiao Dai , Xi Wang , Yesheng Chai , Shan Jia , Siwei Lyu , Jizhong Han

This paper presents a system for detecting fake audio-visual content (i.e., video deepfake), developed for Track 2 of the DDL Challenge. The proposed system employs a two-stage framework, comprising unimodal detection and multimodal score…

多媒体 · 计算机科学 2026-02-03 Qingcao Li , Miao He , Liang Yi , Qing Wen , Yitao Zhang , Hongshuo Jin , Peng Cheng , Zhongjie Ba , Li Lu , Kui Ren

Multimodal deepfakes involving audiovisual manipulations are a growing threat because they are difficult to detect with the naked eye or using unimodal deep learningbased forgery detection methods. Audiovisual forensic models, while more…

计算机视觉与模式识别 · 计算机科学 2024-11-15 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

The impressive achievements of generative models in creating high-quality videos have raised concerns about digital integrity and privacy vulnerabilities. Recent works of AI-generated content detection have been widely studied in the image…

计算机视觉与模式识别 · 计算机科学 2025-02-24 Qingyuan Liu , Yun-Yun Tsai , Ruijian Zha , Victoria Li , Pengyuan Shi , Chengzhi Mao , Junfeng Yang