English
Related papers

Related papers: DiMoDif: Discourse Modality-information Differenti…

200 papers

Audio deepfake detection is an emerging active topic. A growing number of literatures have aimed to study deepfake detection algorithms and achieved effective performance, the problem of which is far from being solved. Although there are…

Sound · Computer Science 2023-08-30 Jiangyan Yi , Chenglong Wang , Jianhua Tao , Xiaohui Zhang , Chu Yuan Zhang , Yan Zhao

With the rapid development of deep learning techniques, the generation and counterfeiting of multimedia material are becoming increasingly straightforward to perform. At the same time, sharing fake content on the web has become so simple…

Multimedia · Computer Science 2022-09-19 Davide Salvi , Brian Hosler , Paolo Bestagini , Matthew C. Stamm , Stefano Tubaro

The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous studies on detecting artificial intelligence-generated fake videos only utilize visual modality or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

The rise of manipulated media has made deepfakes a particularly insidious threat, involving various generative manipulations such as lip-sync modifications, face-swaps, and avatar-driven facial synthesis. Conventional detection methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Soumyya Kanti Datta , Tanvi Ranga , Chengzhe Sun , Siwei Lyu

Existing deepfake detection research has primarily focused on scenarios where the manipulated subject is actively speaking, i.e., generating fabricated content by altering the speaker's appearance or voice. However, in realistic interaction…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Miao Liu , Fangda Wei , Jing Wang , Xinyuan Qian

Multimodal deepfakes are proliferating on social media and threaten authenticity, information integrity, and digital forensics. Existing benchmarks are constrained by their single-modality scope, simplified manipulations, or unrealistic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tianxiao Li , Zhenglin Huang , Haiquan Wen , Yiwei He , Xinze Li , Bingyu Zhu , Wuhui Duan , Congang Chen , Zeyu Fu , Yi Dong , Baoyuan Wu , Jason Li , Guangliang Cheng

Audio deepfake detection has become increasingly challenging due to rapid advances in speech synthesis and voice conversion technologies, particularly under channel distortions, replay attacks, and real-world recording conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 K. A. Shahriar

Multimodal fake news detection is crucial for mitigating adversarial misinformation. Existing methods, relying on static fusion or LLMs, face computational redundancy and hallucination risks due to weak visual foundations. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Weilin Zhou , Zonghao Ying , Chunlei Meng , Jiahui Liu , Hengyang Zhou , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

The rapid progress of generative AI has enabled hyper-realistic audio-visual deepfakes, intensifying threats to personal security and social trust. Most existing deepfake detectors rely either on uni-modal artifacts or audio-visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Jielun Peng , Yabin Wang , Yaqi Li , Long Kong , Xiaopeng Hong

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Peter Grönquist , Yufan Ren , Qingyi He , Alessio Verardo , Sabine Süsstrunk

Video multimodal fusion aims to integrate multimodal signals in videos, such as visual, audio and text, to make a complementary prediction with multiple modalities contents. However, unlike other image-text multimodal tasks, video has…

Computation and Language · Computer Science 2023-06-01 Shaoxiang Wu , Damai Dai , Ziwei Qin , Tianyu Liu , Binghuai Lin , Yunbo Cao , Zhifang Sui

Multimodal generative models are rapidly evolving, leading to a surge in the generation of realistic video and audio that offers exciting possibilities but also serious risks. Deepfake videos, which can convincingly impersonate individuals,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Hannah Lee , Changyeon Lee , Kevin Farhat , Lin Qiu , Steve Geluso , Aerin Kim , Oren Etzioni

The task of deepfakes detection is far from being solved by speech or vision researchers. Several publicly available databases of fake synthetic video and speech were built to aid the development of detection methods. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Pavel Korshunov , Haolin Chen , Philip N. Garner , Sebastien Marcel

The rapid advancement of generative artificial intelligence has enabled the creation of highly realistic fake facial images, posing serious threats to personal privacy and the integrity of online information. Existing deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Huanhuan Yuan , Yang Ping , Zhengqin Xu , Junyi Cao , Shuai Jia , Chao Ma

Audio-visual (AV) lip biometrics is a promising authentication technique that leverages the benefits of both the audio and visual modalities in speech communication. Previous works have demonstrated the usefulness of AV lip biometrics.…

Multimedia · Computer Science 2021-04-27 Meng Liu , Longbiao Wang , Kong Aik Lee , Hanyi Zhang , Chang Zeng , Jianwu Dang

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid

Multimodal deepfakes involving audiovisual manipulations are a growing threat because they are difficult to detect with the naked eye or using unimodal deep learningbased forgery detection methods. Audiovisual forensic models, while more…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

The rapid surge of text-to-speech and face-voice reenactment models makes video fabrication easier and highly realistic. To encounter this problem, we require datasets that rich in type of generation methods and perturbation strategy which…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Zhixi Cai , Kartik Kuckreja , Shreya Ghosh , Akanksha Chuchra , Muhammad Haris Khan , Usman Tariq , Tom Gedeon , Abhinav Dhall

Audio-visual temporal deepfake localization under the content-driven partial manipulation remains a highly challenging task. In this scenario, the deepfake regions are usually only spanning a few frames, with the majority of the rest…

Recent multimodal deepfake detection methods designed for generalization conjecture that single-stage supervised training struggles to generalize across unseen manipulations and datasets. However, such approaches that target generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Ashutosh Anshul , Shreyas Gopal , Deepu Rajan , Eng Siong Chng
‹ Prev 1 3 4 5 6 7 10 Next ›