English
Related papers

Related papers: FauForensics: Boosting Audio-Visual Deepfake Detec…

200 papers

Detecting deepfakes has been an increasingly important topic, especially given the rapid development of AI generation techniques. In this paper, we ask: How can we build a universal detection framework that is effective for most facial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Long Ma , Zhiyuan Yan , Jin Xu , Yize Chen , Qinglang Guo , Zhen Bi , Yong Liao , Hui Lin

DeepFake technology has gained significant attention due to its ability to manipulate facial attributes with high realism, raising serious societal concerns. Face-Swap DeepFake is the most harmful among these techniques, which fabricates…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Pu Sun , Honggang Qi , Yuezun Li

Expressions and facial action units (AUs) are two levels of facial behavior descriptors. Expression auxiliary information has been widely used to improve the AU detection performance. However, most existing expression representations can…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Rudong An , Wei Zhang , Hao Zeng , Wei Chen , Zhigang Deng , Yu Ding

Detecting deception by human behaviors is vital in many fields such as custom security and multimedia anti-fraud. Recently, audio-visual deception detection attracts more attention due to its better performance than using only a single…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Zhaoxu Li , Zitong Yu , Nithish Muthuchamy Selvaraj , Xiaobao Guo , Bingquan Shen , Adams Wai-Kin Kong , Alex Kot

Audio deepfakes represent a growing threat to digital security and trust, leveraging advanced generative models to produce synthetic speech that closely mimics real human voices. Detecting such manipulations is especially challenging under…

Sound · Computer Science 2025-05-01 Andrea Di Pierno , Luca Guarnera , Dario Allegra , Sebastiano Battiato

Audio-Visual Question Answering (AVQA) is a challenging multimodal reasoning task requiring intelligent systems to answer natural language queries based on paired audio-video inputs accurately. However, existing AVQA approaches often suffer…

Multimedia · Computer Science 2025-04-03 Jie Ma , Zhitao Gao , Qi Chai , Jun Liu , Pinghui Wang , Jing Tao , Zhou Su

The proliferation of sophisticated AI-generated deepfakes poses critical challenges for digital media authentication and societal security. While existing detection methods perform well within specific generative domains, they exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Naseem Khan , Tuan Nguyen , Amine Bermak , Issa Khalil

Advancements in AI-synthesized human voices have created a growing threat of impersonation and disinformation, making it crucial to develop methods to detect synthetic human voices. This study proposes a new approach to identifying…

Sound · Computer Science 2023-04-28 Chengzhe Sun , Shan Jia , Shuwei Hou , Siwei Lyu

The rapid advancement of generative AI has enabled the mass production of photorealistic synthetic images, blurring the boundary between authentic and fabricated visual content. This challenge is particularly evident in deepfake scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Minsun Jeon , Simon S. Woo

Generalizing deepfake detection to unseen manipulations remains a key challenge. A recent approach to tackle this issue is to train a network with pristine face images that have been manipulated with hand-crafted artifacts to extract more…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Alejandro Cobo , Roberto Valle , José Miguel Buenaposada , Luis Baumela

Detecting and grounding multi-modal media manipulation (DGM^4) has become increasingly crucial due to the widespread dissemination of face forgery and text misinformation. In this paper, we present the Unified Frequency-Assisted transFormer…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Huan Liu , Zichang Tan , Qiang Chen , Yunchao Wei , Yao Zhao , Jingdong Wang

Existing DeepFake detection techniques primarily focus on facial manipulations, such as face-swapping or lip-syncing. However, advancements in text-to-video (T2V) and image-to-video (I2V) generative models now allow fully AI-generated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Rohit Kundu , Hao Xiong , Vishal Mohanty , Athula Balachandran , Amit K. Roy-Chowdhury

The rapid advancement of generative models has enabled highly realistic audio deepfakes, yet current detectors suffer from a critical bias problem, leading to poor generalization across unseen datasets. This paper proposes Artifact-Focused…

While deep learning technologies are now capable of generating realistic images confusing humans, the research efforts are turning to the synthesis of images for more concrete and application-specific purposes. Facial image generation based…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Yeqi Bai , Tao Ma , Lipo Wang , Zhenjie Zhang

The rapid emergence of multimodal deepfakes (visual and auditory content are manipulated in concert) undermines the reliability of existing detectors that rely solely on modality-specific artifacts or cross-modal inconsistencies. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yuxuan Du , Zhendong Wang , Yuhao Luo , Caiyong Piao , Zhiyuan Yan , Hao Li , Li Yuan

Facial recognition systems are vulnerable to physical (e.g., printed photos) and digital (e.g., DeepFake) face attacks. Existing methods struggle to simultaneously detect physical and digital attacks due to: 1) significant intra-class…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yongze Li , Ning Li , Ajian Liu , Hui Ma , Liying Yang , Xihong Chen , Zhiyao Liang , Yanyan Liang , Jun Wan , Zhen Lei

Deepfake detection is crucial for curbing the harm it causes to society. However, current Deepfake detection methods fail to thoroughly explore artifact information across different domains due to insufficient intrinsic interactions. These…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Xueqi Qiu , Xingyu Miao , Fan Wan , Haoran Duan , Tejal Shah , Varun Ojhab , Yang Longa , Rajiv Ranjan

Generative models have surged in popularity recently due to their ability to produce high-quality images and video. However, steering these models to produce images with specific attributes and precise control remains challenging. Humans,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Tuomas Varanka , Huai-Qian Khor , Yante Li , Mengting Wei , Hanwei Kung , Nicu Sebe , Guoying Zhao

Face identity provides a powerful signal for deepfake detection. Prior studies show that even when not explicitly modeled, classifiers often learn identity features implicitly. This has led to conflicting views: some suppress identity cues…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Younghun Kim , Minsuk Jang , Myung-Joon Kwon , Wonjun Lee , Changick Kim

The rapid advancement of speech synthesis and voice conversion technologies has raised significant security concerns in multimedia forensics. Although current detection models demonstrate impressive performance, they struggle to maintain…

Sound · Computer Science 2025-11-26 Wangjie Li , Lin Li , Qingyang Hong