English
Related papers

Related papers: MARE: Multimodal Alignment and Reinforcement for E…

200 papers

Deep-learning-based technologies such as deepfakes ones have been attracting widespread attention in both society and academia, particularly ones used to synthesize forged face images. These automatic and professional-skill-free face…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 YuYang Sun , ZhiYong Zhang , Isao Echizen , Huy H. Nguyen , ChangZhen Qiu , Lu Sun

Detecting AI-generated images with multimodal large language models (MLLMs) has gained increasing attention, due to their rich world knowledge, common-sense reasoning, and potential for explainability. However, naively applying those MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Kaiqing Lin , Zhiyuan Yan , Ruoxin Chen , Junyan Ye , Ke-Yue Zhang , Yue Zhou , Peng Jin , Bin Li , Taiping Yao , Shouhong Ding

Deepfake detection remains a challenging task due to the difficulty of generalizing to new types of forgeries. This problem primarily stems from the overfitting of existing detection methods to forgery-irrelevant features and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhiyuan Yan , Yong Zhang , Yanbo Fan , Baoyuan Wu

Detecting DeepFakes has become a crucial research area as the widespread use of AI image generators enables the effortless creation of face-manipulated and fully synthetic content, while existing methods are often limited to binary…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Rohit Kundu , Shan Jia , Vishal Mohanty , Athula Balachandran , Amit K. Roy-Chowdhury

Large Vision-Language Models excel at multimodal understanding but struggle to deeply integrate visual information into their predominantly text-based reasoning processes, a key challenge in mirroring human cognition. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ziwei Zheng , Michael Yang , Jack Hong , Chenxiao Zhao , Guohai Xu , Le Yang , Chao Shen , Xing Yu

The proliferation of highly realistic facial forgeries necessitates robust detection methods. However, existing approaches often suffer from limited accuracy and poor generalization due to significant distribution shifts among samples…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Jingwei Li , Jiaxin Tong , Pengfei Wu

Fake News and especially deepfakes (generated, non-real image or video content) have become a serious topic over the last years. With the emergence of machine learning algorithms it is now easier than ever before to generate such fake…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Lukas Kroiß , Johannes Reschke

The rapid progress in deep generative models has led to the creation of incredibly realistic synthetic images that are becoming increasingly difficult to distinguish from real-world data. The widespread use of Variational Models, Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Anant Mehta , Bryant McArthur , Nagarjuna Kolloju , Zhengzhong Tu

The rapid rise of deepfake technology poses a severe threat to social and political stability by enabling hyper-realistic synthetic media capable of manipulating public perception. However, existing detection methods struggle with two core…

Computation and Language · Computer Science 2026-01-27 Gautam Siddharth Kashyap , Harsh Joshi , Niharika Jain , Ebad Shabbir , Jiechao Gao , Nipun Joshi , Usman Naseem

The proliferation of DeepFake technology is a rising challenge in today's society, owing to more powerful and accessible generation methods. To counter this, the research community has developed detectors of ever-increasing accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Federico Baldassarre , Quentin Debard , Gonzalo Fiz Pontiveros , Tri Kurniawan Wijaya

The proliferation of synthetic images generated by advanced AI models poses significant challenges in identifying and understanding manipulated visual content. Current fake image detection methods predominantly rely on binary classification…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Ritabrata Chakraborty , Rajatsubhra Chakraborty , Ali Khaleghi Rahimian , Thomas MacDougall

Deepfake technologies empowered by deep learning are rapidly evolving, creating new security concerns for society. Existing multimodal detection methods usually capture audio-visual inconsistencies to expose Deepfake videos. More seriously,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Yu Chen , Yang Yu , Rongrong Ni , Yao Zhao , Haoliang Li

The amount of news being consumed online has substantially expanded in recent years. Fake news has become increasingly common, especially in regional languages like Malayalam, due to the rapid publication and lack of editorial standards on…

Computation and Language · Computer Science 2023-10-30 Adhish S. Sujan , Ajitha. V , Aleena Benny , Amiya M. P. , V. S. Anoop

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

Modern deepfakes have evolved into localized and intermittent manipulations that require fine-grained temporal localization to mitigate severe digital security risks. The prohibitive cost of frame-level annotation makes weakly supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Midou Guo , Qilin Yin , Wei Lu , Rui Yang

The rapid advancement of large vision-language models (LVLMs) has driven significant progress in multimodal tasks, enabling models to interpret, reason, and generate outputs across both visual and textual domains. While excelling in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Hao Yu , Zhuokai Zhao , Shen Yan , Lukasz Korycki , Jianyu Wang , Baosheng He , Jiayi Liu , Lizhu Zhang , Xiangjun Fan , Hanchao Yu

Reasoning about failures is crucial for building reliable and trustworthy robotic systems. Prior approaches either treat failure reasoning as a closed-set classification problem or assume access to ample human annotations. Failures in the…

Visual hallucination, where Multimodal Large Language Models fabricate details inconsistent with image content, critically undermines their reliability. Existing fine-tuning methods offer limited improvement, failing to deeply intervene in…

Computation and Language · Computer Science 2025-11-17 Filippo Morbiato , Luca Romano , Alessandro Persona

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

With the continuous improvements of deepfake methods, forgery messages have transitioned from single-modality to multi-modal fusion, posing new challenges for existing forgery detection algorithms. In this paper, we propose AVT2-DWF, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Rui Wang , Dengpan Ye , Long Tang , Yunming Zhang , Jiacheng Deng