English
Related papers

Related papers: Training-Free Multimodal Deepfake Detection via Gr…

200 papers

Multimodal reasoning in Large Language Models (LLMs) struggles with incomplete knowledge and hallucination artifacts, challenges that textual Knowledge Graphs (KGs) only partially mitigate due to their modality isolation. While Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Junming Liu , Siyuan Meng , Yanting Gao , Song Mao , Pinlong Cai , Guohang Yan , Yirong Chen , Zilin Bian , Ding Wang , Botian Shi

Existing deepfake detection techniques struggle to keep-up with the ever-evolving novel, unseen forgeries methods. This limitation stems from their reliance on statistical artifacts learned during training, which are often tied to specific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Guangyu Shen , Zhihua Li , Xiang Xu , Tianchen Zhao , Zheng Zhang , Dongsheng An , Zhuowen Tu , Yifan Xing , Qin Zhang

Large language models ($\textbf{LLMs}$) have emerged as a powerful method for discovery. Instead of utilizing numerical data, LLMs utilize associated variable $\textit{semantic metadata}$ to predict variable relationships. Simultaneously,…

Machine Learning · Computer Science 2025-04-15 Alex Havrilla , David Alvarez-Melis , Nicolo Fusi

Recent Deepfake Video Detection (DFD) studies have demonstrated that pre-trained Vision-Language Models (VLMs) such as CLIP exhibit strong generalization capabilities in detecting artifacts across different identities. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Jiawen Zhu , Yunqi Miao , Xueyi Zhang , Jiankang Deng , Guansong Pang

We propose a visual-linguistic representation learning approach within a self-supervised learning framework by introducing a new operation, loss, and data augmentation strategy. First, we generate diverse features for the image-text…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jaeyoo Park , Bohyung Han

Multimodal fake news detection is crucial for mitigating adversarial misinformation. Existing methods, relying on static fusion or LLMs, face computational redundancy and hallucination risks due to weak visual foundations. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Weilin Zhou , Zonghao Ying , Chunlei Meng , Jiahui Liu , Hengyang Zhou , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Multimodal learning enhances the performance of various machine learning tasks by leveraging complementary information across different modalities. However, existing methods often learn multimodal representations that retain substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tong Zhang , Shu Shen , C. L. Philip Chen

Current deepfake attribution or deepfake detection works tend to exhibit poor generalization to novel generative methods due to the limited exploration in visual modalities alone. They tend to assess the attribution or detection performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yaning Zhang , Linlin Shen , Zitong Yu , Chunjie Ma , Zan Gao

Multimodal Large Language Models (MLLMs) rely on strong linguistic reasoning inherited from their base language models. However, multimodal instruction fine-tuning paradoxically degrades this text's reasoning capability, undermining…

Computation and Language · Computer Science 2026-01-13 Zijing Wang , Yongkang Liu , Mingyang Wang , Ercong Nie , Deyuan Chen , Zhengjie Zhao , Shi Feng , Daling Wang , Xiaocui Yang , Yifei Zhang , Hinrich Schütze

Deepfake detection remains highly challenging, particularly in cross-dataset scenarios and complex real-world settings. This challenge mainly arises because artifact patterns vary substantially across different forgery methods, whereas…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiang Zhang , Wenliang Weng , Daoyong Fu , Beijing Chen , Ziqiang Li , Ziwen He , Zhangjie Fu

Visual latent reasoning lets a multimodal large language model (MLLM) create intermediate visual evidence as continuous tokens, avoiding external tools or image generators. However, existing methods usually follow an output-as-input latent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yanting Miao , Yutao Sun , Dexin Wang , Mengyu Zhou , Pascal Poupart , Lei Lv , Qi Zhao , Li Wang , Hao Li , Xiaoxi Jiang , Guanjun Jiang

The advent of Intelligent Tutoring Systems (ITSs) has marked a paradigm shift in education, enabling highly personalized learning pathways. However, true personalization requires adapting to learners' complex knowledge states (multi-source)…

Multiagent Systems · Computer Science 2025-11-17 Biqing Zeng , Mengquan Liu , Zongwei Zhen

DeepFakes, which refer to AI-generated media content, have become an increasing concern due to their use as a means for disinformation. Detecting DeepFakes is currently solved with programmed machine learning algorithms. In this work, we…

Artificial Intelligence · Computer Science 2024-06-12 Shan Jia , Reilin Lyu , Kangran Zhao , Yize Chen , Zhiyuan Yan , Yan Ju , Chuanbo Hu , Xin Li , Baoyuan Wu , Siwei Lyu

Recently, In-context Learning (ICL) has become a significant inference paradigm in Large Multimodal Models (LMMs), utilizing a few in-context demonstrations (ICDs) to prompt LMMs for new tasks. However, the synergistic effects in multimodal…

Machine Learning · Computer Science 2025-05-20 Yuchu Jiang , Jiale Fu , Chenduo Hao , Xinting Hu , Yingzhe Peng , Xin Geng , Xu Yang

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic…

Computation and Language · Computer Science 2024-10-01 Fengzhu Zeng , Wenqian Li , Wei Gao , Yan Pang

Multimodal sarcasm detection (MSD) is essential for various downstream tasks. Existing MSD methods tend to rely on spurious correlations. These methods often mistakenly prioritize non-essential features yet still make correct predictions,…

Computation and Language · Computer Science 2024-12-10 Diandian Guo , Cong Cao , Fangfang Yuan , Yanbing Liu , Guangjie Zeng , Xiaoyan Yu , Hao Peng , Philip S. Yu

Despite significant progress, recent studies indicate that current large language models (LLMs) may still capture dataset biases and utilize them during inference, leading to the poor generalizability of LLMs. However, due to the diversity…

Computation and Language · Computer Science 2025-05-28 Zhouhao Sun , Xiao Ding , Li Du , Yunpeng Xu , Yixuan Ma , Yang Zhao , Bing Qin , Ting Liu

Multimodal recommendation enhances accuracy by leveraging visual and textual signals, and its success largely depends on learning high-quality cross-modal representations. Recent advances in Large Vision-Language Models (LVLMs) offer…

Information Retrieval · Computer Science 2026-04-28 Zhongtao Rao , Peilin Zhou , Dading Chong , Zhiwei Chen , Shoujin Wang , Nan Tang

With the advancement of remote sensing satellite technology and the rapid progress of deep learning, remote sensing change detection (RSCD) has become a key technique for regional monitoring. Traditional change detection (CD) methods and…

Image and Video Processing · Electrical Eng. & Systems 2026-03-11 Chengming Wang , Guodong Fan , Jinjiang Li , Min Gan , C. L. Philip Chen