中文
相关论文

相关论文: VIGIL: Part-Grounded Structured Reasoning for Gene…

200 篇论文

Vision-language models (VLMs) are widely assumed to exhibit in-context learning (ICL), a property similar to that of their language-only counterparts. While recent work suggests VLMs can perform multimodal ICL (MM-ICL), studies show they…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Chengyue Huang , Yuchen Zhu , Sichen Zhu , Jingyun Xiao , Moises Andrade , Shivang Chopra , Zsolt Kira

The growing sophistication of deepfakes presents substantial challenges to the integrity of media and the preservation of public trust. Concurrently, vision-language models (VLMs), large language models enhanced with visual reasoning…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Shahroz Tariq , David Nguyen , M. A. P. Chamikara , Tingmin Wu , Alsharif Abuadbba , Kristen Moore

Current Vision-Language Models (VLMs) for deepfake detection excel at identifying spatial artifacts but overlook a critical dimension: temporal inconsistencies in video forgeries. Adapting VLMs to reason about these dynamic cues remains a…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Zheyuan Gu , Qingsong Zhao , Yusong Wang , Zhaohong Huang , Xinqi Li , Cheng Yuan , Jiaowei Shao , Chi Zhang , Xuelong Li

Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Zhiyuan Yan , Peng Sun , Yubo Lang , Shuo Du , Shanzhuo Zhang , Wei Wang , Lei Liu

We introduce a general-purpose conditioning method for neural networks called FiLM: Feature-wise Linear Modulation. FiLM layers influence neural network computation via a simple, feature-wise affine transformation based on conditioning…

计算机视觉与模式识别 · 计算机科学 2017-12-20 Ethan Perez , Florian Strub , Harm de Vries , Vincent Dumoulin , Aaron Courville

The rapid advancement of generative models has intensified the challenge of detecting and interpreting visual forgeries, necessitating robust frameworks for image forgery detection while providing reasoning as well as localization. While…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Ipsita Praharaj , Yukta Butala , Badrikanath Praharaj , Yash Butala

Deepfake detection models often generate natural-language explanations, yet their reasoning is frequently ungrounded in visual evidence, limiting reliability. Existing evaluations measure classification accuracy but overlook reasoning…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Kartik Kuckreja , Parul Gupta , Muhammad Haris Khan , Abhinav Dhall

We investigated visual reasoning limitations of both multimodal large language models (MLLMs) and image generation models (IGMs) by creating a novel benchmark to systematically compare failure modes across image-to-text and text-to-image…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Aahana Basappa , Pranay Goel , Anusri Karra , Anish Karra , Asa Gilmore , Kevin Zhu

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

计算与语言 · 计算机科学 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

Automatic detection of multimodal misinformation has gained a widespread attention recently. However, the potential of powerful Large Language Models (LLMs) for multimodal misinformation detection remains underexplored. Besides, how to…

计算与语言 · 计算机科学 2024-04-09 Longzheng Wang , Xiaohan Xu , Lei Zhang , Jiarui Lu , Yongxiu Xu , Hongbo Xu , Minghao Tang , Chuang Zhang

Multimodal Large Language Models (MLLMs) have become a powerful tool for integrating visual and textual information. Despite their exceptional performance on visual understanding benchmarks, measuring their ability to reason abstractly…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Nilay Yilmaz , Maitreya Patel , Yiran Lawrence Luo , Tejas Gokhale , Chitta Baral , Suren Jayasuriya , Yezhou Yang

Deepfake detection remains a critical challenge in the era of advanced generative models, particularly as synthetic media becomes more sophisticated. In this study, we explore the potential of state of the art multi-modal (reasoning) large…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Simiao Ren , Yao Yao , Kidus Zewde , Zisheng Liang , Tsang , Ng , Ning-Yau Cheng , Xiaoou Zhan , Qinzhe Liu , Yifei Chen , Hengwei Xu

Multimodal large language models have unlocked new possibilities for various multimodal tasks. However, their potential in image manipulation detection remains unexplored. When directly applied to the IMD task, M-LLMs often produce…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Zhihao Sun , Haoran Jiang , Haoran Chen , Yixin Cao , Xipeng Qiu , Zuxuan Wu , Yu-Gang Jiang

Progress in image generation raises significant public security concerns. We argue that fake image detection should not operate as a "black box". Instead, an ideal approach must ensure both strong generalization and transparency. Recent…

计算机视觉与模式识别 · 计算机科学 2025-11-10 Yikun Ji , Yan Hong , Jiahui Zhan , Haoxing Chen , jun lan , Huijia Zhu , Weiqiang Wang , Liqing Zhang , Jianfu Zhang

Multimodal fake news detection is crucial for mitigating adversarial misinformation. Existing methods, relying on static fusion or LLMs, face computational redundancy and hallucination risks due to weak visual foundations. To address this,…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Weilin Zhou , Zonghao Ying , Chunlei Meng , Jiahui Liu , Hengyang Zhou , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang

Large Vision Language Models (LVLMs) have achieved remarkable progress, yet they often suffer from language bias, producing answers without relying on visual evidence. While prior work attempts to mitigate this issue through decoding…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Seulbi Lee , Sangheum Hwang

The rapid development of deepfake video technology has not only facilitated artistic creation but also made it easier to spread misinformation. Traditional deepfake video detection (DVD) methods face issues such as a lack of transparency in…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Haoran Sun , Chen Cai , Huiping Zhuang , Kong Aik Lee , Lap-Pui Chau , Yi Wang

With the rapid advancement of AIGC technology, developing identification methods to address the security challenges posed by deepfakes has become urgent. Face forgery identification techniques can be categorized into two types: traditional…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Binjia Zhou , Dawei Luo , Shuai Chen , Feng Xu , Seow , Haoyuan Li , Jiachi Wang , Jiawen Wang , Zunlei Feng , Yijun Bei

Recent efforts in video reasoning segmentation (VRS) integrate large language models (LLMs) with perception models to localize and track objects via textual instructions, achieving barely satisfactory results in simple scenarios. However,…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Rongkun Zheng , Lu Qi , Xi Chen , Yi Wang , Kun Wang , Yu Qiao , Hengshuang Zhao

Multimodal large language models (MLLMs) have demonstrated strong capabilities in vision-related tasks, capitalizing on their visual semantic comprehension and reasoning capabilities. However, their ability to detect subtle visual spoofing…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Yichen Shi , Yuhao Gao , Yingxin Lai , Hongyang Wang , Jun Feng , Lei He , Jun Wan , Changsheng Chen , Zitong Yu , Xiaochun Cao