中文
相关论文

相关论文: ViFP: A Framework for Visual False Positive Detect…

200 篇论文

Despite significant advancements in the general capability of large language models (LLMs), they continue to struggle with consistent and accurate reasoning, especially in complex tasks such as mathematical and code reasoning. One key…

机器学习 · 计算机科学 2024-10-10 Zhenwen Liang , Ye Liu , Tong Niu , Xiangliang Zhang , Yingbo Zhou , Semih Yavuz

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

密码学与安全 · 计算机科学 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Despite the remarkable progress of Vision-Language Models (VLMs) in adopting "Thinking-with-Images" capabilities, accurately evaluating the authenticity of their reasoning process remains a critical challenge. Existing benchmarks mainly…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Xuchen Li , Xuzhao Li , Renjie Pi , Shiyu Hu , Jian Zhao , Jiahui Gao

To enhance the reasoning capabilities of Large Language Models (LLMs) without high costs of training, nor extensive test-time sampling, we introduce Verification-First (VF), a strategy that prompts models to verify a provided candidate…

计算与语言 · 计算机科学 2026-05-26 Shiguang Wu , Quanming Yao

Multimodal Large Language Models (MLLMs) frequently suffer from unfaithfulness, generating reasoning chains that drift from visual evidence or contradict final predictions. We propose Faithful-First Reasoning, Planning, and Acting (RPA)…

人工智能 · 计算机科学 2026-04-09 Junxian Li , Xinyue Xu , Sai Ma , Di Zhang , Sichao Li

Large Vision-Language Models (LVLMs) achieve strong performance on visual question answering benchmarks, yet often rely on spurious correlations rather than genuine causal reasoning. Existing evaluations primarily assess the correctness of…

人工智能 · 计算机科学 2026-02-25 Dhita Putri Pratama , Soyeon Caren Han , Yihao Ding

Despite significant progress, Vision-Language Models (VLMs) still struggle with complex visual reasoning, where multi-step dependencies cause early errors to cascade through the reasoning chain. Existing post-training paradigms are limited:…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Yanbei Jiang , Chao Lei , Yihao Ding , Krista Ehinger , Jey Han Lau

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Detecting AI-generated images with multimodal large language models (MLLMs) has gained increasing attention, due to their rich world knowledge, common-sense reasoning, and potential for explainability. However, naively applying those MLLMs…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Kaiqing Lin , Zhiyuan Yan , Ruoxin Chen , Junyan Ye , Ke-Yue Zhang , Yue Zhou , Peng Jin , Bin Li , Taiping Yao , Shouhong Ding

Explainability in artificial intelligence is crucial for restoring trust, particularly in areas like face forgery detection, where viewers often struggle to distinguish between real and fabricated content. Vision and Large Language Models…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Niki Maria Foteinopoulou , Enjie Ghorbel , Djamila Aouada

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

The increasing demand for intelligent systems capable of interpreting and reasoning about visual content requires the development of large Vision-and-Language Models (VLMs) that are not only accurate but also have explicit reasoning…

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

计算与语言 · 计算机科学 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal benchmarks and two…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Yizhuo Ding , Mingkang Chen , Zhibang Feng , Tong Xiao , Wanying Qu , Wenqi Shao , Yanwei Fu

In medical visual question answering (Med-VQA), achieving accurate responses relies on three critical steps: precise perception of medical imaging data, logical reasoning grounded in visual input and textual questions, and coherent answer…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Songtao Jiang , Yuan Wang , Ruizhe Chen , Yan Zhang , Ruilin Luo , Bohan Lei , Sibo Song , Yang Feng , Jimeng Sun , Jian Wu , Zuozhu Liu

Reinforcement learning (RL) has proven highly effective in eliciting the reasoning capabilities of large language models (LLMs). Inspired by this success, recent studies have explored applying similar techniques to vision-language models…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Yan Chen , Long Li , Teng Xi , Long Zeng , Jingdong Wang

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

While Vision-Language Models (VLMs) have shown remarkable abilities in visual and language reasoning tasks, they invariably generate flawed responses. Self-correction that instructs models to refine their outputs presents a promising…

计算与语言 · 计算机科学 2025-06-06 Jiayi He , Hehai Lin , Qingyun Wang , Yi Fung , Heng Ji

Large vision-language models (LVLMs) have witnessed significant progress on visual understanding tasks. However, they often prioritize language knowledge over image information on visual reasoning tasks, incurring performance degradation.…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Jingqi Zhou , Sheng Wang , Jingwei Dong , Kai Liu , Lei Li , Jiahui Gao , Jiyue Jiang , Lingpeng Kong , Chuan Wu

Evaluating whether Multimodal Large Language Models (MLLMs) genuinely reason about physical dynamics remains challenging. Most existing benchmarks rely on recognition-style protocols such as Visual Question Answering (VQA) and Violation of…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Jiarong Liang , Max Ku , Ka-Hei Hui , Ping Nie , Wenhu Chen