中文
相关论文

相关论文: FRISM: Fine-Grained Reasoning Injection via Subspa…

200 篇论文

Vision-Language Models (VLMs) have recently shown promising advancements in sequential decision-making tasks through task-specific fine-tuning. However, common fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement…

计算与语言 · 计算机科学 2025-03-26 Haoqiang Kang , Enna Sachdeva , Piyush Gupta , Sangjae Bae , Kwonjoon Lee

Vision-language models (VLM) excel at general understanding yet remain weak at dynamic spatial reasoning (DSR), i.e., reasoning about the evolvement of object geometry and relationship in 3D space over time, largely due to the scarcity of…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Shengchao Zhou , Yuxin Chen , Yuying Ge , Wei Huang , Jiehong Lin , Ying Shan , Xiaojuan Qi

Logical reasoning is a core capability for large language models (LLMs), yet existing benchmarks that rely solely on final-answer accuracy fail to capture the quality of the reasoning process. To address this, we introduce FineLogic, a…

Large Language Models (LLMs) still struggle with multi-step logical reasoning. Existing approaches either purely refine the reasoning chain in natural language form or attach a symbolic solver as an external module. In this work, we instead…

计算与语言 · 计算机科学 2026-04-22 Feihao Fang , My T. Thai , Yuanyuan Lei

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Fine-grained ship classification in remote sensing (RS-FGSC) poses a significant challenge due to the high similarity between classes and the limited availability of labeled data, limiting the effectiveness of traditional supervised…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Long Lan , Fengxiang Wang , Xiangtao Zheng , Zengmao Wang , Xinwang Liu

Large Vision-Language Models (LVLMs) have shown exceptional performance in multimodal tasks, but their effectiveness in complex visual reasoning is still constrained, especially when employing Chain-of-Thought prompting techniques. In this…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Congzhi Zhang , Jiawei Peng , Zhenglin Wang , Yilong Lai , Haowen Sun , Heng Chang , Fei Ma , Weijiang Yu

Vision-Language Models (VLMs) have recently emerged as powerful tools, excelling in tasks that integrate visual and textual comprehension, such as image captioning, visual question answering, and image-text retrieval. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Ilias Stogiannidis , Steven McDonagh , Sotirios A. Tsaftaris

Visual Spatial Reasoning (VSR) is a core human cognitive ability and a critical requirement for advancing embodied intelligence and autonomous systems. Despite recent progress in Vision-Language Models (VLMs), achieving human-level VSR…

Recent advances in large Vision-Language Models (VLMs) have exhibited strong reasoning capabilities on complex visual tasks by thinking with images in their Chain-of-Thought (CoT), which is achieved by actively invoking tools to analyze…

计算机视觉与模式识别 · 计算机科学 2026-01-08 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuanyu Wan , Lijun Zhang

Evaluating vision-language models (VLMs) in scientific domains like mathematics and physics poses unique challenges that go far beyond predicting final answers. These domains demand conceptual understanding, symbolic reasoning, and…

人工智能 · 计算机科学 2025-12-08 Shima Imani , Seungwhan Moon , Adel Ahmadyan , Lu Zhang , Kirmani Ahmed , Babak Damavandi

Multimodal Large Language Models (MLLMs) excel at broad visual understanding but still struggle with fine-grained perception, where decisive evidence is small and easily overwhelmed by global context. Recent "Thinking-with-Images" methods…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Lai Wei , Liangbo He , Jun Lan , Lingzhong Dong , Yutong Cai , Siyuan Li , Huijia Zhu , Weiqiang Wang , Linghe Kong , Yue Wang , Zhuosheng Zhang , Weiran Huang

Recent advancements in multimodal reward models (RMs) have substantially improved post-training for visual generative models. However, current RMs face inherent limitations: (1) visual inputs consume large context budgets, forcing fewer…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Qunzhong Wang , Jie Liu , Jiajun Liang , Yilei Jiang , Yuanxing Zhang , Yaozhi Zheng , Xintao Wang , Pengfei Wan , Xiangyu Yue , Jiaheng Liu

Hallucinations in large language models (LLMs) pose significant challenges in tasks requiring complex multi-step reasoning, such as mathematical problem-solving. Existing approaches primarily detect the presence of hallucinations but lack a…

计算与语言 · 计算机科学 2025-09-19 Ruosen Li , Ziming Luo , Xinya Du

Mainstream Multimodal Large Language Models (MLLMs) achieve visual understanding by using a vision projector to bridge well-pretrained vision encoders and large language models (LLMs). The inherent gap between visual and textual modalities…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Jianting Tang , Yubo Wang , Haoyu Cao , Linli Xu

Large vision-language models (VLMs) still struggle with reliable 3D spatial reasoning, a core capability for embodied and physical AI systems. This limitation arises from their inability to capture fine-grained 3D geometry and spatial…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Jian Zhang , Shijie Zhou , Bangya Liu , Achuta Kadambi , Zhiwen Fan

We propose PRISM, a novel framework designed to overcome the limitations of 2D-based Preference-Based Reinforcement Learning (PBRL) by unifying 3D point cloud modeling and future-aware preference refinement. At its core, PRISM adopts a 3D…

计算与语言 · 计算机科学 2025-03-20 Yirong Sun , Yanjun Chen

Long-context question-answering (LCQA) systems have greatly benefited from the powerful reasoning capabilities of large language models (LLMs), which can be categorized into slow and quick reasoning modes. However, both modes have their…

计算与语言 · 计算机科学 2025-04-01 Zhengyi Zhao , Shubo Zhang , Zezhong Wang , Bin Liang , Binyang Li , Kam-Fai Wong

Dynamic spatial reasoning from monocular video is essential for bridging visual intelligence and the physical world, yet remains challenging for vision-language models (VLMs). Prior approaches either verbalize spatial-temporal reasoning…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Zhangquan Chen , Manyuan Zhang , Xinlei Yu , Xiang An , Bo Li , Xin Xie , ZiDong Wang , Mingze Sun , Shuang Chen , Hongyu Li , Xiaobin Hu , Ruqi Huang

In recent times, the standard practice for developing MLLMs is to feed features from vision encoder(s) into the LLM and train with natural language supervision. This approach often causes models to lean towards language comprehension and…

计算机视觉与模式识别 · 计算机科学 2025-10-20 Jitesh Jain , Zhengyuan Yang , Humphrey Shi , Jianfeng Gao , Jianwei Yang