中文
相关论文

相关论文: ChainV: Atomic Visual Hints Make Multimodal Reason…

200 篇论文

DeepSeek-R1-Zero has successfully demonstrated the emergence of reasoning capabilities in LLMs purely through Reinforcement Learning (RL). Inspired by this breakthrough, we explore how RL can be utilized to enhance the reasoning capability…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Wenxuan Huang , Bohan Jia , Zijie Zhai , Shaosheng Cao , Zheyu Ye , Fei Zhao , Zhe Xu , Xu Tang , Yao Hu , Shaohui Lin

Although reinforcement learning (RL) has significantly advanced reasoning capabilities in large multimodal language models (MLLMs), its efficacy remains limited for lightweight models essential for edge deployments. To address this issue,…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Jingze Wu , Quan Zhang , Hongfei Suo , Zeqiang Cai , Hongbo Chen

Multimodal large language models (MLLMs) have advanced perception across text, vision, and audio, yet they often struggle with structured cross-modal reasoning, particularly when integrating audio and visual signals. We introduce…

计算机视觉与模式识别 · 计算机科学 2025-06-20 Zhenghao Xing , Xiaowei Hu , Chi-Wing Fu , Wenhai Wang , Jifeng Dai , Pheng-Ann Heng

The exponential growth of Large Multimodal Models (LMMs) has driven advancements in cross-modal reasoning but at significant computational costs. In this work, we focus on visual language models. We highlight the redundancy and inefficiency…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Yasmine Omri , Parth Shroff , Thierry Tambe

Chain of Thought (CoT) of multi-step benefits from the logical structure of the reasoning steps and task-specific actions, significantly enhancing the mathematical reasoning capabilities of large language models. As the prevalence of long…

人工智能 · 计算机科学 2025-03-07 Wen Yang , Minpeng Liao , Kai Fan

Visual reasoning, the capability to interpret visual input in response to implicit text query through multi-step reasoning, remains a challenge for deep learning models due to the lack of relevant benchmarks. Previous work in visual…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Yiqing Shen , Chenjia Li , Chenxiao Fan , Mathias Unberath

Vision-Language Models (VLMs) have made significant strides in static image understanding but continue to face critical hurdles in spatiotemporal reasoning. A major bottleneck is "multi-image reasoning hallucination", where a massive…

Chain-of-thought (CoT) reasoning and its variants have substantially improved the performance of language models on complex reasoning tasks, yet the precise mechanisms by which different strategies facilitate generalization remain poorly…

计算与语言 · 计算机科学 2026-02-11 Archiki Prasad , Mandar Joshi , Kenton Lee , Mohit Bansal , Peter Shaw

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

Vision-Language Models (VLMs) have demonstrated strong performance on multimodal reasoning tasks, but their deployment remains challenging due to high inference latency and computational cost, particularly when processing high-resolution…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Putu Indah Githa Cahyani , Komang David Dananjaya Suartana , Novanto Yudistira

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

Achieving artificial visual reasoning - the ability to answer image-related questions which require a multi-step, high-level process - is an important step towards artificial general intelligence. This multi-modal task requires learning a…

计算机视觉与模式识别 · 计算机科学 2017-12-20 Ethan Perez , Harm de Vries , Florian Strub , Vincent Dumoulin , Aaron Courville

Reasoning-centric video object segmentation is an inherently complex task: the query often refers to dynamics, causality, and temporal interactions, rather than static appearances. Yet existing solutions generally collapse these factors…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Yifan Li , Yingda Yin , Lingting Zhu , Weikai Chen , Shengju Qian , Xin Wang , Yanwei Fu

Multimodal LLMs (MLLMs) with a great ability of text and image understanding have received great attention. To achieve better reasoning with MLLMs, Chain-of-Thought (CoT) reasoning has been widely explored, which further promotes MLLMs'…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Zefeng Wang , Zhen Han , Shuo Chen , Fan Xue , Zifeng Ding , Xun Xiao , Volker Tresp , Philip Torr , Jindong Gu

Recently, improving the reasoning ability of large multimodal models (LMMs) through reinforcement learning has made great progress. However, most existing works are based on highly reasoning-intensive datasets such as mathematics and code,…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Xingjian Zhang , Siwei Wen , Wenjun Wu , Lei Huang

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Chain-of-Thought (CoT) reasoning has become a powerful driver of trajectory prediction in VLA-based autonomous driving, yet its autoregressive nature imposes a latency cost that is prohibitive for real-time deployment. Latent CoT methods…

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

计算与语言 · 计算机科学 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Existing large language models (LLMs) face challenges of following complex instructions, especially when multiple constraints are present and organized in paralleling, chaining, and branching structures. One intuitive solution, namely…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Yulei Qin , Gang Li , Zongyi Li , Zihan Xu , Yuchen Shi , Zhekai Lin , Xiao Cui , Ke Li , Xing Sun

Video understanding is fundamental to tasks such as action recognition, video reasoning, and robotic control. Early video understanding methods based on large vision-language models (LVLMs) typically adopt a single-pass reasoning paradigm…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Yiyang Zhou , Yangfan He , Yaofeng Su , Siwei Han , Joel Jang , Gedas Bertasius , Mohit Bansal , Huaxiu Yao