English
Related papers

Related papers: Scaling Agentic Reinforcement Learning for Tool-In…

200 papers

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…

Recent advances in Multi-modal Large Language Models (MLLMs) target 3D spatial intelligence, yet the progress has been largely driven by post-training on curated benchmarks, leaving the inference-time approach relatively underexplored. In…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tingshu Mou , Jiabo He , Renying Wang , Ce Liu , Hao Yang , Tiehua Zhang , Jingjing Chen , Xingjun Ma

While significant research has focused on developing embodied reasoning capabilities using Vision-Language Models (VLMs) or integrating advanced VLMs into Vision-Language-Action (VLA) models for end-to-end robot control, few studies…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Ganlin Yang , Tianyi Zhang , Haoran Hao , Weiyun Wang , Yibin Liu , Dehui Wang , Guanzhou Chen , Zijian Cai , Junting Chen , Weijie Su , Wengang Zhou , Yu Qiao , Jifeng Dai , Jiangmiao Pang , Gen Luo , Wenhai Wang , Yao Mu , Zhi Hou

Vision-Language Models (VLMs) have recently demonstrated incredible strides on diverse vision language tasks. We dig into vision-based deductive reasoning, a more sophisticated but less explored realm, and find previously unexposed…

Artificial Intelligence · Computer Science 2024-10-02 Yizhe Zhang , He Bai , Ruixiang Zhang , Jiatao Gu , Shuangfei Zhai , Josh Susskind , Navdeep Jaitly

Recent advances in text-only large language models (LLMs), such as DeepSeek-R1, demonstrate remarkable reasoning ability. However, these models remain fragile or entirely incapable when extended to multi-modal tasks. Existing approaches…

Multiagent Systems · Computer Science 2025-10-30 Weijia Zhang , Zijia Liu , Haoru Li , Haoqi Chen , Jiaxuan You

Vision-Language Models (VLMs) have recently gained attention due to their competitive performance on multiple downstream tasks, achieved by following user-input instructions. However, VLMs still exhibit several limitations in visual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Simone Alghisi , Gabriel Roccabruna , Massimo Rizzoli , Seyed Mahed Mousavi , Giuseppe Riccardi

Large Vision-Language Models (LVLMs) have become powerful general-purpose assistants, yet their predictions often lack reliability and interpretability due to insufficient grounding in visual evidence. The emerging thinking-with-images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Meng Cao , Haoze Zhao , Can Zhang , Xiaojun Chang , Ian Reid , Xiaodan Liang

Recently, improving the reasoning ability of large multimodal models (LMMs) through reinforcement learning has made great progress. However, most existing works are based on highly reasoning-intensive datasets such as mathematics and code,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Xingjian Zhang , Siwei Wen , Wenjun Wu , Lei Huang

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models in an end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Chi-Pin Huang , Yueh-Hua Wu , Min-Hung Chen , Yu-Chiang Frank Wang , Fu-En Yang

Recent progress in Vision Language Models (VLMs) has raised the question of whether they can reliably perform nonverbal reasoning. To this end, we introduce VRIQ (Visual Reasoning IQ), a novel benchmark designed to assess and analyze the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Tina Khezresmaeilzadeh , Jike Zhong , Konstantinos Psounis

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin

Generating accurate and consistent visual aids is a critical challenge in mathematics education, where visual representations like geometric shapes and functions play a pivotal role in enhancing student comprehension. This paper introduces…

Computation and Language · Computer Science 2024-11-11 Jeongwoo Lee , Kwangsuk Park , Jihyeon Park

In this article, we investigate vision-language models (VLM) as reasoners. The ability to form abstractions underlies mathematical reasoning, problem-solving, and other Math AI tasks. Several formalisms have been given to these underlying…

Artificial Intelligence · Computer Science 2024-07-08 Denisa Roberts , Lucas Roberts

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

Visual reasoning requires multimodal perception and commonsense cognition of the world. Recently, multiple vision-language models (VLMs) have been proposed with excellent commonsense reasoning ability in various domains. However, how to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Liangyu Chen , Bo Li , Sheng Shen , Jingkang Yang , Chunyuan Li , Kurt Keutzer , Trevor Darrell , Ziwei Liu

Recent advancements in multimodal reward models (RMs) have substantially improved post-training for visual generative models. However, current RMs face inherent limitations: (1) visual inputs consume large context budgets, forcing fewer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Qunzhong Wang , Jie Liu , Jiajun Liang , Yilei Jiang , Yuanxing Zhang , Yaozhi Zheng , Xintao Wang , Pengfei Wan , Xiangyu Yue , Jiaheng Liu

A key trend in Large Reasoning Models (e.g., OpenAI's o3) is the native agentic ability to use external tools such as web browsers for searching and writing/executing code for image manipulation to think with images. In the open-source…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Ziyu Liu , Yuhang Zang , Yushan Zou , Zijian Liang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Integration of Large Language Models (LLMs) into visual domain tasks, resulting in visual-LLMs (V-LLMs), has enabled exceptional performance in vision-language tasks, particularly for visual question answering (VQA). However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Kanchana Ranasinghe , Satya Narayan Shukla , Omid Poursaeed , Michael S. Ryoo , Tsung-Yu Lin

Recent research has increasingly focused on the reasoning capabilities of Large Language Models (LLMs) in multi-turn interactions, as these scenarios more closely mirror real-world problem-solving. However, analyzing the intricate reasoning…

Computation and Language · Computer Science 2025-11-14 Yiran Zhang , Mingyang Lin , Mark Dras , Usman Naseem

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

‹ Prev 1 3 4 5 6 7 10 Next ›