English
Related papers

Related papers: Visual Agentic Reinforcement Fine-Tuning

200 papers

Visual reasoning models (VRMs) have recently shown strong cross-modal reasoning capabilities by integrating visual perception with language reasoning. However, they often suffer from overthinking, producing unnecessarily long reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yixu Huang , Tinghui Zhu , Muhao Chen

Despite their popularity and success, Multimodal Large Language Models (MLLMs) often struggle to interpret images accurately, which limits their reasoning capability in complex scenarios (e.g., high object density and complex background…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xuanzhao Dong , Wenhui Zhu , Peijie Qiu , Xiwen Chen , Xiaobing Yu , Xin Li , Zhipeng Wang , Shao Tang , Gen Li , Yujian Xiong , Hao Wang , Yanxi Chen , Prayag Tiwari , Yalin Wang

The image geolocalization task aims to predict the location where an image was taken anywhere on Earth using visual clues. Existing large vision-language model (LVLM) approaches leverage world knowledge, chain-of-thought reasoning, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yuxiang Ji , Yong Wang , Ziyu Ma , Yiming Hu , Hailang Huang , Xuecai Hu , Guanhua Chen , Liaoni Wu , Xiangxiang Chu

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

While large language models (LLMs) are still being adopted to new domains and utilized in novel applications, we are experiencing an influx of the new generation of foundation models, namely multi-modal large language models (MLLMs). These…

Computation and Language · Computer Science 2024-08-23 Kian Ahrabian , Zhivar Sourati , Kexuan Sun , Jiarui Zhang , Yifan Jiang , Fred Morstatter , Jay Pujara

Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated success in enhancing LLM reasoning capabilities, but remains limited to single-turn interactions without tool integration. While recent Agentic Reinforcement Learning…

Artificial Intelligence · Computer Science 2025-10-20 Dongfu Jiang , Yi Lu , Zhuofeng Li , Zhiheng Lyu , Ping Nie , Haozhe Wang , Alex Su , Hui Chen , Kai Zou , Chao Du , Tianyu Pang , Wenhu Chen

Agentic Artificial Intelligence (AI) systems leveraging Large Language Models (LLMs) exhibit significant potential for complex reasoning, planning, and tool utilization. We demonstrate that a specialized computer vision system can be built…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Jin Kim , Muhammad Wahi-Anwa , Sangyun Park , Shawn Shin , John M. Hoffman , Matthew S. Brown

With the emergence of large language models (LLMs) and vision foundation models, how to combine the intelligence and capacity of these open-sourced or API-available models to achieve open-world visual perception remains an open question. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chris Kelly , Luhui Hu , Bang Yang , Yu Tian , Deshun Yang , Cindy Yang , Zaoshan Huang , Zihao Li , Jiayin Hu , Yuexian Zou

The web is littered with images, once created for human consumption and now increasingly interpreted by agents using vision-language models (VLMs). These agents make visual decisions at scale, deciding what to click, recommend, or buy. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Manuel Cherep , Pranav M R , Pattie Maes , Nikhil Singh

The evolution of text to visual components facilitates people's daily lives, such as generating image, videos from text and identifying the desired elements within the images. Computer vision models involving the multimodal abilities in the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Chris Kelly , Luhui Hu , Jiayin Hu , Yu Tian , Deshun Yang , Bang Yang , Cindy Yang , Zihao Li , Zaoshan Huang , Yuexian Zou

Web agents such as Deep Research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains primarily text-centric, overlooking visual information in…

Information Retrieval · Computer Science 2025-09-03 Xinyu Geng , Peng Xia , Zhen Zhang , Xinyu Wang , Qiuchen Wang , Ruixue Ding , Chenxi Wang , Jialong Wu , Yida Zhao , Kuan Li , Yong Jiang , Pengjun Xie , Fei Huang , Jingren Zhou

Contemporary large language model (LLM)-based multi-agent systems exhibit systematic advantages in deep research tasks, which emphasize iterative, vertically structured information seeking. However, when confronted with wide search tasks…

Multiagent Systems · Computer Science 2026-02-03 Mingju Chen , Guibin Zhang , Heng Chang , Yuchen Guo , Shiji Zhou

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

Reinforcement learning (RL) with rule-based reward functions has recently shown great promise in enhancing the reasoning depth and generalization ability of vision-language models (VLMs), while maintaining computational efficiency. In spite…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yizhou Liu , Dingkang Yang , Zizhi Chen , Minghao Han , Xukun Zhang , Keliang Liu , Jingwei Wei , Lihua Zhang

Recent advances in multimodal large language models (MLLMs) have shown great potential for extending vision-language reasoning to professional tool-based image editing, enabling intuitive and creative editing. A promising direction is to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Qiucheng Wu , Jing Shi , Simon Jenni , Kushal Kafle , Tianyu Wang , Shiyu Chang , Handong Zhao

Large Vision-Language Models (LVLMs) have advanced rapidly by aligning visual patches with the text embedding space, but a fixed visual-token budget forces images to be resized to a uniform pretraining resolution, often erasing fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Zipeng Zhu , Zhanghao Hu , Qinglin Zhu , Yuxi Hong , Yijun Liu , Jingyong Su , Yulan He , Lin Gui

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in vision-language tasks yet remain limited in long video understanding due to the limited context window. Consequently, prevailing approaches tend to rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Yang Ding , Yizhen Zhang , Xin Lai , Ruihang Chu , Yujiu Yang

Artificial Intelligence is moving from models that only generate text to Agentic AI, where systems behave as autonomous entities that can perceive, reason, plan, and act. Large Language Models (LLMs) are no longer used only as passive…

Artificial Intelligence · Computer Science 2026-01-21 Arunkumar V , Gangadharan G. R. , Rajkumar Buyya

Vision-Language Models (VLMs) excel at many multimodal tasks, yet they frequently struggle with tasks requiring precise understanding and handling of fine-grained visual elements. This is mainly due to information loss during image encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Xuchen Li , Xuzhao Li , Jiahui Gao , Renjie Pi , Shiyu Hu , Wentao Zhang

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

Computation and Language · Computer Science 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang