English
Related papers

Related papers: Towards Omnidirectional Reasoning with 360-R1: A D…

200 papers

The emergence of Vision-Language Models (VLMs) has introduced new paradigms for global image geo-localization through retrieval-augmented generation (RAG) and reasoning-driven inference. However, RAG methods are constrained by retrieval…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bo Yu , Fengze Yang , Yiming Liu , Chao Wang , Xuewen Luo , Taozhe Li , Ruimin Ke , Xiaofan Zhou , Chenxi Liu

Reinforcement learning with verifiable rewards (RLVR) has substantially enhanced the reasoning capabilities of multimodal large language models (MLLMs). However, existing RLVR approaches typically rely on outcome-driven optimization that…

Artificial Intelligence · Computer Science 2026-04-10 Ziqi Miao , Haonan Jia , Lijun Li , Chen Qian , Yuan Xiong , Wenting Yan , Jing Shao

While Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Vision-Language Models (LVLMs), most existing methods in multimodal reasoning neglect the critical role of visual perception within…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Siyuan Huang , Xiaoye Qu , Yafu Li , Yun Luo , Zefeng He , Daizong Liu , Yu Cheng

Existing vision-language models (VLMs) are tailored for pinhole imagery, stitching multiple narrow field-of-view inputs to piece together a complete omni-scene understanding. Yet, such multi-view perception overlooks the holistic spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Weijia Fan , Ruiping Liu , Jiale Wei , Yufan Chen , Junwei Zheng , Zichao Zeng , Jiaming Zhang , Qiufu Li , Linlin Shen , Rainer Stiefelhagen

Group Relative Policy Optimization (GRPO), which is widely adopted by R1-like reasoning models, has advanced mathematical reasoning. Nevertheless, GRPO faces challenges in reward sparsity, verbosity, and inadequate focus on problem…

Computation and Language · Computer Science 2025-09-23 Jixiao Zhang , Chunsheng Zuo

Inspired by the remarkable reasoning capabilities of Deepseek-R1 in complex textual tasks, many works attempt to incentivize similar capabilities in Multimodal Large Language Models (MLLMs) by directly applying reinforcement learning (RL).…

Machine Learning · Computer Science 2026-01-29 Shuang Chen , Yue Guo , Zhaochen Su , Yafu Li , Yulun Wu , Jiacheng Chen , Jiayu Chen , Weijie Wang , Xiaoye Qu , Yu Cheng

Recent advances in Omni models have enabled unified multimodal perception and generation. However, most existing systems still exhibit rigid reasoning behaviors, either overthinking simple problems or failing to reason when necessary. To…

Artificial Intelligence · Computer Science 2025-12-05 Dongchao Yang , Songxiang Liu , Disong Wang , Yuanyuan Wang , Guanglu Wan , Helen Meng

Physical reasoning over visual inputs demands tight integration of visual perception, domain knowledge, and multi-step symbolic inference. Yet even state-of-the-art Vision Language Models (VLMs) fall far short of human performance on…

Artificial Intelligence · Computer Science 2026-04-16 Derek Lilienthal , Manisha Mukherjee , Sameera Horawalavithana

The ability for AI agents to "think with images" requires a sophisticated blend of reasoning and perception. However, current open multimodal agents still largely fall short on the reasoning aspect crucial for real-world tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Kaican Li , Lewei Yao , Jiannan Wu , Tiezheng Yu , Jierun Chen , Haoli Bai , Lu Hou , Lanqing Hong , Wei Zhang , Nevin L. Zhang

DeepSeek R1 has significantly advanced complex reasoning for large language models (LLMs). While recent methods have attempted to replicate R1's reasoning capabilities in multimodal settings, they face limitations, including inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Zhehan Kan , Yanlin Liu , Kun Yin , Xinghua Jiang , Xin Li , Haoyu Cao , Yinsong Liu , Deqiang Jiang , Xing Sun , Qingmin Liao , Wenming Yang

Visual reasoning, the capability to interpret visual input in response to implicit text query through multi-step reasoning, remains a challenge for deep learning models due to the lack of relevant benchmarks. Previous work in visual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yiqing Shen , Chenjia Li , Chenxiao Fan , Mathias Unberath

Complex Visual Question Answering (Complex VQA) tasks, which demand sophisticated multi-modal reasoning and external knowledge integration, present significant challenges for existing large vision-language models (LVLMs) often limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jingwei Peng , Jiehao Chen , Mateo Alejandro Rojas , Meilin Zhang

Understanding perspective is fundamental to human visual perception, yet the extent to which multimodal large language models (MLLMs) internalize perspective geometry remains unclear. We introduce MMPerspective, the first benchmark…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yolo Y. Tang , Pinxin Liu , Zhangyun Tan , Mingqian Feng , Rui Mao , Chao Huang , Jing Bi , Yunzhong Xiao , Susan Liang , Hang Hua , Ali Vosoughi , Luchuan Song , Zeliang Zhang , Chenliang Xu

Multimodal large language models (MLLMs) deployed on devices must adapt to continuously changing visual scenarios such as variations in background and perspective, to effectively perform complex visual tasks. To investigate catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kai Jiang , Siqi Huang , Xiangyu Chen , Jiawei Shao , Hongyuan Zhang , Ping Luo , Xuelong Li

Recent advances in reasoning-induced image quality assessment (IQA) have demonstrated the power of reinforcement learning to rank (RL2R) for training vision-language models (VLMs) to assess perceptual quality. However, existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiangyong Chen , Xiaochuan Lin , Haoran Liu , Xuan Li , Yichen Su , Xiangwei Guo

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for endowing Large Language Models (LLMs) with robust multi-step reasoning abilities. However, its design and optimizations remain tailored…

Computation and Language · Computer Science 2026-04-15 Zhenhailong Wang , Xuehang Guo , Sofia Stoica , Haiyang Xu , Hongru Wang , Hyeonjeong Ha , Xiusi Chen , Yangyi Chen , Ming Yan , Fei Huang , Heng Ji

The rapid proliferation of AI-generated video necessitates robust detection tools that offer both high accuracy and human-interpretable explanations. While existing MLLM-based detectors rely on supervised fine-tuning (SFT) or direct…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Kyoungjun Park , Yifan Yang , Juheon Yi , Shicheng Zheng , Yifei Shen , Dongqi Han , Caihua Shan , Muhammad Muaz , Lili Qiu

Current roadside perception systems mainly focus on instance-level perception, which fall short in enabling interaction via natural language and reasoning about traffic behaviors in context. To bridge this gap, we introduce RoadSceneVQA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Runwei Guan , Rongsheng Hu , Shangshu Chen , Ningyuan Xiao , Xue Xia , Jiayang Liu , Beibei Chen , Ziren Tang , Ningwei Ouyang , Shaofeng Liang , Yuxuan Fan , Wanjie Sun , Yutao Yue

We introduce MediX-R1, an open-ended Reinforcement Learning (RL) framework for medical multimodal large language models (MLLMs) that enables clinically grounded, free-form answers beyond multiple-choice formats. MediX-R1 fine-tunes a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Sahal Shaji Mullappilly , Mohammed Irfan Kurpath , Omair Mohamed , Mohamed Zidan , Fahad Khan , Salman Khan , Rao Anwer , Hisham Cholakkal

Video quality assessment (VQA) aims to objectively quantify perceptual quality degradation in alignment with human visual perception. Despite recent advances, existing VQA models still suffer from two critical limitations: \textit{poor…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Linhan Cao , Wei Sun , Weixia Zhang , Xiangyang Zhu , Jun Jia , Kaiwei Zhang , Dandan Zhu , Guangtao Zhai , Xiongkuo Min