English
Related papers

Related papers: MLLMRec-R1: Incentivizing Reasoning Capability in …

200 papers

Looped Language Models (LoopLMs) perform multi-step latent reasoning prior to token generation and outperform conventional LLMs on reasoning benchmarks at smaller parameter budgets. However, attempts to further improve LoopLM reasoning with…

Machine Learning · Computer Science 2026-05-29 Jonathan Williams , Esin Tureci

Long chain-of-thought (CoT) significantly enhances the reasoning capabilities of large language models (LLMs). However, extensive reasoning traces lead to inefficiencies and increased time-to-first-token (TTFT). We propose a training…

Computation and Language · Computer Science 2026-01-08 Roy Xie , David Qiu , Deepak Gopinath , Dong Lin , Yanchao Sun , Chong Wang , Saloni Potdar , Bhuwan Dhingra

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

Machine Learning · Computer Science 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Omnidirectional images (ODIs), with their 360{\deg} field of view, provide unparalleled spatial awareness for immersive applications like augmented reality and embodied AI. However, the capability of existing multi-modal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Xinshen Zhang , Zhen Ye , Xu Zheng

Despite significant progress, Vision-Language Models (VLMs) still struggle with complex visual reasoning, where multi-step dependencies cause early errors to cascade through the reasoning chain. Existing post-training paradigms are limited:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yanbei Jiang , Chao Lei , Yihao Ding , Krista Ehinger , Jey Han Lau

Large language models (LLMs), especially Explicit Long Chain-of-Thought (CoT) reasoning models like DeepSeek-R1 and QWQ, have demonstrated powerful reasoning capabilities, achieving impressive performance in commonsense reasoning and…

Computation and Language · Computer Science 2025-08-13 Jiatong Li , Weida Wang , Qinggang Zhang , Junxian Li , Di Zhang , Changmeng Zheng , Shufei Zhang , Xiaoyong Wei , Qing Li

We introduce MediX-R1, an open-ended Reinforcement Learning (RL) framework for medical multimodal large language models (MLLMs) that enables clinically grounded, free-form answers beyond multiple-choice formats. MediX-R1 fine-tunes a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Sahal Shaji Mullappilly , Mohammed Irfan Kurpath , Omair Mohamed , Mohamed Zidan , Fahad Khan , Salman Khan , Rao Anwer , Hisham Cholakkal

Large Language Models (LLMs) have demonstrated impressive capabilities in language processing, yet they often struggle with tasks requiring genuine visual spatial reasoning. In this paper, we introduce a novel two-stage training framework…

Computation and Language · Computer Science 2025-02-26 Alan Dao , Dinh Bach Vu

Multimodal Large Language Models (MLLMs) have achieved notable gains in various tasks by incorporating Chain-of-Thought (CoT) reasoning in language spaces. Recent work extends this direction by leveraging external tools for visual editing,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Bangzheng Li , Ximeng Sun , Jiang Liu , Ze Wang , Jialian Wu , Xiaodong Yu , Hao Chen , Emad Barsoum , Muhao Chen , Zicheng Liu

Recent progress in Large Language Model (LLM) reasoning is increasingly driven by the refinement of post-training loss functions and alignment strategies. However, standard Reinforcement Learning (RL) paradigms like Group Relative Policy…

Machine Learning · Computer Science 2026-01-28 Kishan Panaganti , Zhenwen Liang , Wenhao Yu , Haitao Mi , Dong Yu

Reinforcement Learning with Verifiable Rewards (RLVR) has markedly enhanced the reasoning abilities of large language models (LLMs). Its success, however, largely depends on strong base models with rich world knowledge, yielding only modest…

Artificial Intelligence · Computer Science 2025-08-19 Yongxin Guo , Wenbo Deng , Zhenglin Cheng , Xiaoying Tang

Multimodal Large Language Models (MLLMs) have empowered embodied agents with remarkable capabilities in planning and reasoning. However, when facing ambiguous natural language instructions (e.g., "fetch the tool" in a cluttered room),…

Artificial Intelligence · Computer Science 2025-12-23 Weijie Zhou , Xuangtang Xiong , Ye Tian , Lijun Yue , Xinyu Wu , Wei Li , Chaoyang Zhao , Honghui Dong , Ming Tang , Jinqiao Wang , Zhengyou Zhang

Group Relative Policy Optimization (GRPO) has become a standard approach for training mathematical reasoning models; however, its reliance on multiple completions per prompt makes training computationally expensive. Although recent work has…

Machine Learning · Computer Science 2026-01-15 Kangda Wei , Ruihong Huang

The rapid evolution of agentic workflows has demonstrated strong performance of LLM-based agents in addressing complex reasoning tasks. However, existing workflow optimization methods typically formulate workflow synthesis as a static,…

Artificial Intelligence · Computer Science 2026-02-03 Mingze Kong , Zikun Qu , Zhongquan Zhou , Pengyu Liang , Xiang Li , Zhiwei Shang , Zhi Hong , Kaiyu Huang , Zhiyong Wang , Zhongxiang Dai

Multimodal Large Language Models (MLLMs) are making significant progress in multimodal reasoning. Early approaches focus on pure text-based reasoning. More recent studies have incorporated multimodal information into the reasoning steps;…

Artificial Intelligence · Computer Science 2026-04-21 Dongjie Cheng , Yongqi Li , Zhixin Ma , Hongru Cai , Yupeng Hu , Wenjie Wang , Liqiang Nie , Wenjie Li

Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily…

Reinforcement Learning with Verifiable Rewards (RLVR), primarily driven by the Group Relative Policy Optimization (GRPO) algorithm, is a leading approach for enhancing the reasoning abilities of Large Language Models (LLMs). Despite its…

Machine Learning · Computer Science 2025-10-21 Kangqi Ni , Zhen Tan , Zijie Liu , Pingzhi Li , Tianlong Chen

Reinforcement learning has become the primary paradigm for aligning large language models (LLMs) on complex reasoning tasks, with group relative policy optimization (GRPO) widely used in large-scale post-training. However, GRPO faces…

Machine Learning · Computer Science 2026-01-08 Amir Hossein Yari , Fajri Koto

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities across diverse tasks, yet they lag significantly behind humans in spatial reasoning. We investigate this gap through Transformation-Driven Visual Reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Zongzhao Li , Zongyang Ma , Mingze Li , Songyou Li , Yu Rong , Tingyang Xu , Ziqi Zhang , Deli Zhao , Wenbing Huang

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu