English
Related papers

Related papers: AdaCuRL: Adaptive Curriculum Reinforcement Learnin…

200 papers

Despite impressive progress in areas like mathematical reasoning, large language models still face significant challenges in consistently solving complex problems. Drawing inspiration from key human learning strategies, we propose two novel…

Artificial Intelligence · Computer Science 2025-09-18 Enci Zhang , Xingang Yan , Wei Lin , Tianxiang Zhang , Qianchun Lu

Reinforcement finetuning (RFT) has shown great potential for enhancing the mathematical reasoning capabilities of large language models (LLMs), but it is often sample- and compute-inefficient, requiring extensive training. In this work, we…

Machine Learning · Computer Science 2026-02-03 Taiwei Shi , Yiyang Wu , Linxin Song , Tianyi Zhou , Jieyu Zhao

Learning in the combinatorially large output space of sequence generation problems is challenging as providing expert demonstrations scales poorly with sequence length, and RL struggles with sparse rewards. Between dense demonstrations in…

Reinforcement learning (RL) can be formulated as a sequence modeling problem, where models predict future actions based on historical state-action-reward sequences. Current approaches typically require long trajectory sequences to model the…

Machine Learning · Computer Science 2024-12-23 Hemant Kumawat , Saibal Mukhopadhyay

Deep reinforcement learning (RL) has shown great empirical successes, but suffers from brittleness and sample inefficiency. A potential remedy is to use a previously-trained policy as a source of supervision. In this work, we refer to these…

Machine Learning · Computer Science 2021-09-16 Daniel Seita , Abhinav Gopal , Zhao Mandi , John Canny

Large Language Models (LLMs) have shown remarkable performance on complex reasoning tasks, especially when equipped with long chain-of-thought (CoT) reasoning. However, eliciting long CoT typically requires large-scale reinforcement…

Computation and Language · Computer Science 2026-01-30 Huiyuan Lai , Malvina Nissim

Query optimization is a crucial component for the efficacy of Retrieval-Augmented Generation (RAG) systems. While reinforcement learning (RL)-based agentic and reasoning methods have recently emerged as a promising direction on query…

Artificial Intelligence · Computer Science 2026-01-30 Wei Wen , Sihang Deng , Tianjun Wei , Keyu Chen , Ruizhi Qiao , Xing Sun

Automatic Curriculum Learning (ACL) has become a cornerstone of recent successes in Deep Reinforcement Learning (DRL).These methods shape the learning trajectories of agents by challenging them with tasks adapted to their capacities. In…

Machine Learning · Computer Science 2020-06-01 Rémy Portelas , Cédric Colas , Lilian Weng , Katja Hofmann , Pierre-Yves Oudeyer

Curriculum learning has demonstrated substantial effectiveness in robot learning. However, it still faces limitations when scaling to complex, wide-ranging task spaces. Such task spaces often lack a well-defined difficulty structure, making…

Robotics · Computer Science 2026-01-27 Ziming Li , Chenhao Li , Marco Hutter

Deep reinforcement learning (DRL) has been widely applied in autonomous exploration and mapping tasks, but often struggles with the challenges of sampling efficiency, poor adaptability to unknown map sizes, and slow simulation speed. To…

Robotics · Computer Science 2023-02-28 Zhi Li , Jinghao Xin , Ning Li

Recent advances in Large Language Models(LLMs) have enabled strong performance in long-form writing, but current training paradigms remain limited: Supervised Fine-Tuning (SFT) remains constrained by data saturation and performance…

Computation and Language · Computer Science 2026-04-21 Xuanyu Lei , Chenliang Li , Yuning Wu , Kaiming Liu , Weizhou Shen , Peng Li , Ming Yan , Fei Huang , Ya-Qin Zhang , Yang Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities but often face challenges with tasks requiring sophisticated reasoning. While Chain-of-Thought (CoT) prompting significantly enhances reasoning, it indiscriminately…

Machine Learning · Computer Science 2025-05-27 Chenwei Lou , Zewei Sun , Xinnian Liang , Meng Qu , Wei Shen , Wenqi Wang , Yuntao Li , Qingping Yang , Shuangzhi Wu

Modern large reasoning models demonstrate impressive problem-solving capabilities by employing sophisticated reasoning strategies. However, they often struggle to balance efficiency and effectiveness, frequently generating unnecessarily…

Artificial Intelligence · Computer Science 2025-12-23 Shijue Huang , Hongru Wang , Wanjun Zhong , Zhaochen Su , Jiazhan Feng , Bowen Cao , Yi R. Fung

Reinforcement Learning (RL) is crucial for empowering VideoLLMs with complex spatiotemporal reasoning. However, current RL paradigms predominantly rely on random data shuffling or naive curriculum strategies based on scalar difficulty…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Hongbo Jin , Kuanwei Lin , Wenhao Zhang , Yichen Jin , Ge Li

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Xiangyu Zhang , Abinet Tesfaye Eseye , Bernard Knueven , Weijia Liu , Matthew Reynolds , Wesley Jones

Class-Incremental Learning aims to update a deep classifier to learn new categories while maintaining or improving its accuracy on previously observed classes. Common methods to prevent forgetting previously learned classes include…

Machine Learning · Computer Science 2024-07-02 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Mert Kilickaya , Joaquin Vanschoren

Reinforcement learning has proven its effectiveness in enhancing the reasoning capabilities of large language models. Recent research efforts have progressively extended this paradigm to multimodal reasoning tasks. Due to the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ruifeng Yuan , Chenghao Xiao , Sicong Leng , Jianyu Wang , Long Li , Weiwen Xu , Hou Pong Chan , Deli Zhao , Tingyang Xu , Zhongyu Wei , Hao Zhang , Yu Rong

Training Large Language Models (LLMs) is highly memory-intensive due to optimizer state overhead. The FRUGAL framework mitigates this with gradient splitting, but its static hyperparameters -- the subspace ratio ($\rho$) and update…

Machine Learning · Computer Science 2026-04-30 Quang-Hung Bui , Anh Son Ta

A key challenge of continual reinforcement learning (CRL) in dynamic environments is to promptly adapt the RL agent's behavior as the environment changes over its lifetime, while minimizing the catastrophic forgetting of the learned…

Machine Learning · Computer Science 2023-05-25 Tiantian Zhang , Zichuan Lin , Yuxing Wang , Deheng Ye , Qiang Fu , Wei Yang , Xueqian Wang , Bin Liang , Bo Yuan , Xiu Li

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a prevailing paradigm for enhancing reasoning in Multimodal Large Language Models (MLLMs). However, relying solely on outcome supervision risks reward hacking, where…

Computation and Language · Computer Science 2026-03-04 Yukun Chen , Jiaming Li , Longze Chen , Ze Gong , Jingpeng Li , Zhen Qin , Hengyu Chang , Ancheng Xu , Zhihao Yang , Hamid Alinejad-Rokny , Qiang Qu , Bo Zheng , Min Yang
‹ Prev 1 2 3 10 Next ›