English
Related papers

Related papers: Mind Your Entropy: From Maximum Entropy to Traject…

200 papers

This report presents our reinforcement learning-based approach for the swing-up and stabilisation tasks of the acrobot and pendubot, tailored specifcially to the updated guidelines of the 3rd AI Olympics at ICRA 2025. Building upon our…

Robotics · Computer Science 2025-05-13 Jean Seong Bjorn Choe , Bumkyu Choi , Jong-kook Kim

Connections between statistical mechanics and machine learning have repeatedly proven fruitful, providing insight into optimization, generalization, and representation learning. In this work, we follow this tradition by leveraging results…

Machine Learning · Computer Science 2026-03-16 Jacob Adamczyk , Juan Sebastian Rojas , Rahul V. Kulkarni

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the…

Machine Learning · Computer Science 2020-11-19 Saurabh Arora , Prashant Doshi , Bikramjit Banerjee

Although well-established in general reinforcement learning (RL), value-based methods are rarely explored in constrained RL (CRL) for their incapability of finding policies that can randomize among multiple actions. To apply value-based…

Machine Learning · Computer Science 2022-06-28 Tianchi Cai , Wenpeng Zhang , Lihong Gu , Xiaodong Zeng , Jinjie Gu

Entropic regularization of policies in Reinforcement Learning (RL) is a commonly used heuristic to ensure that the learned policy explores the state-space sufficiently before overfitting to a local optimal policy. The primary motivation for…

Machine Learning · Computer Science 2021-01-19 Hisham Husain , Kamil Ciosek , Ryota Tomioka

Tool use represents a critical capability for AI agents, with recent advances focusing on leveraging reinforcement learning (RL) to scale up the explicit reasoning process to achieve better performance. However, there are some key…

Artificial Intelligence · Computer Science 2026-03-17 Yirong Zeng , Xiao Ding , Yufei Liu , Yuxian Wang , Qunyao Du , Yutai Hou , Wu Ning , Haonan Song , Duyu Tang , Dandan Tu , Bing Qin , Ting Liu

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

This paper proposes an adaptive energy management strategy for hybrid electric vehicles by combining deep reinforcement learning (DRL) and transfer learning (TL). This work aims to address the defect of DRL in tedious training time. First,…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Xiaowei Guo , Teng Liu , Bangbei Tang , Xiaolin Tang , Jinwei Zhang , Wenhao Tan , Shufeng Jin

The double descent (DD) paradox, where over-parameterized models see generalization improve past the interpolation point, remains largely unexplored in the non-stationary domain of Deep Reinforcement Learning (DRL). We present preliminary…

Machine Learning · Computer Science 2025-11-11 Viktor Veselý , Aleksandar Todorov , Matthia Sabatelli

This paper studies the continuous-time reinforcement learning in jump-diffusion models by featuring the q-learning (the continuous-time counterpart of Q-learning) under Tsallis entropy regularization. Contrary to the Shannon entropy, the…

Optimization and Control · Mathematics 2026-02-16 Lijun Bo , Yijie Huang , Xiang Yu , Tingting Zhang

Large reasoning models (LRMs) have emerged as a powerful paradigm for solving complex real-world tasks. In practice, these models are predominantly trained via Reinforcement Learning with Verifiable Rewards (RLVR), yet most existing…

Artificial Intelligence · Computer Science 2026-02-27 Qiannian Zhao , Chen Yang , Jinhao Jing , Yunke Zhang , Xuhui Ren , Lu Yu , Shijie Zhang , Hongzhi Yin

Reinforcement learning-based recommender systems have recently gained popularity. However, due to the typical limitations of simulation environments (e.g., data inefficiency), most of the work cannot be broadly applied in all domains. To…

Information Retrieval · Computer Science 2024-06-04 Xiaocong Chen , Siyu Wang , Lina Yao

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central approach for improving the reasoning ability of large language models. Recent work studies RLVR through token entropy, arguing that high-entropy tokens drive…

Machine Learning · Computer Science 2025-12-02 Xinzhu Chen , Xuesheng Li , Zhongxiang Sun , Weijie Yu

Reinforcement Learning with Verifiable Reward (RLVR) has proven effective for training reasoning-oriented large language models, but existing methods largely assume high-resource settings with abundant training data. In low-resource…

Machine Learning · Computer Science 2026-04-21 Zhanyu Liu , Qingguo Hu , Ante Wang , Chenqing Liu , Zhishang Xiang , Hui Li , Delai Qiu , Jinsong Su

Reinforcement Learning (RL) heavily relies on the careful design of the reward function. However, accurately assigning rewards to each state-action pair in Long-Term Reinforcement Learning (LTRL) tasks remains a significant challenge. As a…

Machine Learning · Computer Science 2025-06-03 Qi Ju , Falin Hei , Zhemei Fang , Yunfeng Luo

Reinforcement Learning with Verifiable Rewards (RLVR) for Multimodal Large Language Models (MLLMs) is highly dependent on high-quality labeled data, which is often scarce and prone to substantial annotation noise in real-world scenarios.…

We investigate an entropy-regularized reinforcement learning (RL) approach to optimal stopping problems motivated by real option models. Classical stopping rules are strict and non-randomized, limiting natural exploration in RL settings. To…

Optimization and Control · Mathematics 2026-02-18 Jodi Dianetti , Giorgio Ferrari , Renyuan Xu

The varying significance of distinct primitive behaviors during the policy learning process has been overlooked by prior model-free RL algorithms. Leveraging this insight, we explore the causal relationship between different action…

Machine Learning · Computer Science 2024-11-05 Tianying Ji , Yongyuan Liang , Yan Zeng , Yu Luo , Guowei Xu , Jiawei Guo , Ruijie Zheng , Furong Huang , Fuchun Sun , Huazhe Xu

This paper presents advanced techniques of training diffusion policies for offline reinforcement learning (RL). At the core is a mean-reverting stochastic differential equation (SDE) that transfers a complex action distribution into a…

Machine Learning · Computer Science 2025-01-09 Ruoqi Zhang , Ziwei Luo , Jens Sjölund , Thomas B. Schön , Per Mattsson

Replaying data is a principal mechanism underlying the stability and data efficiency of off-policy reinforcement learning (RL). We present an effective yet simple framework to extend the use of replays across multiple experiments, minimally…