English
Related papers

Related papers: CIM: Constrained Intrinsic Motivation for Sparse-R…

200 papers

As people learn to navigate the world, autonomic nervous system (e.g., "fight or flight") responses provide intrinsic feedback about the potential consequence of action choices (e.g., becoming nervous when close to a cliff edge or driving…

Artificial Intelligence · Computer Science 2019-03-25 Daniel McDuff , Ashish Kapoor

Efficient exploration is crucial in cooperative multi-agent reinforcement learning (MARL), especially in sparse-reward settings. However, due to the reliance on the unimodal policy, existing methods are prone to falling into the local…

Multiagent Systems · Computer Science 2024-12-09 Yuqian Fu , Yuanheng Zhu , Haoran Li , Zijie Zhao , Jiajun Chai , Dongbin Zhao

Safety is essential for reinforcement learning (RL) applied in real-world tasks like autonomous driving. Chance constraints which guarantee the satisfaction of state constraints at a high probability are suitable to represent the…

Machine Learning · Computer Science 2021-02-18 Baiyu Peng , Yao Mu , Jingliang Duan , Yang Guan , Shengbo Eben Li , Jianyu Chen

Current Reinforcement Learning (RL) methods often suffer from sample-inefficiency, resulting from blind exploration strategies that neglect causal relationships among states, actions, and rewards. Although recent causal approaches aim to…

Artificial Intelligence · Computer Science 2025-02-17 Hongye Cao , Fan Feng , Tianpei Yang , Jing Huo , Yang Gao

Reinforcement learning (RL) has enhanced the capabilities of large language models (LLMs) through reward-driven training. Nevertheless, this process can introduce excessively long responses, inflating inference latency and computational…

Machine Learning · Computer Science 2026-02-17 Chang Liu , Yiran Zhao , Lawrence Liu , Yaoqi Ye , Csaba Szepesvári , Lin F. Yang

Exploration is essential in reinforcement learning, particularly in environments where external rewards are sparse. Here we focus on exploration with intrinsic rewards, where the agent transiently augments the external rewards with…

Machine Learning · Computer Science 2024-01-26 Changmin Yu , Neil Burgess , Maneesh Sahani , Samuel J. Gershman

Reinforcement learning (RL) is a promising approach for robotic navigation, allowing robots to learn through trial and error. However, real-world robotic tasks often suffer from sparse rewards, leading to inefficient exploration and…

Popular debiased estimation methods for causal inference -- such as augmented inverse propensity weighting and targeted maximum likelihood estimation -- enjoy desirable asymptotic properties like statistical efficiency and double robustness…

Machine Learning · Statistics 2025-09-16 Tiffany Tianhui Cai , Yuri Fonseca , Kaiwen Hou , Hongseok Namkoong

Active inference is an ambitious theory that treats perception, inference and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena,…

Artificial Intelligence · Computer Science 2018-06-22 Martin Biehl , Christian Guckelsberger , Christoph Salge , Simón C. Smith , Daniel Polani

Designing effective reward functions is critical for reinforcement learning-based biomechanical simulations, yet HCI researchers and practitioners often waste (computation) time with unintuitive trial-and-error tuning. This paper…

Human-Computer Interaction · Computer Science 2025-08-22 Hannah Selder , Florian Fischer , Per Ola Kristensson , Arthur Fleig

This paper presents an interpretable reward design framework for reinforcement learning based constrained optimal control problems with state and terminal constraints. The problem is formalized within a standard partially observable Markov…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Jingjie Ni , Fangfei Li , Xin Jin , Xianlun Peng , Yang Tang

Learning with sparse rewards remains a significant challenge in reinforcement learning (RL), especially when the aim is to train a policy capable of achieving multiple different goals. To date, the most successful approaches for dealing…

Machine Learning · Computer Science 2020-06-02 Henry Charlesworth , Giovanni Montana

We study a class of constrained reinforcement learning (RL) problems in which multiple constraint specifications are not identified before training. It is challenging to identify appropriate constraint specifications due to the undefined…

Optimization and Control · Mathematics 2024-01-02 Dongsheng Ding , Zhengyan Huan , Alejandro Ribeiro

Efficient collaboration in the centralized training with decentralized execution (CTDE) paradigm remains a challenge in cooperative multi-agent systems. We identify divergent action tendencies among agents as a significant obstacle to…

Multiagent Systems · Computer Science 2024-08-30 Junkai Zhang , Yifan Zhang , Xi Sheryl Zhang , Yifan Zang , Jian Cheng

The application of reinforcement learning (RL) in robotic control is still limited in the environments with sparse and delayed rewards. In this paper, we propose a practical self-imitation learning method named Self-Imitation Learning with…

Machine Learning · Computer Science 2021-05-26 Zhixin Chen , Mengxiang Lin

The constrained gradient method (CGM) has recently been proposed to solve convex optimization and monotone variational inequality (VI) problems with general functional constraints. While existing literature has established convergence…

Optimization and Control · Mathematics 2025-11-24 Danqing Zhou , Hongmei Chen , Shiqian Ma , Junfeng Yang

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Deep learning has achieved remarkable successes in solving challenging reinforcement learning (RL) problems when dense reward function is provided. However, in sparse reward environment it still often suffers from the need to carefully…

Machine Learning · Computer Science 2019-02-19 Hao Liu , Alexander Trott , Richard Socher , Caiming Xiong

Constraint Programming (CP) has been successfully used to model and solve complex combinatorial problems. However, modeling is often not trivial and requires expertise, which is a bottleneck to wider adoption. In Constraint Acquisition…

Artificial Intelligence · Computer Science 2023-12-19 Dimos Tsouros , Senne Berden , Tias Guns

Continual learning is inherently a constrained learning problem. The goal is to learn a predictor under a no-forgetting requirement. Although several prior studies formulate it as such, they do not solve the constrained problem explicitly.…

Machine Learning · Computer Science 2024-06-03 Juan Elenter , Navid NaderiAlizadeh , Tara Javidi , Alejandro Ribeiro