中文
相关论文

相关论文: From Credit Assignment to Entropy Regularization: …

200 篇论文

Entropy regularization is known to improve exploration in sequential decision-making problems. We show that this same mechanism can also lead to nearly unbiased and lower-variance estimates of the mean reward in the optimize-and-estimate…

机器学习 · 计算机科学 2022-08-26 Ben Chugg , Peter Henderson , Jacob Goldin , Daniel E. Ho

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

人工智能 · 计算机科学 2022-06-20 Ingy ElSayed-Aly , Lu Feng

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

机器学习 · 计算机科学 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

The effectiveness of reinforcement learning (RL) agents in continuous control robotics tasks is mainly dependent on the design of the underlying reward function, which is highly prone to reward hacking. A misalignment between the reward…

We focus on an unloading problem, typical of the logistics sector, modeled as a sequential pick-and-place task. In this type of task, modern machine learning techniques have shown to work better than classic systems since they are more…

机器人学 · 计算机科学 2023-05-30 Vittorio Giammarino , Andrew J Meyer , Kai Biegun

While deep reinforcement learning has achieved tremendous successes in various applications, most existing works only focus on maximizing the expected value of total return and thus ignore its inherent stochasticity. Such stochasticity is…

机器学习 · 计算机科学 2023-09-19 Han Zhong , Xun Deng , Ethan X. Fang , Zhuoran Yang , Zhaoran Wang , Runze Li

In reinforcement learning (RL), different reward functions can define the same optimal policy but result in drastically different learning performance. For some, the agent gets stuck with a suboptimal behavior, and for others, it solves the…

机器学习 · 计算机科学 2025-02-25 Grigorii Veviurko , Wendelin Böhmer , Mathijs de Weerdt

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

机器学习 · 计算机科学 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

The emerging field of \emph{value awareness engineering} claims that software agents and systems should be value-aware, i.e. they must make decisions in accordance with human values. In this context, such agents must be capable of…

人工智能 · 计算机科学 2024-06-10 Andrés Holgado-Sánchez , Joaquín Arias , Holger Billhardt , Sascha Ossowski

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

机器学习 · 计算机科学 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel

In the context of inverse reinforcement learning (IRL) with a single expert, adversarial inverse reinforcement learning (AIRL) serves as a foundational approach to providing comprehensive and transferable task descriptions. However, AIRL…

机器学习 · 统计学 2024-12-31 Yangchun Zhang , Wang Zhou , Yirui Zhou

The framework of reinforcement learning or optimal control provides a mathematical formalization of intelligent decision making that is powerful and broadly applicable. While the general form of the reinforcement learning problem enables…

机器学习 · 计算机科学 2018-05-22 Sergey Levine

Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills…

机器学习 · 计算机科学 2022-08-09 Archit Sharma , Kelvin Xu , Nikhil Sardana , Abhishek Gupta , Karol Hausman , Sergey Levine , Chelsea Finn

This paper discusses the application of L1-regularized maximum entropy modeling or SL1-Max [9] to multiclass categorization problems. A new modification to the SL1-Max fast sequential learning algorithm is proposed to handle conditional…

机器学习 · 计算机科学 2007-05-23 Patrick Haffner , Steven Phillips , Rob Schapire

In this paper, a novel Multi-agent Reinforcement Learning (MARL) approach, Multi-Agent Continuous Dynamic Policy Gradient (MACDPP) was proposed to tackle the issues of limited capability and sample efficiency in various scenarios controlled…

系统与控制 · 电气工程与系统科学 2023-09-27 Chenyang Miao , Yunduan Cui , Huiyun Li , Xinyu Wu

Multi-agent reinforcement learning (MARL) faces two critical bottlenecks distinct from single-agent RL: credit assignment in cooperative tasks and partial observability of environmental states. We propose LERO, a framework integrating Large…

机器学习 · 计算机科学 2025-03-31 Yuan Wei , Xiaohan Shan , Jianmin Li

In this work, we address the problem of determining reliable policies in reinforcement learning (RL), with a focus on optimization under uncertainty and the need for performance guarantees. While classical RL algorithms aim at maximizing…

机器学习 · 计算机科学 2025-10-22 Nadir Farhi

Large reasoning models (LRMs) aim to solve diverse and complex problems through structured reasoning. Recent advances in group-based policy optimization methods have shown promise in enabling stable advantage estimation without reliance on…

机器学习 · 计算机科学 2026-01-29 Zhizheng Jiang , Kang Zhao , Weikai Xu , Xinkui Lin , Wei Liu , Jian Luan , Shuo Shang , Peng Han

Deep Reinforcement Learning (Deep RL) has been receiving increasingly more attention thanks to its encouraging performance on a variety of control tasks. Yet, conventional regularization techniques in training neural networks (e.g., $L_2$…

机器学习 · 计算机科学 2021-11-30 Zhuang Liu , Xuanlin Li , Bingyi Kang , Trevor Darrell

We address the problem of learning to assign prediction tasks to one agent from a set of available human or AI agents. In particular, we focus on the sequential learning of agent expertise and assignment policies where each agent is…

人机交互 · 计算机科学 2026-05-28 Shang Wu , Saatvik Kher , Padhraic Smyth