中文
相关论文

相关论文: Mind the Model, Not the Agent: The Primacy Bias in…

200 篇论文

While reinforcement learning (RL) has achieved notable success in various domains, training effective policies for complex tasks remains challenging. Agents often converge to local optima and fail to maximize long-term rewards. Existing…

人工智能 · 计算机科学 2025-05-28 Heng Tan , Hua Yan , Yu Yang

In real world settings, numerous constraints are present which are hard to specify mathematically. However, for the real world deployment of reinforcement learning (RL), it is critical that RL agents are aware of these constraints, so that…

机器学习 · 计算机科学 2021-05-24 Usman Anwar , Shehryar Malik , Alireza Aghasi , Ali Ahmed

Reinforcement Learning (RL) is a learning paradigm in which the agent learns from its environment through trial and error. Deep reinforcement learning (DRL) algorithms represent the agent's policies using neural networks, making their…

人工智能 · 计算机科学 2024-09-10 Jasmina Gajcin , Jovan Jeromela , Ivana Dusparic

Transformer-based Large Language Models (LLMs) have revolutionized Natural Language Processing by demonstrating exceptional performance across diverse tasks. This study investigates the impact of the parameter initialization scale on the…

计算与语言 · 计算机科学 2025-05-22 Junjie Yao , Zhongwang Zhang , Zhi-Qin John Xu

Preference based Reinforcement Learning (PbRL) removes the need to hand specify a reward function by learning a reward from preference feedback over policy behaviors. Current approaches to PbRL do not address the credit assignment problem…

机器学习 · 计算机科学 2024-04-16 Mudit Verma , Katherine Metcalf

This paper investigates search in model-based reinforcement learning (RL). Conventional wisdom holds that long-term predictions and compounding errors are the primary obstacles for model-based RL. We challenge this view, showing that search…

机器学习 · 计算机科学 2026-05-25 Wei-Di Chang , Mikael Henaff , Brandon Amos , Gregory Dudek , Scott Fujimoto

Developments in reinforcement learning (RL) have allowed algorithms to achieve impressive performance in highly complex, but largely static problems. In contrast, biological learning seems to value efficiency of adaptation to a…

人工智能 · 计算机科学 2022-05-20 Eric Chalmers , Artur Luczak

Supervised machine learning models and their evaluation strongly depends on the quality of the underlying dataset. When we search for a relevant piece of information it may appear anywhere in a given passage. However, we observe a bias in…

信息检索 · 计算机科学 2021-01-19 Sebastian Hofstätter , Aldo Lipani , Sophia Althammer , Markus Zlabinger , Allan Hanbury

Although recent model-free reinforcement learning algorithms have been shown to be capable of mastering complicated decision-making tasks, the sample complexity of these methods has remained a hurdle to utilizing them in many real-world…

机器学习 · 计算机科学 2020-04-21 Saeed Moazami , Peggy Doerschuk

Preference-based Reinforcement Learning (PbRL) is a paradigm in which an RL agent learns to optimize a task using pair-wise preference-based feedback over trajectories, rather than explicit reward signals. While PbRL has demonstrated…

机器学习 · 计算机科学 2024-04-18 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

Object-centric representations have recently enabled significant progress in tackling relational reasoning tasks. By building a strong object-centric inductive bias into neural architectures, recent efforts have improved generalization and…

机器学习 · 计算机科学 2021-04-20 Wenling Shang , Lasse Espeholt , Anton Raichuk , Tim Salimans

The reinforcement learning (RL) problem is rife with sources of non-stationarity, making it a notoriously difficult problem domain for the application of neural networks. We identify a mechanism by which non-stationary prediction targets…

机器学习 · 计算机科学 2022-05-05 Clare Lyle , Mark Rowland , Will Dabney

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

流体动力学 · 物理学 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

One of the key behavioral characteristics used in neuroscience to determine whether the subject of study -- be it a rodent or a human -- exhibits model-based learning is effective adaptation to local changes in the environment, a particular…

机器学习 · 计算机科学 2023-09-28 Ali Rahimi-Kalahroudi , Janarthanan Rajendran , Ida Momennejad , Harm van Seijen , Sarath Chandar

Playing an important role in Model-Based Reinforcement Learning (MBRL), environment models aim to predict future states based on the past. Existing works usually ignore instantaneous dependence in the state, that is, assuming that the…

机器学习 · 计算机科学 2023-03-10 Zhengmao Zhu , Yuren Liu , Honglong Tian , Yang Yu , Kun Zhang

Hybrid action models are widely considered an effective approach to reinforcement learning (RL) modeling. The current mainstream method is to train agents under Parameterized Action Markov Decision Processes (PAMDPs), which performs well in…

机器学习 · 计算机科学 2025-01-07 Zijian Wang , Bin Wang , Mingwen Shao , Hongbo Dou , Boxiang Tao

Model-based reinforcement learning (MBRL) is a crucial approach to enhance the generalization capabilities and improve the sample efficiency of RL algorithms. However, current MBRL methods focus primarily on building world models for single…

机器学习 · 计算机科学 2025-11-11 Xuantang Xiong , Ni Mu , Runpeng Xie , Senhao Yang , Yaqing Wang , Lexiang Wang , Yao Luan , Siyuan Li , Shuang Xu , Yiqin Yang , Bo Xu

Learning in multi-agent systems is highly challenging due to several factors including the non-stationarity introduced by agents' interactions and the combinatorial nature of their state and action spaces. In particular, we consider the…

机器学习 · 统计学 2023-05-10 Barna Pásztor , Ilija Bogunovic , Andreas Krause

Everything else being equal, simpler models should be preferred over more complex ones. In reinforcement learning (RL), simplicity is typically quantified on an action-by-action basis -- but this timescale ignores temporal regularities,…

机器学习 · 计算机科学 2023-05-29 Tankred Saanum , Noémi Éltető , Peter Dayan , Marcel Binz , Eric Schulz

Capturing and simulating intelligent adaptive behaviours within spatially explicit individual-based models remains an ongoing challenge for researchers. While an ever-increasing abundance of real-world behavioural data are collected, few…

多智能体系统 · 计算机科学 2022-01-05 Sedar Olmez , Dan Birks , Alison Heppenstall