English
Related papers

Related papers: Dynamics Generalisation in Reinforcement Learning …

200 papers

Real-world reinforcement learning demands adaptation to unseen environmental conditions without costly retraining. Contextual Markov Decision Processes (cMDP) model this challenge, but existing methods often require explicit context…

Machine Learning · Computer Science 2026-01-19 Frank Röder , Jan Benad , Manfred Eppe , Pradeep Kr. Banerjee

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

We believe that agents for automated incident response based on machine learning need to handle changes in network structure. Computer networks are dynamic, and can naturally change in structure over time. Retraining agents for small…

Artificial Intelligence · Computer Science 2024-07-09 Jakob Nyberg , Pontus Johnson

Recently, it has been shown that transformers pre-trained on diverse datasets with multi-episode contexts can generalize to new reinforcement learning tasks in-context. A key limitation of previously proposed models is their reliance on a…

Machine Learning · Computer Science 2024-07-02 Viacheslav Sinii , Alexander Nikulin , Vladislav Kurenkov , Ilya Zisman , Sergey Kolesnikov

Bounded rational agents often make decisions by evaluating a finite selection of choices, typically derived from a reference point termed the $`$default policy,' based on previous experience. However, the inherent rigidity of the static…

Robotics · Computer Science 2024-09-19 Durgakant Pushp , Junhong Xu , Zheng Chen , Lantao Liu

Though deep reinforcement learning agents have achieved unprecedented success in recent years, their learned policies can be brittle, failing to generalize to even slight modifications of their environments or unfamiliar situations. The…

Artificial Intelligence · Computer Science 2021-12-13 Yiheng Xie , Mingxuan Li , Shangqun Yu , Michael Littman

In many real-world decision making problems, reaching an optimal decision requires taking into account a variable number of objects around the agent. Autonomous driving is a domain in which this is especially relevant, since the number of…

Machine Learning · Computer Science 2020-08-13 Maria Hügle , Gabriel Kalweit , Branka Mirchevska , Moritz Werling , Joschka Boedecker

Building generalist agents that can rapidly adapt to new environments is a key challenge for deploying AI in the digital and real worlds. Is scaling current agent architectures the most effective way to build generalist agents? We propose a…

Artificial Intelligence · Computer Science 2025-02-25 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , Insup Lee

Context awareness is increasingly gaining applicability in interactive ubiquitous mobile computing systems. Each context-aware application has its own set of behaviors to react to context modifications. This paper is concerned with the…

Human-Computer Interaction · Computer Science 2016-09-07 Mao Zheng , Qian Xu , Hao Fan

Climate Change is an incredibly complicated problem that humanity faces. When many variables interact with each other, it can be difficult for humans to grasp the causes and effects of the very large-scale problem of climate change. The…

Machine Learning · Computer Science 2022-12-01 Theodore Wolf

Generalization and adaptation of learned skills to novel situations is a core requirement for intelligent autonomous robots. Although contextual reinforcement learning provides a principled framework for learning and generalization of…

Machine Learning · Computer Science 2019-10-08 Pascal Klink , Hany Abdulsamad , Boris Belousov , Jan Peters

Reinforcement learning (RL) has produced spectacular results in games, robotics, and continuous control. Yet, despite these successes, learned policies often fail to generalize beyond their training distribution, limiting real-world impact.…

Machine Learning · Computer Science 2026-04-06 André Biedenkapp

Training autonomous agents that can learn new tasks from only a handful of demonstrations is a long-standing problem in machine learning. Recently, transformers have been shown to learn new language or vision tasks without any weight…

Machine Learning · Computer Science 2023-12-08 Sharath Chandra Raparthy , Eric Hambro , Robert Kirk , Mikael Henaff , Roberta Raileanu

Dynamic Algorithm Configuration (DAC) addresses the challenge of dynamically setting hyperparameters of an algorithm for a diverse set of instances rather than focusing solely on individual tasks. Agents trained with Deep Reinforcement…

Machine Learning · Computer Science 2024-07-19 Carolin Benjamins , Gjorgjina Cenikj , Ana Nikolikj , Aditya Mohan , Tome Eftimov , Marius Lindauer

Deep reinforcement learning is used in various domains, but usually under the assumption that the environment has stationary conditions like transitions and state distributions. When this assumption is not met, performance suffers. For this…

Machine Learning · Computer Science 2024-05-24 Zihe Liu , Jie Lu , Guangquan Zhang , Junyu Xuan

In this work, we analyze the conditions under which information about the context of an input $X$ can improve the predictions of deep learning models in new domains. Following work in marginal transfer learning in Domain Generalization…

Machine Learning · Computer Science 2025-10-23 Jens Müller , Lars Kühmichel , Martin Rohbeck , Stefan T. Radev , Ullrich Köthe

Learning to navigate in complex environments with dynamic elements is an important milestone in developing AI agents. In this work we formulate the navigation question as a reinforcement learning problem and show that data efficiency and…

Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and opt for domain adaptation methods for a given dataset in…

Machine Learning · Computer Science 2024-05-28 Ryuichiro Hataya , Kota Matsui , Masaaki Imaizumi

In reinforcement learning, agents that consider the context, or current state, when selecting source policies for transfer have been shown to outperform context-free approaches. However, none of the existing approaches transfer knowledge…

Machine Learning · Computer Science 2020-06-11 Michael Gimelfarb , Scott Sanner , Chi-Guhn Lee

Deep Reinforcement Learning (RL) is mainly studied in a setting where the training and the testing environments are similar. But in many practical applications, these environments may differ. For instance, in control systems, the robot(s)…

Machine Learning · Computer Science 2022-10-25 Jean-Baptiste Gaya , Laure Soulier , Ludovic Denoyer