English
Related papers

Related papers: Adapting to Unseen Environments through Explicit R…

200 papers

AI agents deployed in assistive roles often have to collaborate with other agents (humans, AI systems) without prior coordination. Methods considered state of the art for such ad hoc teamwork often pursue a data-driven approach that needs a…

Artificial Intelligence · Computer Science 2025-08-07 Hasra Dodampegama , Mohan Sridharan

Classical methods in robot motion planning, such as sampling-based and optimization-based methods, often struggle with scalability towards higher-dimensional state spaces and complex environments. Diffusion models, known for their…

Robotics · Computer Science 2026-03-20 Edward Sandra , Lander Vanroye , Dries Dirckx , Ruben Cartuyvels , Jan Swevers , Wilm Decré

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Adaptation and Self-Organizing Systems · Physics 2022-04-15 Wolfram Barfuss , Richard P. Mann

The deployment of autonomous agents in real-world scenarios is challenged by "unknown unknowns", i.e. novel unexpected environments not encountered during training, such as degraded signs. While existing research focuses on anomaly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Abhibha Gupta , Rully Agus Hendrawan , Mansur Arief

To learn directed behaviors in complex environments, intelligent agents need to optimize objective functions. Various objectives are known for designing artificial agents, including task rewards and intrinsic motivation. However, it is…

Artificial Intelligence · Computer Science 2022-02-15 Danijar Hafner , Pedro A. Ortega , Jimmy Ba , Thomas Parr , Karl Friston , Nicolas Heess

Large language models are increasingly deployed as specialized agents that plan, call tools, and take actions over extended horizons. Yet many existing evaluations assume a "clean interface" where dynamics are specified and stable, tools…

Computation and Language · Computer Science 2026-02-04 Pouya Pezeshkpour , Estevam Hruschka

Recent work has shown that deep reinforcement-learning agents can learn to follow language-like instructions from infrequent environment rewards. However, this places on environment designers the onus of designing language-conditional…

Artificial Intelligence · Computer Science 2019-12-24 Dzmitry Bahdanau , Felix Hill , Jan Leike , Edward Hughes , Arian Hosseini , Pushmeet Kohli , Edward Grefenstette

To quickly solve new tasks in complex environments, intelligent agents need to build up reusable knowledge. For example, a learned world model captures knowledge about the environment that applies to new tasks. Similarly, skills capture…

Machine Learning · Computer Science 2021-05-04 Kevin Xie , Homanga Bharadhwaj , Danijar Hafner , Animesh Garg , Florian Shkurti

Goal-models (GM) have been used in adaptive systems engineering for their ability to capture the different ways to fulfill the requirements. Contextual GM (CGM) extend these models with the notion of context and context-dependent…

Software Engineering · Computer Science 2015-03-25 Felipe Pontes Guimarães , Genaina Nunes Rodrigues , Raian Ali , Daniel Macêdo Batista

Are world models a necessary ingredient for flexible, goal-directed behaviour, or is model-free learning sufficient? We provide a formal answer to this question, showing that any agent capable of generalizing to multi-step goal-directed…

Artificial Intelligence · Computer Science 2025-10-21 Jonathan Richens , David Abel , Alexis Bellot , Tom Everitt

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment,…

Artificial Intelligence · Computer Science 2022-07-04 Olivier Moulin , Vincent Francois-Lavet , Paul Elbers , Mark Hoogendoorn

Reinforcement learning (RL) has achieved outstanding success in complex robot control tasks, such as drone racing, where the RL agents have outperformed human champions in a known racing track. However, these agents fail in unseen track…

Robotics · Computer Science 2026-01-15 Hongze Wang , Jiaxu Xing , Nico Messikommer , Davide Scaramuzza

The technology for autonomous vehicles is close to replacing human drivers by artificial systems endowed with high-level decision-making capabilities. In this regard, systems must learn about the usual vehicle's behavior to predict imminent…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , andCarlo Regazzoni

The question of whether deep neural networks are good at generalising beyond their immediate training experience is of critical importance for learning-based approaches to AI. Here, we consider tests of out-of-sample generalisation that…

Artificial Intelligence · Computer Science 2020-02-20 Felix Hill , Andrew Lampinen , Rosalia Schneider , Stephen Clark , Matthew Botvinick , James L. McClelland , Adam Santoro

Learning accurate models of the physical world is required for a lot of robotic manipulation tasks. However, during manipulation, robots are expected to interact with unknown workpieces so that building predictive models which can…

Machine Learning · Computer Science 2020-11-03 Wenyu Zhang , Skyler Seto , Devesh K. Jha

Developing agents capable of fluid gameplay in first/third-person games without API access remains a critical challenge in Artificial General Intelligence (AGI). Recent efforts leverage Vision Language Models (VLMs) as direct controllers,…

Computation and Language · Computer Science 2025-03-28 Wenxuan Lu , Jiangyang He , Zhanqiu Zhang , Yiwen Guo , Tianning Zang

If a robotic agent wants to exploit symbolic planning techniques to achieve some goal, it must be able to properly ground an abstract planning domain in the environment in which it operates. However, if the environment is initially unknown…

Artificial Intelligence · Computer Science 2022-04-11 Leonardo Lamanna , Luciano Serafini , Alessandro Saetti , Alfonso Gerevini , Paolo Traverso

Learning and adaptation play great role in emergent socio-economic phenomena. Complex dynamics has been previously found in the systems of multiple learning agents interacting via a simple game. Meanwhile, the single agent adaptation is…

Physics and Society · Physics 2020-05-18 Arkady Zgonnikov , Ihor Lubashevsky

Generalizable agents should adapt to diverse tasks and unseen environments beyond their training distribution. This position paper argues that such generalization requires environment scaling: expanding the distribution of executable…

Artificial Intelligence · Computer Science 2026-05-19 Jiayi Zhang , Fanqi Kong , Guibin Zhang , Maojia Song , Zhaoyang Yu , Jianhao Ruan , Jinyu Xiang , Bang Liu , Chenglin Wu , Yuyu Luo

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

Machine Learning · Computer Science 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell