English
Related papers

Related papers: Projective simulation with generalization

200 papers

The ability to plan and execute goal specific actions in varied, unexpected settings is a central requirement of intelligent agents. In this paper, we explore how an agent can be equipped with an internal model of the dynamics of the…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Katerina Fragkiadaki , Pulkit Agrawal , Sergey Levine , Jitendra Malik

Language Models and Vision Language Models have recently demonstrated unprecedented capabilities in terms of understanding human intentions, reasoning, scene understanding, and planning-like behaviour, in text form, among many others. In…

Imitation learning is an effective and safe technique to train robot policies in the real world because it does not depend on an expensive random exploration process. However, due to the lack of exploration, learning policies that…

Robotics · Computer Science 2021-06-24 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Silvio Savarese , Li Fei-Fei

Graphical User Interface (GUI) agents offer cross-platform solutions for automating complex digital tasks, with significant potential to transform productivity workflows. However, their performance is often constrained by the scarcity of…

Artificial Intelligence · Computer Science 2025-04-16 Junlei Zhang , Zichen Ding , Chang Ma , Zijie Chen , Qiushi Sun , Zhenzhong Lan , Junxian He

It is a long-standing challenge to enable an intelligent agent to learn in one environment and generalize to an unseen environment without further data collection and finetuning. In this paper, we consider a zero shot generalization problem…

Machine Learning · Computer Science 2021-03-16 Huazhe Xu , Boyuan Chen , Yang Gao , Trevor Darrell

Complex, multi-task problems have proven to be difficult to solve efficiently in a sparse-reward reinforcement learning setting. In order to be sample efficient, multi-task learning requires reuse and sharing of low-level policies. To…

Machine Learning · Computer Science 2021-09-28 Valerie Chen , Abhinav Gupta , Kenneth Marino

Generalized planning accelerates classical planning by finding an algorithm-like policy that solves multiple instances of a task. A generalized plan can be learned from a few training examples and applied to an entire domain of problems.…

Robotics · Computer Science 2021-09-24 Aidan Curtis , Tom Silver , Joshua B. Tenenbaum , Tomas Lozano-Perez , Leslie Pack Kaelbling

This paper proposes an intent-aware multi-agent planning framework as well as a learning algorithm. Under this framework, an agent plans in the goal space to maximize the expected utility. The planning process takes the belief of other…

Artificial Intelligence · Computer Science 2018-03-07 Siyuan Qi , Song-Chun Zhu

Personalization is the process of fitting a model to patient data, a critical step towards application of multi-physics computational models in clinical practice. Designing robust personalization algorithms is often a tedious,…

Imitation learning holds the promise of equipping robots with versatile skills by learning from expert demonstrations. However, policies trained on finite datasets often struggle to generalize beyond the training distribution. In this work,…

Machine Learning · Computer Science 2025-04-28 Yixiao Wang

The AI community has been exploring a pathway to artificial general intelligence (AGI) by developing "language agents", which are complex large language models (LLMs) pipelines involving both prompting techniques and tool usage methods.…

It is desirable for an agent to be able to solve a rich variety of problems that can be specified through language in the same environment. A popular approach towards obtaining such agents is to reuse skills learned in prior tasks to…

Machine Learning · Computer Science 2024-03-19 Geraud Nangue Tasse , Devon Jarvis , Steven James , Benjamin Rosman

The last few years have witnessed substantial progress in the field of embodied AI where artificial agents, mirroring biological counterparts, are now able to learn from interaction to accomplish complex tasks. Despite this success,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Sarah Pratt , Luca Weihs , Ali Farhadi

Guessing games are a prototypical instance of the "learning by interacting" paradigm. This work investigates how well an artificial agent can benefit from playing guessing games when later asked to perform on novel NLP downstream tasks such…

Computation and Language · Computer Science 2021-02-02 Alessandro Suglia , Yonatan Bisk , Ioannis Konstas , Antonio Vergari , Emanuele Bastianelli , Andrea Vanzo , Oliver Lemon

This work is about understanding the impact of invariance and equivariance on generalisation in supervised learning. We use the perspective afforded by an averaging operator to show that for any predictor that is not equivariant, there is…

Machine Learning · Computer Science 2025-01-08 Hayder Elesedy

We are concerned with the question of how an agent can acquire its own representations from sensory data. We restrict our focus to learning representations for long-term planning, a class of problems that state-of-the-art learning methods…

Machine Learning · Computer Science 2022-05-05 Steven James , Benjamin Rosman , George Konidaris

Agent-based modelling and simulation offers a new and exciting way of understanding the world of work. In this paper we describe the development of an agent-based simulation model, designed to help to understand the relationship between…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Peer-Olaf Siebers , Uwe Aickelin , Helen Celia , Christopher Clegg

Simulation is a crucial component of any robotic system. In order to simulate correctly, we need to write complex rules of the environment: how dynamic agents behave, and how the actions of each of the agents affect the behavior of others.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Seung Wook Kim , Yuhao Zhou , Jonah Philion , Antonio Torralba , Sanja Fidler

The concept of an embodied intelligent agent is a key concept in modern artificial intelligence and robotics. Physically, an agent is an open system embedded in an environment that it interacts with through sensors and actuators. It…

Quantum Physics · Physics 2021-03-17 Michael. J. Kewming , Sally Shrapnel , Gerard. J. Milburn

We discuss the possibility of freedom of action in embodied systems that are, with no exception and at all scales of their body, subject to physical law. We relate the discussion to a model of an artificial agent that exhibits a primitive…

Adaptation and Self-Organizing Systems · Physics 2011-05-12 Hans J. Briegel