English
Related papers

Related papers: Learning Awareness Models

200 papers

Object permanence in psychology means knowing that objects still exist even if they are no longer visible. It is a crucial concept for robots to operate autonomously in uncontrolled environments. Existing approaches learn object permanence…

Robotics · Computer Science 2021-10-04 Ying Siu Liang , Chen Zhang , Dongkyu Choi , Kenneth Kwok

As part of human core knowledge, the representation of objects is the building block of mental representation that supports high-level concepts and symbolic reasoning. While humans develop the ability of perceiving objects situated in 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 John Day , Tushar Arora , Jirui Liu , Li Erran Li , Ming Bo Cai

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

Autonomous agents embedded in a physical environment need the ability to recognize objects and their properties from sensory data. Such a perceptual ability is often implemented by supervised machine learning models, which are pre-trained…

In order for robots and other artificial agents to efficiently learn to perform useful tasks defined by an end user, they must understand not only the goals of those tasks, but also the structure and dynamics of that user's environment.…

Artificial Intelligence · Computer Science 2019-07-22 Robert Loftin , Bei Peng , Matthew E. Taylor , Michael L. Littman , David L. Roberts

Safe human-robot interactions require robots to be able to learn how to behave appropriately in \sout{humans' world} \rev{spaces populated by people} and thus to cope with the challenges posed by our dynamic and unstructured environment,…

Self-Modeling is the process by which an agent, such as an animal or machine, learns to create a predictive model of its own dynamics. Once captured, this self-model can then allow the agent to plan and evaluate various potential behaviors…

Robotics · Computer Science 2022-09-07 Robert Kwiatkowski , Yuhang Hu , Boyuan Chen , Hod Lipson

Model-based reinforcement learning (RL) enjoys several benefits, such as data-efficiency and planning, by learning a model of the environment's dynamics. However, learning a global model that can generalize across different dynamics is a…

Machine Learning · Computer Science 2020-06-30 Kimin Lee , Younggyo Seo , Seunghyun Lee , Honglak Lee , Jinwoo Shin

Modelling the behaviours of other agents is essential for understanding how agents interact and making effective decisions. Existing methods for agent modelling commonly assume knowledge of the local observations and chosen actions of the…

Machine Learning · Computer Science 2021-11-10 Georgios Papoudakis , Filippos Christianos , Stefano V. Albrecht

Learning physical dynamics in a series of non-stationary environments is a challenging but essential task for model-based reinforcement learning (MBRL) with visual inputs. It requires the agent to consistently adapt to novel tasks without…

Machine Learning · Computer Science 2025-07-08 Minting Pan , Wendong Zhang , Geng Chen , Xiangming Zhu , Siyu Gao , Yunbo Wang , Xiaokang Yang

A long-standing challenge in Reinforcement Learning is enabling agents to learn a model of their environment which can be transferred to solve other problems in a world with the same underlying rules. One reason this is difficult is the…

Machine Learning · Computer Science 2019-05-16 Kai Olav Ellefsen , Jim Torresen

The ability to simulate the effects of future actions on the world is a crucial ability of intelligent embodied agents, enabling agents to anticipate the effects of their actions and make plans accordingly. While a large body of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Siyuan Zhou , Yilun Du , Yuncong Yang , Lei Han , Peihao Chen , Dit-Yan Yeung , Chuang Gan

A key challenge for an agent learning to interact with the world is to reason about physical properties of objects and to foresee their dynamics under the effect of applied forces. In order to scale learning through interaction to many…

Robotics · Computer Science 2020-08-04 Iman Nematollahi , Oier Mees , Lukas Hermann , Wolfram Burgard

We study the problem of learning physical object representations for robot manipulation. Understanding object physics is critical for successful object manipulation, but also challenging because physical object properties can rarely be…

Robotics · Computer Science 2019-06-13 Zhenjia Xu , Jiajun Wu , Andy Zeng , Joshua B. Tenenbaum , Shuran Song

The ability to plan and execute goal specific actions in varied, unexpected settings is a central requirement of intelligent agents. In this paper, we explore how an agent can be equipped with an internal model of the dynamics of the…

Computer Vision and Pattern Recognition · Computer Science 2016-01-20 Katerina Fragkiadaki , Pulkit Agrawal , Sergey Levine , Jitendra Malik

To interact with humans and act in the world, agents need to understand the range of language that people use and relate it to the visual world. While current agents can learn to execute simple language instructions, we aim to build agents…

Computation and Language · Computer Science 2024-06-03 Jessy Lin , Yuqing Du , Olivia Watkins , Danijar Hafner , Pieter Abbeel , Dan Klein , Anca Dragan

Machines that can predict the effect of physical interactions on the dynamics of previously unseen object instances are important for creating better robots and interactive virtual worlds. In this work, we focus on predicting the dynamics…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Davis Rempe , Srinath Sridhar , He Wang , Leonidas J. Guibas

The ability of modeling the other agents, such as understanding their intentions and skills, is essential to an agent's interactions with other agents. Conventional agent modeling relies on passive observation from demonstrations. In this…

Artificial Intelligence · Computer Science 2018-10-02 Tianmin Shu , Caiming Xiong , Ying Nian Wu , Song-Chun Zhu

Large Language Models (LLMs) handle physical commonsense information inadequately. As a result of being trained in a disembodied setting, LLMs often fail to predict an action's outcome in a given environment. However, predicting the effects…

Computation and Language · Computer Science 2023-02-06 Gautier Dagan , Frank Keller , Alex Lascarides

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang