English
Related papers

Related papers: Learning Shared Dynamics with Meta-World Models

200 papers

The success of smart environments largely depends on their smartness of understanding the environments' ongoing situations. Accordingly, this task is an essence to smart environment central processors. Obtaining knowledge from the…

Human-Computer Interaction · Computer Science 2019-06-25 Hossein Rajaby Faghihi , Mohammad Amin Fazli , Jafar Habibi

We present a framework for learning human user models from joint-action demonstrations that enables the robot to compute a robust policy for a collaborative task with a human. The learning takes place completely automatically, without any…

Robotics · Computer Science 2017-06-15 Stefanos Nikolaidis , Keren Gu , Ramya Ramakrishnan , Julie Shah

To make sense of their surroundings, intelligent systems must transform complex sensory inputs to structured codes that are reduced to task-relevant information such as object category. Biological agents achieve this in a largely autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Robin Weiler , Matthias Brucklacher , Cyriel M. A. Pennartz , Sander M. Bohté

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

Human actions are based on the mental perception of the environment. Even when all the aspects of an environment are not visible, humans have an internal mental model that can generalize the partially visible scenes to fully constructed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Usama Younus , Vinoj Jayasundara , Shivam Mishra , Suleyman Aslan

For successful deployment of robots in multifaceted situations, an understanding of the robot for its environment is indispensable. With advancing performance of state-of-the-art object detectors, the capability of robots to detect objects…

Human-Computer Interaction · Computer Science 2023-03-02 Daniel Weber , Wolfgang Fuhl , Enkelejda Kasneci , Andreas Zell

Learning to interact with the environment not only empowers the agent with manipulation capability but also generates information to facilitate building of action understanding and imitation capabilities. This seems to be a strategy adopted…

Robotics · Computer Science 2022-12-06 M. Y. Seker , A. Ahmetoglu , Y. Nagai , M. Asada , E. Oztop , E. Ugur

Multi-agent reinforcement learning shines as the pinnacle of multi-agent systems, conquering intricate real-world challenges, fostering collaboration and coordination among agents, and unleashing the potential for intelligent…

Multiagent Systems · Computer Science 2023-12-27 Jiawei Wang , Jian Zhao , Zhengtao Cao , Ruili Feng , Rongjun Qin , Yang Yu

World models aim to capture the dynamics of the environment, enabling agents to predict and plan for future states. In most scenarios of interest, the dynamics are highly centered on interactions among objects within the environment. This…

Machine Learning · Computer Science 2025-07-08 Zizhao Wang , Kaixin Wang , Li Zhao , Peter Stone , Jiang Bian

Humans should be able work more effectively with artificial intelligence-based systems when they can predict likely failures and form useful mental models of how the systems work. We conducted a study of human's mental models of artificial…

Human-Computer Interaction · Computer Science 2022-02-01 Kimberly Glasgow , Jonathan Kopecky , John Gersh , Adam Crego

Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remains a rarely utilized property. When task relations are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

The ability to act in multiple environments and transfer previous knowledge to new situations can be considered a critical aspect of any intelligent agent. Towards this goal, we define a novel method of multitask and transfer learning that…

Machine Learning · Computer Science 2016-02-23 Emilio Parisotto , Jimmy Lei Ba , Ruslan Salakhutdinov

Imitation learning is a popular method for teaching robots new behaviors. However, most existing methods focus on teaching short, isolated skills rather than long, multi-step tasks. To bridge this gap, imitation learning algorithms must not…

Artificial Intelligence · Computer Science 2025-11-04 Leon Keller , Daniel Tanneberg , Jan Peters

How do people acquire rich, flexible knowledge about their environment from others despite limited cognitive capacity? Humans are often thought to rely on computationally costly mentalizing, such as inferring others' beliefs. In contrast,…

Artificial Intelligence · Computer Science 2026-05-11 Silja Keßler , Miriam Bautista-Salinero , Claudio Tennie , Charley M. Wu

When modeling dynamical systems from real-world data samples, the distribution of data often changes according to the environment in which they are captured, and the dynamics of the system itself vary from one environment to another.…

Machine Learning · Computer Science 2022-02-15 Yuan Yin , Ibrahim Ayed , Emmanuel de Bézenac , Nicolas Baskiotis , Patrick Gallinari

The pursuit of artificial general intelligence (AGI) has placed embodied intelligence at the forefront of robotics research. Embodied intelligence focuses on agents capable of perceiving, reasoning, and acting within the physical world.…

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have…

The cognitive framework of conceptual spaces bridges the gap between symbolic and subsymbolic AI by proposing an intermediate conceptual layer where knowledge is represented geometrically. There are two main approaches for obtaining the…

Machine Learning · Computer Science 2019-08-08 Lucas Bechberger , Elektra Kypridemou

Identifying common patterns among events is a key ability in human and machine perception, as it underlies intelligent decision making. We propose an approach for learning semantic relational set abstractions on videos, inspired by human…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Alex Andonian , Camilo Fosco , Mathew Monfort , Allen Lee , Rogerio Feris , Carl Vondrick , Aude Oliva

In social robotics, robots needs to be able to be understood by humans. Especially in collaborative tasks where they have to share mutual knowledge. For instance, in an educative scenario, learners share their knowledge and they must adapt…

Robotics · Computer Science 2016-02-24 Alexis Jacq , Wafa Johal , Pierre Dillenbourg , Ana Paiva