English
Related papers

Related papers: Active Inference for Robotic Manipulation

200 papers

To learn directed behaviors in complex environments, intelligent agents need to optimize objective functions. Various objectives are known for designing artificial agents, including task rewards and intrinsic motivation. However, it is…

Artificial Intelligence · Computer Science 2022-02-15 Danijar Hafner , Pedro A. Ortega , Jimmy Ba , Thomas Parr , Karl Friston , Nicolas Heess

This paper addresses the problem of synthesizing the behavior of an AI agent that provides proactive task assistance to a human in settings like factory floors where they may coexist in a common environment. Unlike in the case of requested…

Artificial Intelligence · Computer Science 2021-09-07 Anagha Kulkarni , Siddharth Srivastava , Subbarao Kambhampati

The way the brain selects and controls actions is still widely debated. Mainstream approaches based on Optimal Control focus on stimulus-response mappings that optimize cost functions. Ideomotor theory and cybernetics propose a different…

Active inference is a unifying theory for perception and action resting upon the idea that the brain maintains an internal model of the world by minimizing free energy. From a behavioral perspective, active inference agents can be seen as…

Machine Learning · Computer Science 2024-01-17 Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals. We seek to mathematically formalize these abilities using a neural network…

Machine Learning · Computer Science 2018-11-01 Nick Haber , Damian Mrowca , Li Fei-Fei , Daniel L. K. Yamins

This paper proposes an intent-aware multi-agent planning framework as well as a learning algorithm. Under this framework, an agent plans in the goal space to maximize the expected utility. The planning process takes the belief of other…

Artificial Intelligence · Computer Science 2018-03-07 Siyuan Qi , Song-Chun Zhu

In this work, we introduce the concept of Active Representation Learning, a novel class of problems that intertwines exploration and representation learning within partially observable environments. We extend ideas from Active Simultaneous…

Machine Learning · Computer Science 2024-11-07 Nikola Milosevic , Gesine Müller , Jan Huisken , Nico Scherf

The enactive approach to cognition is typically proposed as a viable alternative to traditional cognitive science. Enactive cognition displaces the explanatory focus from the internal representations of the agent to the direct sensorimotor…

Machine Learning · Computer Science 2018-10-11 Rafik Hadfi

Active learning from demonstration allows a robot to query a human for specific types of input to achieve efficient learning. Existing work has explored a variety of active query strategies; however, to our knowledge, none of these…

Machine Learning · Computer Science 2019-06-05 Daniel S. Brown , Yuchen Cui , Scott Niekum

Intention recognition, or the ability to anticipate the actions of another agent, plays a vital role in the design and development of automated assistants that can support humans in their daily tasks. In particular, industrial settings pose…

Artificial Intelligence · Computer Science 2024-11-27 Juan Carlos Saborio , Joachim Hertzberg

Planning for robotic manipulation requires reasoning about the changes a robot can affect on objects. When such interactions can be modelled analytically, as in domains with rigid objects, efficient planning algorithms exist. However, in…

Robotics · Computer Science 2019-05-14 Angelina Wang , Thanard Kurutach , Kara Liu , Pieter Abbeel , Aviv Tamar

Object permanence in psychology means knowing that objects still exist even if they are no longer visible. It is a crucial concept for robots to operate autonomously in uncontrolled environments. Existing approaches learn object permanence…

Robotics · Computer Science 2021-10-04 Ying Siu Liang , Chen Zhang , Dongkyu Choi , Kenneth Kwok

We consider an active visual exploration scenario, where an agent must intelligently select its camera motions to efficiently reconstruct the full environment from only a limited set of narrow field-of-view glimpses. While the agent has…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Santhosh K. Ramakrishnan , Kristen Grauman

Dynamic game theory is an increasingly popular tool for modeling multi-agent, e.g. human-robot, interactions. Game-theoretic models presume that each agent wishes to minimize a private cost function that depends on others' actions. These…

Robotics · Computer Science 2025-10-17 Cade Armstrong , Ryan Park , Xinjie Liu , Kushagra Gupta , David Fridovich-Keil

Manipulation of deformable objects is a challenging task for a robot. It will be problematic to use a single sensory input to track the behaviour of such objects: vision can be subjected to occlusions, whereas tactile inputs cannot capture…

Robotics · Computer Science 2023-05-01 Leszek Pecyna , Siyuan Dong , Shan Luo

Manipulating unseen objects is challenging without a 3D representation, as objects generally have occluded surfaces. This requires physical interaction with objects to build their internal representations. This paper presents an approach…

Robotics · Computer Science 2024-10-27 Saptarshi Dasgupta , Akshat Gupta , Shreshth Tuli , Rohan Paul

We propose an approach to learning agents for active robotic mapping, where the goal is to map the environment as quickly as possible. The agent learns to map efficiently in simulated environments by receiving rewards corresponding to how…

Robotics · Computer Science 2018-01-01 Shane Barratt

If a robotic agent wants to exploit symbolic planning techniques to achieve some goal, it must be able to properly ground an abstract planning domain in the environment in which it operates. However, if the environment is initially unknown…

Artificial Intelligence · Computer Science 2022-04-11 Leonardo Lamanna , Luciano Serafini , Alessandro Saetti , Alfonso Gerevini , Paolo Traverso

Standard computer vision systems assume access to intelligently captured inputs (e.g., photos from a human photographer), yet autonomously capturing good observations is a major challenge in itself. We address the problem of learning to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Santhosh K. Ramakrishnan , Dinesh Jayaraman , Kristen Grauman

Humans perceive and interact with hundreds of objects every day. In doing so, they need to employ mental models of these objects and often exploit symmetries in the object's shape and appearance in order to learn generalizable and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Stefano Ferraro , Toon Van de Maele , Tim Verbelen , Bart Dhoedt