English
Related papers

Related papers: Learning at the Ends: From Hand to Tool Affordance…

200 papers

Selection of appropriate tools and use of them when performing daily tasks is a critical function for introducing robots for domestic applications. In previous studies, however, adaptability to target objects was limited, making it…

Robotics · Computer Science 2021-06-07 Namiko Saito , Tetsuya Ogata , Satoshi Funabashi , Hiroki Mori , Shigeki Sugano

Transfer of objects between humans and robots is a critical capability for collaborative robots. Although there has been a recent surge of interest in human-robot handovers, most prior research focus on robot-to-human handovers. Further,…

Robotics · Computer Science 2020-03-16 Wei Yang , Chris Paxton , Maya Cakmak , Dieter Fox

Handing objects to humans is an essential capability for collaborative robots. Previous research works on human-robot handovers focus on facilitating the performance of the human partner and possibly minimising the physical effort needed to…

Training end-to-end deep robot policies requires a lot of domain-, task-, and hardware-specific data, which is often costly to provide. In this work, we propose to tackle this issue by employing a deep neural network with a modular…

Robotics · Computer Science 2019-03-12 Aleksi Hämäläinen , Karol Arndt , Ali Ghadirzadeh , Ville Kyrki

When humans perform contact-rich manipulation tasks, customized tools are often necessary to simplify the task. For instance, we use various utensils for handling food, such as knives, forks and spoons. Similarly, robots may benefit from…

Robotics · Computer Science 2023-02-28 Mengxi Li , Rika Antonova , Dorsa Sadigh , Jeannette Bohg

Developing robots that can assist humans efficiently, safely, and adaptively is crucial for real-world applications such as healthcare. While previous work often assumes a centralized system for co-optimizing human-robot interactions, we…

Robotics · Computer Science 2024-12-30 Jason Qin , Shikun Ban , Wentao Zhu , Yizhou Wang , Dimitris Samaras

Similar to humans, robots benefit from interacting with their environment through a number of different sensor modalities, such as vision, touch, sound. However, learning from different sensor modalities is difficult, because the learning…

Robotics · Computer Science 2019-10-10 Martina Zambelli , Antoine Cully , Yiannis Demiris

Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Tommaso Apicella , Alessio Xompero , Edoardo Ragusa , Riccardo Berta , Andrea Cavallaro , Paolo Gastaldo

It is intractable for assistive robots to have all functionalities pre-programmed prior to deployment. Rather, it is more realistic for robots to perform supplemental, on-site learning about user's needs and preferences, and particularities…

Robotics · Computer Science 2022-10-19 Nina Moorman , Erin Hedlund-Botti , Matthew Gombolay

Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches,…

Humans have an extraordinary ability to communicate and read the properties of objects by simply watching them being carried by someone else. This level of communicative skills and interpretation, available to humans, is essential for…

Future robots are envisioned as versatile systems capable of performing a variety of household tasks. The big question remains, how can we bridge the embodiment gap while minimizing physical robot learning, which fundamentally does not…

Robotics · Computer Science 2025-03-31 Hanzhi Chen , Boyang Sun , Anran Zhang , Marc Pollefeys , Stefan Leutenegger

The ability to wield tools was once considered exclusive to human intelligence, but it's now known that many other animals, like crows, possess this capability. Yet, robotic systems still fall short of matching biological dexterity. In this…

Robotics · Computer Science 2026-01-12 Hoi-Yin Lee , Peng Zhou , Anqing Duan , Wanyu Ma , Chenguang Yang , David Navarro-Alarcon

Robot-assisted feeding requires reliable bite acquisition, a challenging task due to the complex interactions between utensils and food with diverse physical properties. These interactions are further complicated by the temporal variability…

Robotics · Computer Science 2025-09-03 Zhanxin Wu , Bo Ai , Tom Silver , Tapomayukh Bhattacharjee

For humans, the process of grasping an object relies heavily on rich tactile feedback. Most recent robotic grasping work, however, has been based only on visual input, and thus cannot easily benefit from feedback after initiating contact.…

Robot-to-human handovers often rely on static, open-loop strategies (or, at best, approaches that adapt only the position), which generally do not consider how the object will be grasped by the human, thus requiring the user to adapt. This…

Robotics · Computer Science 2026-04-27 Federico Biagi , Dario Onfiani , Simone Silenzi , Cristina Iani , Luigi Biagiotti

The term "affordance" denotes the behavioral meaning of objects. We propose a cognitive architecture for the detection of affordances in the visual modality. This model is based on the internal simulation of movement sequences. For each…

Artificial Intelligence · Computer Science 2016-11-02 Wolfram Schenck , Hendrik Hasenbein , Ralf Möller

The uses of robots are changing from static environments in factories to encompass novel concepts such as Human-Robot Collaboration in unstructured settings. Pre-programming all the functionalities for robots becomes impractical, and hence,…

Planning in realistic environments requires searching in large planning spaces. Affordances are a powerful concept to simplify this search, because they model what actions can be successful in a given situation. However, the classical…

Robotics · Computer Science 2021-06-24 Danfei Xu , Ajay Mandlekar , Roberto Martín-Martín , Yuke Zhu , Silvio Savarese , Li Fei-Fei

Learning predictive models from interaction with the world allows an agent, such as a robot, to learn about how the world works, and then use this learned model to plan coordinated sequences of actions to bring about desired outcomes.…

Machine Learning · Computer Science 2020-01-01 Karl Schmeckpeper , Annie Xie , Oleh Rybkin , Stephen Tian , Kostas Daniilidis , Sergey Levine , Chelsea Finn