English
Related papers

Related papers: SpotLight: Robotic Scene Understanding through Int…

200 papers

Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or…

Robotics · Computer Science 2024-06-07 Pietro Mazzaglia , Taco Cohen , Daniel Dijkman

Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or…

Robotics · Computer Science 2024-06-14 Pietro Mazzaglia , Taco Cohen , Daniel Dijkman

We present a novel framework for estimating accident-prone regions in everyday indoor scenes, aimed at improving real-time risk awareness in service robots operating in human-centric environments. As robots become integrated into daily…

In the quest to enable robots to coexist with humans, understanding dynamic situations and selecting appropriate actions based on common sense and affordances are essential. Conventional AI systems face challenges in applying affordance, as…

Artificial Intelligence · Computer Science 2025-04-03 Kazuma Arii , Satoshi Kurihara

Visual affordance learning is a key component for robots to understand how to interact with objects. Conventional approaches in this field rely on pre-defined objects and actions, falling short of capturing diverse interactions in realworld…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Tomoya Yoshida , Shuhei Kurita , Taichi Nishimura , Shinsuke Mori

Artificial intelligence is essential to succeed in challenging activities that involve dynamic environments, such as object manipulation tasks in indoor scenes. Most of the state-of-the-art literature explores robotic grasping methods by…

Robotics · Computer Science 2019-05-28 Paola Ardón , Èric Pairet , Ron Petrick , Subramanian Ramamoorthy , Katrin Lohan

Hybrid collaboration has become a fixture in modern workplaces, yet it introduces persistent socio-technical asymmetries-especially disadvantaging remote participants, who struggle with presence disparity, reduced visibility, and limited…

Human-Computer Interaction · Computer Science 2025-06-30 Marie Altmann , Kimberly Hegemann , Ali Askari , Vineetha Rallabandi , Max Pascher , Jens Gerken

Traditional control and planning for robotic manipulation heavily rely on precise physical models and predefined action sequences. While effective in structured environments, such approaches often fail in real-world scenarios due to…

Robotics · Computer Science 2025-08-08 Jin Wang , Weijie Wang , Boyuan Deng , Heng Zhang , Rui Dai , Nikos Tsagarakis

We propose AffordanceNet, a new deep learning approach to simultaneously detect multiple objects and their affordances from RGB images. Our AffordanceNet has two branches: an object detection branch to localize and classify the object, and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Thanh-Toan Do , Anh Nguyen , Ian Reid

Spatial relationships between objects represent key scene information for humans to understand and interact with the world. To study the capability of current computer vision systems to recognize physically grounded spatial relations, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Chuan Wen , Dinesh Jayaraman , Yang Gao

Over the past few years, deep learning techniques have achieved tremendous success in many visual understanding tasks such as object detection, image segmentation, and caption generation. Despite this thriving in computer vision and natural…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Anh Nguyen

While general object recognition is still far from being solved, this paper proposes a way for a robot to recognize every object at an almost human-level accuracy. Our key observation is that many robots will stay in a relatively closed…

Computer Vision and Pattern Recognition · Computer Science 2015-07-13 Shuran Song , Linguang Zhang , Jianxiong Xiao

This paper provides a review of deep learning applications in scene understanding in autonomous robots, including innovations in object detection, semantic and instance segmentation, depth estimation, 3D reconstruction, and visual SLAM. It…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Afia Maham , Dur E Nayab Tashfa

Autonomous mobile service robots, like lawnmowers or cleaning robots, operating in human-populated environments need to reason about local human-human interactions to support safe and socially aware navigation while fulfilling their tasks.…

Robotics · Computer Science 2026-02-27 Mengyu Liang , Sarah Gillet Schlegel , Iolanda Leite

Objects rarely sit in isolation in everyday human environments. If we want robots to operate and perform tasks in our human environments, they must understand how the objects they manipulate will interact with structural elements of the…

Robotics · Computer Science 2024-01-30 Yixuan Huang , Nichols Crawford Taylor , Adam Conkey , Weiyu Liu , Tucker Hermans

General scene perception has progressed from object recognition toward open-vocabulary grounding, part localization, and affordance prediction. Yet these capabilities are often realized as isolated predictions that localize objects, parts,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Pengxin Xu , Xincheng Lin , Luping Xiao , Qing Jiang , Meishan Zhang , Hao Fei , Shanghang Zhang , Xingyu Chen

Intelligent robots require object-level scene understanding to reason about possible tasks and interactions with the environment. Moreover, many perception tasks such as scene reconstruction, image retrieval, or place recognition can…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Cathrin Elich , Iro Armeni , Martin R. Oswald , Marc Pollefeys , Joerg Stueckler

This paper presents Affecta-context, a general framework to facilitate behavior adaptation for social robots. The framework uses information about the physical context to guide its behaviors in human-robot interactions. It consists of two…

Robotics · Computer Science 2025-08-08 Morten Roed Frederiksen , Kasper Støy

The term "affordance" denotes the behavioral meaning of objects. We propose a cognitive architecture for the detection of affordances in the visual modality. This model is based on the internal simulation of movement sequences. For each…

Artificial Intelligence · Computer Science 2016-11-02 Wolfram Schenck , Hendrik Hasenbein , Ralf Möller

Lengthy setup processes that require robotics expertise remain a major barrier to deploying robots for tasks involving high product variability and small batch sizes. As a result, collaborative robots, despite their advanced sensing and…

Robotics · Computer Science 2025-12-30 Christoph Willibald , Lugh Martensen , Thomas Eiband , Dongheui Lee