English
Related papers

Related papers: HIPer: A Human-Inspired Scene Perception Model for…

200 papers

As the scene information, including objectness and scene type, are important for people with visual impairment, in this work we present a multi-task efficient perception system for the scene parsing and recognition tasks. Building on the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Yingzhi Zhang , Haoye Chen , Kailun Yang , Jiaming Zhang , Rainer Stiefelhagen

Careful robot manipulation in every-day cluttered environments requires an accurate understanding of the 3D scene, in order to grasp and place objects stably and reliably and to avoid colliding with other objects. In general, we must…

Robotics · Computer Science 2025-11-11 Aditya Agarwal , Gaurav Singh , Bipasha Sen , Tomás Lozano-Pérez , Leslie Pack Kaelbling

The success of smart environments largely depends on their smartness of understanding the environments' ongoing situations. Accordingly, this task is an essence to smart environment central processors. Obtaining knowledge from the…

Human-Computer Interaction · Computer Science 2019-06-25 Hossein Rajaby Faghihi , Mohammad Amin Fazli , Jafar Habibi

Human-centric 3D scene understanding has recently drawn increasing attention, driven by its critical impact on robotics. However, human-centric real-life scenarios are extremely diverse and complicated, and humans have intricate motions and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Yichen Yao , Zimo Jiang , Yujing Sun , Zhencai Zhu , Xinge Zhu , Runnan Chen , Yuexin Ma

Being able to explore an environment and understand the location and type of all objects therein is important for indoor robotic platforms that must interact closely with humans. However, it is difficult to evaluate progress in this area…

Robotics · Computer Science 2020-09-14 David Hall , Ben Talbot , Suman Raj Bista , Haoyang Zhang , Rohan Smith , Feras Dayoub , Niko Sünderhauf

Scene models allow robots to reason about what is in the scene, what else should be in it, and what should not be in it. In this paper, we propose a hybrid Boltzmann Machine (BM) for scene modeling where relations between objects are…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 İlker Bozcan , Yağmur Oymak , İdil Zeynep Alemdar , Sinan Kalkan

Understanding human perceptions of robot performance is crucial for designing socially intelligent robots that can adapt to human expectations. Current approaches often rely on surveys, which can disrupt ongoing human-robot interactions. As…

In industrial environments, predicting human actions is essential for ensuring safe and effective collaboration between humans and robots. This paper introduces a perception framework that enables mobile robots to understand and share…

Robotics · Computer Science 2025-01-09 Ali Imran , Giovanni Beltrame , David St-Onge

Abstract semantic 3D scene understanding is a problem of critical importance in robotics. As robots still lack the common-sense knowledge about household objects and locations of an average human, we investigate the use of pre-trained…

Robotics · Computer Science 2023-11-09 William Chen , Siyi Hu , Rajat Talak , Luca Carlone

3D scene graphs have recently emerged as a powerful high-level representation of 3D environments. A 3D scene graph describes the environment as a layered graph where nodes represent spatial concepts at multiple levels of abstraction and…

Robotics · Computer Science 2022-06-22 Nathan Hughes , Yun Chang , Luca Carlone

When working around other agents such as humans, it is important to model their perception capabilities to predict and make sense of their behavior. In this work, we consider agents whose perception capabilities are determined by their…

Robotics · Computer Science 2025-08-12 Maulik Bhatt , HongHao Zhen , Monroe Kennedy , Negar Mehr

This work tackles scene understanding for outdoor robotic navigation, solely relying on images captured by an on-board camera. Conventional visual scene understanding interprets the environment based on specific descriptive categories.…

Robotics · Computer Science 2022-02-07 Galadrielle Humblot-Renaux , Letizia Marchegiani , Thomas B. Moeslund , Rikke Gade

Object finding in clutter is a skill that requires perception of the environment and in many cases physical interaction. In robotics, interactive perception defines a set of algorithms that leverage actions to improve the perception of the…

Robotics · Computer Science 2020-06-02 Tonci Novkovic , Remi Pautrat , Fadri Furrer , Michel Breyer , Roland Siegwart , Juan Nieto

Proximity perception is a technology that has the potential to play an essential role in the future of robotics. It can fulfill the promise of safe, robust, and autonomous systems in industry and everyday life, alongside humans, as well as…

Two regimes permitting safe physical human-robot interaction, speed and separation monitoring and safety-rated monitored stop, depend on reliable perception of the space surrounding the robot. This can be accomplished by visual sensors…

Robotics · Computer Science 2023-12-21 Jakub Rozlivek , Petr Svarny , Matej Hoffmann

Autonomous mobile robots need to perceive the environments with their onboard sensors (e.g., LiDARs and RGB cameras) and then make appropriate navigation decisions. In order to navigate human-inhabited public spaces, such a navigation task…

Robotics · Computer Science 2023-09-25 Bhabaranjan Panigrahi , Amir Hossain Raj , Mohammad Nazeri , Xuesu Xiao

Perspective-taking is the ability to perceive or understand a situation or concept from another individual's point of view, and is crucial in daily human interactions. Enabling robots to perform perspective-taking remains an unsolved…

Artificial Intelligence · Computer Science 2023-08-15 Kaiqi Chen , Jing Yu Lim , Kingsley Kuan , Harold Soh

In the past decade, using Street View images and machine learning to measure human perception has become a mainstream research approach in urban science. However, this approach using only image-shallow information makes it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Haoran Ma , Dongdong Wu

Robots are increasingly being used in dynamic environments like workplaces, hospitals, and homes. As a result, interactions with robots must be simple and intuitive, with robots perception adapting efficiently to human-induced changes. This…

Robotics · Computer Science 2024-11-25 Simone Colombani , Luca Brini , Dimitri Ognibene , Giuseppe Boccignone

For a robot to act intelligently, it needs to sense the world around it. Increasingly, robots build an internal representation of the world from sensor readings. This representation can then be used to inform downstream tasks, such as…

Robotics · Computer Science 2023-01-27 Carter Sifferman