English
Related papers

Related papers: Early Recall, Late Precision: Multi-Robot Semantic…

200 papers

Existing Simultaneous Localization and Mapping (SLAM) approaches are limited in their scalability due to growing map size in long-term robot operation. Moreover, processing such maps for localization and planning tasks leads to the…

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Thousands of scanned historical topographic maps contain valuable information covering long periods of time, such as how the hydrography of a region has changed over time. Efficiently unlocking the information in these maps requires…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Weiwei Duan , Yao-Yi Chiang , Stefan Leyk , Johannes H. Uhl , Craig A. Knoblock

Grasping unknown objects in unstructured environments is a critical challenge for service robots, which must operate in dynamic, real-world settings such as homes, hospitals, and warehouses. Success in these environments requires both…

Robotics · Computer Science 2026-02-17 Avihai Giuili , Rotem Atari , Avishai Sintov

Autonomous robots can benefit greatly from human-provided semantic characterizations of uncertain task environments and states. However, the development of integrated strategies which let robots model, communicate, and act on such 'soft…

Robotics · Computer Science 2023-09-01 Luke Burks , Hunter M. Ray , Jamison McGinley , Sousheel Vunnam , Nisar Ahmed

Robot autonomy in unknown, GPS-denied, and complex underground environments requires real-time, robust, and accurate onboard pose estimation and mapping for reliable operations. This becomes particularly challenging in perception-degraded…

Conventional navigation pipelines for legged robots remain largely geometry-centric, relying on dense SLAM representations that are fragile under rapid motion and offer limited support for semantic decision making in open-world exploration.…

Robotics · Computer Science 2026-03-09 Guoyang Zhao , Yudong Li , Weiqing Qi , Kai Zhang , Bonan Liu , Kai Chen , Haoang Li , Jun Ma

This paper addresses semantic planning problems in unknown environments under perceptual uncertainty. The environment contains multiple unknown semantically labeled regions or objects, and the robot must reach desired locations while…

Robust and accurate visual-inertial estimation is crucial to many of today's challenges in robotics. Being able to localize against a prior map and obtain accurate and driftfree pose estimates can push the applicability of such systems even…

The availability of real-time semantics greatly improves the core geometric functionality of SLAM systems, enabling numerous robotic and AR/VR applications. We present a new methodology for real-time semantic mapping from RGB-D sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Jingwen Wang , Juan Tarrio , Lourdes Agapito , Pablo F. Alcantarilla , Alexander Vakhitov

Reliable and accurate localization and mapping are key components of most autonomous systems. Besides geometric information about the mapped environment, the semantics plays an important role to enable intelligent navigation behaviors. In…

Recent advances in robotic mobile manipulation have spurred the expansion of the operating environment for robots from constrained workspaces to large-scale, human environments. In order to effectively complete tasks in these spaces, robots…

Robotics · Computer Science 2023-03-27 Cameron Kisailus , Daksh Narang , Matthew Shannon , Odest Chadwicke Jenkins

Object Simultaneous Localization and Mapping (SLAM) systems struggle to correctly associate semantically similar objects in close proximity, especially in cluttered indoor environments and when scenes change. We present Semantic Enhancement…

Robotics · Computer Science 2025-06-18 Jungseok Hong , Ran Choi , John J. Leonard

Humans use spatial language to naturally describe object locations and their relations. Interpreting spatial language not only adds a perceptual modality for robots, but also reduces the barrier of interfacing with humans. Previous work…

Robotics · Computer Science 2021-08-03 Kaiyu Zheng , Deniz Bayazit , Rebecca Mathew , Ellie Pavlick , Stefanie Tellex

Determining multi-robot motion policies for persistently monitoring a region with limited sensing, communication, and localization constraints in non-GPS environments is a challenging problem. To take the localization constraints into…

Robotics · Computer Science 2023-05-16 Manav Mishra , Prithvi Poddar , Rajat Agarwal , Jingxi Chen , Pratap Tokekar , P. B. Sujit

Understanding object affordances is essential for enabling robots to perform purposeful and fine-grained interactions in diverse and unstructured environments. However, existing approaches either rely on retrieval, which is fragile due to…

Robotics · Computer Science 2026-04-01 Qiyuan Zhuang , He-Yang Xu , Yijun Wang , Xin-Yang Zhao , Yang-Yang Li , Xiu-Shen Wei

This paper presents the first active object mapping framework for complex robotic manipulation and autonomous perception tasks. The framework is built on an object SLAM system integrated with a simultaneous multi-object pose estimation…

Robotics · Computer Science 2022-01-11 Yanmin Wu , Yunzhou Zhang , Delong Zhu , Xin Chen , Sonya Coleman , Wenkai Sun , Xinggang Hu , Zhiqiang Deng

Many language-guided robotic systems rely on collapsing spatial reasoning into discrete points, making them brittle to perceptual noise and semantic ambiguity. To address this challenge, we propose RoboMAP, a framework that represents…

Robotics · Computer Science 2025-10-16 Xinyu Shao , Yanzhe Tang , Pengwei Xie , Kaiwen Zhou , Yuzheng Zhuang , Xingyue Quan , Jianye Hao , Long Zeng , Xiu Li

Retrieving relevant imagery from vast satellite archives is crucial for applications like disaster response and long-term climate monitoring. However, most text-to-image retrieval systems are limited to RGB data, failing to exploit the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Daniele Rege Cambrin , Lorenzo Vaiani , Giuseppe Gallipoli , Luca Cagliero , Paolo Garza

This article presents a 3D point cloud map-merging framework for egocentric heterogeneous multi-robot exploration, based on overlap detection and alignment, that is independent of a manual initial guess or prior knowledge of the robots'…