English
Related papers

Related papers: Robust Visual Embodiment: How Robots Discover Thei…

200 papers

This work proposes a fast deployment pipeline for visually-servoed robots which does not assume anything about either the robot - e.g. sizes, colour or the presence of markers - or the deployment environment. In this, accurate estimation of…

Robotics · Computer Science 2023-06-27 Luke Robinson , Daniele De Martini , Matthew Gadd , Paul Newman

We aim to redefine robust ego-motion estimation and photorealistic 3D reconstruction by addressing a critical limitation: the reliance on noise-free data in existing models. While such sanitized conditions simplify evaluation, they fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Xiaohao Xu , Tianyi Zhang , Shibo Zhao , Xiang Li , Sibo Wang , Yongqi Chen , Ye Li , Bhiksha Raj , Matthew Johnson-Roberson , Sebastian Scherer , Xiaonan Huang

We propose Audio Noise Awareness using Visuals of Indoors for NAVIgation for quieter robot path planning. While humans are naturally aware of the noise they make and its impact on those around them, robots currently lack this awareness. A…

Robotics · Computer Science 2024-10-25 Vidhi Jain , Rishi Veerapaneni , Yonatan Bisk

Visual restoration and recognition are traditionally addressed in pipeline fashion, i.e. denoising followed by classification. Instead, observing correlations between the two tasks, for example clearer image will lead to better…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Gang Chen , Yawei Li , Sargur N. Srihari

Service robots should be able to interact naturally with non-expert human users, not only to help them in various tasks but also to receive guidance in order to resolve ambiguities that might be present in the instruction. We consider the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Georgios Tziafas , Hamidreza Kasaei

Over the past few years, deep learning techniques have achieved tremendous success in many visual understanding tasks such as object detection, image segmentation, and caption generation. Despite this thriving in computer vision and natural…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Anh Nguyen

One of the challenges of full autonomy is to have a robot capable of manipulating its current environment to achieve another environment configuration. This paper is a step towards this challenge, focusing on the visual understanding of the…

Robotics · Computer Science 2020-11-24 Guilherme Maeda , Joni Väätäinen , Hironori Yoshida

Humanoid robots without internal sensors such as a compass tend to lose their orientation after a fall. Furthermore, re-initialisation is often ambiguous due to symmetric man-made environments. The room-awareness module proposed here is…

Robotics · Computer Science 2013-04-23 Markus Bader , Johann Prankl , Markus Vincze

Integrating Large Language Models (VLMs) and Vision-Language Models (VLMs) with robotic systems enables robots to process and understand complex natural language instructions and visual information. However, a fundamental challenge remains:…

Robotics · Computer Science 2024-03-18 Yuhang Hu , Yunzhe Wang , Ruibo Liu , Zhou Shen , Hod Lipson

Soft robots achieve functionality through tight coupling among geometry, material composition, and actuation. As a result, effective design optimization requires these three aspects to be considered jointly rather than in isolation. This…

Robotics · Computer Science 2026-03-09 Vittorio Candiello , Manuel Mekkattu , Mike Y. Michelis , Robert K. Katzschmann

Autonomous agents, particularly in the field of robotics, rely on sensory information to perceive and navigate their environment. However, these sensory inputs are often imperfect, leading to distortions in the agent's internal…

Robotics · Computer Science 2025-07-11 David Warutumo , Ciira wa Maina

Vision-based robotics often separates the control loop into one module for perception and a separate module for control. It is possible to train the whole system end-to-end (e.g. with deep RL), but doing it "from scratch" comes with a high…

Robotics · Computer Science 2020-11-16 Bryan Chen , Alexander Sax , Gene Lewis , Iro Armeni , Silvio Savarese , Amir Zamir , Jitendra Malik , Lerrel Pinto

Embodied agents require robust navigation systems to operate in unstructured environments, making the robustness of Simultaneous Localization and Mapping (SLAM) models critical to embodied agent autonomy. While real-world datasets are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Xiaohao Xu , Tianyi Zhang , Sibo Wang , Xiang Li , Yongqi Chen , Ye Li , Bhiksha Raj , Matthew Johnson-Roberson , Xiaonan Huang

Continuum robots possess high flexibility and redundancy, making them well suited for safe interaction in complex environments, yet their continuous deformation and nonlinear dynamics pose fundamental challenges to perception, modeling, and…

Robotics · Computer Science 2026-03-03 Peng Yu , Xin Wang , Ning Tan

Multiple low-vision tasks such as denoising, deblurring and super-resolution depart from RGB images and further reduce the degradations, improving the quality. However, modeling the degradations in the sRGB domain is complicated because of…

Image and Video Processing · Electrical Eng. & Systems 2024-09-30 Marcos V. Conde , Florin Vasluianu , Radu Timofte

Robust localization in a given map is a crucial component of most autonomous robots. In this paper, we address the problem of localizing in an indoor environment that changes and where prominent structures have no correspondence in the map…

Robotic grasping is a fundamental capability for autonomous manipulation, yet remains highly challenging in cluttered environments where occlusion, poor perception quality, and inconsistent 3D reconstructions often lead to unstable or…

Robotics · Computer Science 2025-11-07 Shenglin Wang , Mingtong Dai , Jingxuan Su , Lingbo Liu , Chunjie Chen , Xinyu Wu , Liang Lin

Autonomous driving perception systems are particularly vulnerable in foggy conditions, where light scattering reduces contrast and obscures fine details critical for safe operation. While numerous defogging methods exist, from handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Ardalan Aryashad , Parsa Razmara , Amin Mahjoub , Seyedarmin Azizi , Mahdi Salmani , Arad Firouzkouhi

Visual Place Recognition (VPR) in mobile robotics enables robots to localize themselves by recognizing previously visited locations using visual data. While the reliability of VPR methods has been extensively studied under conditions such…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Timur Ismagilov , Bruno Ferrarini , Michael Milford , Tan Viet Tuyen Nguyen , SD Ramchurn , Shoaib Ehsan

Clustering is one of the fundamental problems in unsupervised learning. Recent deep learning based methods focus on learning clustering oriented representations. Among those methods, Variational Deep Embedding achieves great success in…

Machine Learning · Computer Science 2021-03-12 Ruixuan Luo , Wei Li , Zhiyuan Zhang , Ruihan Bao , Keiko Harimoto , Xu Sun