English
Related papers

Related papers: Audio-Visual Self-Supervised Terrain Type Discover…

200 papers

Identifying the physical properties of the surrounding environment is essential for robotic locomotion and navigation to deal with non-geometric hazards, such as slippery and deformable terrains. It would be of great benefit for robots to…

Robotics · Computer Science 2024-08-30 Jiaqi Chen , Jonas Frey , Ruyi Zhou , Takahiro Miki , Georg Martius , Marco Hutter

Humans are able to localize objects in the environment using both visual and auditory cues, integrating information from multiple modalities into a common reference frame. We introduce a system that can leverage unlabeled audio-visual data…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Chuang Gan , Hang Zhao , Peihao Chen , David Cox , Antonio Torralba

Accurate soil mapping is critical for a highly-automated agricultural vehicle to successfully accomplish important tasks including seeding, ploughing, fertilising and controlled traffic, with limited human supervision, ensuring at the same…

Robotics · Computer Science 2021-04-13 Annalisa Milella , Giulio Reina , Michael Nielsen

Neural networks for multi-domain learning empowers an effective combination of information from different domains by sharing and co-learning the parameters. In visual tracking, the emerging features in shared layers of a multi-domain…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Kourosh Meshgi , Maryam Sadat Mirzaei

Legged robots are popular candidates for missions in challenging terrains due to the wide variety of locomotion strategies they can employ. Terrain classification is a key enabling technology for autonomous legged robots, as it allows the…

Robotics · Computer Science 2020-11-25 Ahmadreza Ahmadi , Tønnes Nygaard , Navinda Kottege , David Howard , Nicolas Hudson

Visual localization is the task of estimating camera pose in a known scene, which is an essential problem in robotics and computer vision. However, long-term visual localization is still a challenge due to the environmental appearance…

Robotics · Computer Science 2022-12-02 Yuxuan Chen , Timothy D. Barfoot

Autonomous robots frequently need to detect "interesting" scenes to decide on further exploration, or to decide which data to share for cooperation. These scenarios often require fast deployment with little or no training data. Prior work…

Robotics · Computer Science 2021-12-21 Chen Wang , Yuheng Qiu , Wenshan Wang , Yafei Hu , Seungchan Kim , Sebastian Scherer

Visual place recognition is a key to unlocking spatial navigation for animals, humans and robots. While state-of-the-art approaches are trained in a supervised manner and therefore hardly capture the information needed for generalizing to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Mohamed Adel Musallam , Vincent Gaudillière , Djamila Aouada

Estimating terrain traversability in off-road environments requires reasoning about complex interaction dynamics between the robot and these terrains. However, it is challenging to create informative labels to learn a model in a supervised…

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

Mobile robots should be capable of planning cost-efficient paths for autonomous navigation. Typically, the terrain and robot properties are subject to variations. For instance, properties of the terrain such as friction may vary across…

Robotics · Computer Science 2024-09-19 Jan Achterhold , Suresh Guttikonda , Jens U. Kreber , Haolong Li , Joerg Stueckler

In a developmental framework, autonomous robots need to explore the world and learn how to interact with it. Without an a priori model of the system, this opens the challenging problem of having robots master their interface with the world:…

Robotics · Computer Science 2016-08-04 Alban Laflaquière

Vision-based road detection is an essential functionality for supporting advanced driver assistance systems (ADAS) such as road following and vehicle and pedestrian detection. The major challenges of road detection are dealing with shadows…

Computer Vision and Pattern Recognition · Computer Science 2014-12-11 José M. Álvarez , Ferran Diego , Joan Serrat , Antonio M. López

Robust and accurate ball detection is a critical component for autonomous humanoid soccer robots, particularly in dynamic and challenging environments such as RoboCup outdoor fields. However, traditional supervised approaches require…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Can Lin , Daniele Affinita , Marco E. P. Zimmatore , Daniele Nardi , Domenico D. Bloisi , Vincenzo Suriani

In this study, we address the problem of supervised change detection for robotic map learning applications, in which the aim is to train a place-specific change classifier (e.g., support vector machine (SVM)) to predict changes from a…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Fei Xiaoxiao , Tanaka Kanji

Detecting sound source objects within visual observation is important for autonomous robots to comprehend surrounding environments. Since sounding objects have a large variety with different appearances in our living environments, labeling…

Sound · Computer Science 2020-07-29 Yoshiki Masuyama , Yoshiaki Bando , Kohei Yatabe , Yoko Sasaki , Masaki Onishi , Yasuhiro Oikawa

Terrain-aware perception holds the potential to improve the robustness and accuracy of autonomous robot navigation in the wilds, thereby facilitating effective off-road traversals. However, the lack of multi-modal perception across various…

Robotics · Computer Science 2024-03-26 Chen Yao , Yangtao Ge , Guowei Shi , Zirui Wang , Ningbo Yang , Zheng Zhu , Hexiang Wei , Yuntian Zhao , Jing Wu , Zhenzhong Jia

We introduce a state-of-the-art audio-visual on-screen sound separation system which is capable of learning to separate sounds and associate them with on-screen objects by looking at in-the-wild videos. We identify limitations of previous…

Sound · Computer Science 2021-10-15 Efthymios Tzinis , Scott Wisdom , Tal Remez , John R. Hershey

Effective use of camera-based vision systems is essential for robust performance in autonomous off-road driving, particularly in the high-speed regime. Despite success in structured, on-road settings, current end-to-end approaches for scene…

Advances in precision agriculture greatly rely on innovative control and sensing technologies that allow service units to increase their level of driving automation while ensuring at the same time high safety standards. This paper deals…

Robotics · Computer Science 2021-04-14 Giulio Reina , Annalisa Milella , Rocco Galati