English
Related papers

Related papers: Energy-Based Models for Cross-Modal Localization u…

200 papers

Energy-based models (EBMs) are a simple yet powerful framework for generative modeling. They are based on a trainable energy function which defines an associated Gibbs measure, and they can be trained and sampled from via well-established…

Machine Learning · Computer Science 2021-05-06 Carles Domingo-Enrich , Alberto Bietti , Eric Vanden-Eijnden , Joan Bruna

Spatial understanding of the semantics of the surroundings is a key capability needed by autonomous cars to enable safe driving decisions. Recently, purely vision-based solutions have gained increasing research interest. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Christian Witte , Jens Behley , Cyrill Stachniss , Marvin Raaijmakers

In autonomous driving, relying solely on frame-based cameras can lead to inaccuracies caused by factors like long exposure times, high-speed motion, and challenging lighting conditions. To address these issues, we introduce a bio-inspired…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hu Cao , Jiong Liu , Xingzhuo Yan , Rui Song , Yan Xia , Walter Zimmer , Guang Chen , Alois Knoll

Positioning and sensing over wireless networks are imperative for many emerging applications. However, since traditional wireless channel models over-simplify the user equipment (UE) as a point target, they cannot be used for sensing the…

Information Theory · Computer Science 2024-05-14 Ang Chen , Li Chen , Yunfei Chen , Nan Zhao , Changsheng You

Cross-view object geo-localization enables high-precision object localization through cross-view matching, with critical applications in autonomous driving, urban management, and disaster response. However, existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Shuhan Hu , Yiru Li , Yuanyuan Li , Yingying Zhu

Change detection in remote sensing imagery is essential for a variety of applications such as urban planning, disaster management, and climate research. However, existing methods for identifying semantically changed areas overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Maximilian Bernhard , Niklas Strauß , Matthias Schubert

Unmanned vehicles usually rely on Global Positioning System (GPS) and Light Detection and Ranging (LiDAR) sensors to achieve high-precision localization results for navigation purpose. However, this combination with their associated costs…

Robotics · Computer Science 2024-07-15 Jinhao He , Huaiyang Huang , Shuyang Zhang , Jianhao Jiao , Chengju Liu , Ming Liu

Multimodal generative models have recently gained significant attention for their ability to learn representations across various modalities, enhancing joint and cross-generation coherence. However, most existing works use standard Gaussian…

Machine Learning · Computer Science 2024-10-01 Shiyu Yuan , Jiali Cui , Hanao Li , Tian Han

Accurate localization is a critical component of mobile autonomous systems, especially in Global Navigation Satellite Systems (GNSS)-denied environments where traditional methods fail. In such scenarios, environmental sensing is essential…

Robotics · Computer Science 2025-04-23 Dominik Kulmer , Maximilian Leitenstern , Marcel Weinmann , Markus Lienkamp

In ill-posed inverse problems, it is commonly desirable to obtain insight into the full spectrum of plausible solutions, rather than extracting only a single reconstruction. Information about the plausible solutions and their likelihoods is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Omer Yair , Elias Nehme , Tomer Michaeli

We propose a map-aided vehicle localization method for GPS-denied environments. This approach exploits prior knowledge of the road grade map and vehicle on-board sensor measurements to accurately estimate the longitudinal position of the…

Robotics · Computer Science 2018-09-13 Roya Firoozi , Jacopo Guanetti , Roberto Horowitz , Francesco Borrelli

Localization has been a challenging task for autonomous navigation. A loop detection algorithm must overcome environmental changes for the place recognition and re-localization of robots. Therefore, deep learning has been extensively…

Robotics · Computer Science 2023-04-19 Alex Junho Lee , Seungwon Song , Hyungtae Lim , Woojoo Lee , Hyun Myung

The volume of unlabelled Earth observation (EO) data is huge, but many important applications lack labelled training data. However, EO data offers the unique opportunity to pair data from different modalities and sensors automatically based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vishal Nedungadi , Ankit Kariryaa , Stefan Oehmcke , Serge Belongie , Christian Igel , Nico Lang

Energy-Based Models (EBMs) have proven to be a highly effective approach for modelling densities on finite-dimensional spaces. Their ability to incorporate domain-specific choices and constraints into the structure of the model through…

Machine Learning · Computer Science 2023-02-24 Jen Ning Lim , Sebastian Vollmer , Lorenz Wolf , Andrew Duncan

Energy based models (EBMs) are appealing due to their generality and simplicity in likelihood modeling, but have been traditionally difficult to train. We present techniques to scale MCMC based EBM training on continuous neural networks,…

Machine Learning · Computer Science 2020-07-01 Yilun Du , Igor Mordatch

Existing spatial localization techniques for autonomous vehicles mostly use a pre-built 3D-HD map, often constructed using a survey-grade 3D mapping vehicle, which is not only expensive but also laborious. This paper shows that by using an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Shan Wang , Yanhao Zhang , Ankit Vora , Akhil Perincherry , Hongdong Li

Automotive self-localization is an essential task for any automated driving function. This means that the vehicle has to reliably know its position and orientation with an accuracy of a few centimeters and degrees, respectively. This paper…

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

Two core competencies of a mobile robot are to build a map of the environment and to estimate its own pose on the basis of this map and incoming sensor readings. To account for the uncertainties in this process, one typically employs…

Robotics · Computer Science 2019-10-24 Alexander Schaefer , Lukas Luft , Wolfram Burgard

Localization in GNSS-denied and GNSS-degraded environments is a challenge for the safe widespread deployment of autonomous vehicles. Such GNSS-challenged environments require alternative methods for robust localization. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Shounak Sural , Ragunathan Rajkumar