English
Related papers

Related papers: Fusing Monocular Images and Sparse IMU Signals for…

200 papers

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and texture details.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Kai Zhang , Shuang Xu , Dongdong Chen , Radu Timofte , Luc Van Gool

Unsupervised change detection techniques are generally constrained to two multi-band optical images acquired at different times through sensors sharing the same spatial and spectral resolution. This scenario is suitable for a straight…

Image and Video Processing · Electrical Eng. & Systems 2018-04-10 Vinicius Ferraris , Nicolas Dobigeon , Marie Chabert

For applications such as autonomous driving, self-localization/camera pose estimation and scene parsing are crucial technologies. In this paper, we propose a unified framework to tackle these two problems simultaneously. The uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Peng Wang , Ruigang Yang , Binbin Cao , Wei Xu , Yuanqing Lin

Multispectral image fusion is a computer vision process that is essential to remote sensing. For applications such as dehazing and object detection, there is a need to offer solutions that can perform in real-time on any type of scene.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Nati Ofir , Jean-Christophe Nebel

We present a novel method for monocular hand shape and pose estimation at unprecedented runtime performance of 100fps and at state-of-the-art accuracy. This is enabled by a new learning based architecture designed such that it can make use…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Yuxiao Zhou , Marc Habermann , Weipeng Xu , Ikhsanul Habibie , Christian Theobalt , Feng Xu

Multispectral object detection aims to leverage complementary information from visible (RGB) and infrared (IR) modalities to enable robust performance under diverse environmental conditions. Our key insight, derived from wavelet analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Seongmin Hwang , Daeyoung Han , Moongu Jeon

Tracking human full-body motion using sparse wearable inertial measurement units (IMUs) overcomes the limitations of occlusion and instrumentation of the environment inherent in vision-based approaches. However, purely IMU-based tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ying Xue , Jiaxi Jiang , Rayan Armani , Dominik Hollidt , Yi-Chi Liao , Christian Holz

Deploying depth estimation networks in the real world requires high-level robustness against various adverse conditions to ensure safe and reliable autonomy. For this purpose, many autonomous vehicles employ multi-modal sensor systems,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ukcheol Shin , Kyunghyun Lee , Jean Oh

Inertial Measurement Unit (IMU)-based Human Activity Recognition (HAR) aims to interpret and classify user behaviors from temporal motion signals. Recently, deep learning frameworks have advanced this task by learning and extracting…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Peng Liao , Shangsong Liang , Lin Chen , Peijia Zheng

In this paper, we propose a tightly-coupled, multi-modal simultaneous localization and mapping (SLAM) framework, integrating an extensive set of sensors: IMU, cameras, multiple lidars, and Ultra-wideband (UWB) range measurements, hence…

Robotics · Computer Science 2021-10-06 Thien-Minh Nguyen , Shenghai Yuan , Muqing Cao , Thien Hoang Nguyen , Lihua Xie

An adequate fusion of the most significant salient information from multiple input channels is essential for many aerial imaging tasks. While multispectral recordings reveal features in various spectral ranges, synthetic aperture sensing…

Image and Video Processing · Electrical Eng. & Systems 2024-02-15 Mohamed Youssef , Oliver Bimber

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

In this letter, we present a neural field-based real-time monocular mapping framework for accurate and dense Simultaneous Localization and Mapping (SLAM). Recent neural mapping frameworks show promising results, but rely on RGB-D or pose…

Robotics · Computer Science 2023-12-18 Wei Zhang , Tiecheng Sun , Sen Wang , Qing Cheng , Norbert Haala

Image fusion is the process of integrating multiple images of the same scene into a single fused image to reduce uncertainty and minimizing redundancy while extracting all the useful information from the source images. Image fusion process…

Computer Vision and Pattern Recognition · Computer Science 2012-12-04 D. Srinivasa Rao , M. Seetha , M. H. M. Krishna Prasad

In recent years, deep learning has become a very active research tool which is used in many image processing fields. In this paper, we propose an effective image fusion method using a deep learning framework to generate a single image which…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Hui Li , Xiao-Jun Wu , Josef Kittler

Pose estimation purely based on 3D point-cloud could suffer from degradation, e.g. scan blocks or scans in repetitive environments. To deal with this problem, we propose an approach for fusing 3D spinning LiDAR and IMU to estimate the…

Robotics · Computer Science 2017-10-20 Haoyang Ye , Ming Liu

We propose a learning-based method that solves monocular stereo and can be extended to fuse depth information from multiple target frames. Given two unconstrained images from a monocular camera with known intrinsic calibration, our network…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Kaixuan Wang , Shaojie Shen

Typical attempts to improve the capability of visual place recognition techniques include the use of multi-sensor fusion and integration of information over time from image sequences. These approaches can improve performance but have…

Robotics · Computer Science 2019-03-11 Stephen Hausler , Adam Jacobson , Michael Milford

Positional estimation is of great importance in the public safety sector. Emergency responders such as fire fighters, medical rescue teams, and the police will all benefit from a resilient positioning system to deliver safe and effective…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Zhuangzhuang Dai , Muhamad Risqi U. Saputra , Chris Xiaoxuan Lu , Niki Trigoni , Andrew Markham

We introduce MIPS-Fusion, a robust and scalable online RGB-D reconstruction method based on a novel neural implicit representation -- multi-implicit-submap. Different from existing neural RGB-D reconstruction methods lacking either…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yijie Tang , Jiazhao Zhang , Zhinan Yu , He Wang , Kai Xu