English
Related papers

Related papers: Robust Deep Multi-Modal Sensor Fusion using Fusion…

200 papers

There are increasing concerns about malicious attacks on autonomous vehicles. In particular, inaudible voice command attacks pose a significant threat as voice commands become available in autonomous driving systems. How to empirically…

Cryptography and Security · Computer Science 2023-06-09 Jiwei Guan , Lei Pan , Chen Wang , Shui Yu , Longxiang Gao , Xi Zheng

Multi-view clustering has been applied in many real-world applications where original data often contain noises. Some graph-based multi-view clustering methods have been proposed to try to reduce the negative influence of noises. However,…

Machine Learning · Computer Science 2026-05-26 Xiang Fang , Yuchong Hu

Features from multiple scales can greatly benefit the semantic edge detection task if they are well fused. However, the prevalent semantic edge detection methods apply a fixed weight fusion strategy where images with different semantics are…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Yuan Hu , Yunpeng Chen , Xiang Li , Jiashi Feng

One critical challenge in 6D object pose estimation from a single RGBD image is efficient integration of two different modalities, i.e., color and depth. In this work, we tackle this problem by a novel Deep Fusion Transformer~(DFTr) block…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Jun Zhou , Kai Chen , Linlin Xu , Qi Dou , Jing Qin

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

The performance of Federated learning (FL) is negatively affected by device differences and statistical characteristics between participating clients. To address this issue, we introduce a deep unfolding network (DUN)-based technique that…

Machine Learning · Computer Science 2023-07-03 Shanika I Nanayakkara , Shiva Raj Pokhrel , Gang Li

Long-tailed distributions in class-imbalanced data present a fundamental challenge for deep learning models, which tend to be biased toward majority classes. While recent methods for long-tailed recognition have mitigated this issue, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Heegeon Yoon , Heeyoung Kim

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Soft robots are typically approximated as low-dimensional systems, especially when learning-based methods are used. This leads to models that are limited in their capability to predict the large number of deformation modes and interactions…

Robotics · Computer Science 2022-05-10 Thomas George Thuruthel , Fumiya Iida

Intelligent transportation systems (ITS) localization is of significant importance as it provides fundamental position and orientation for autonomous operations like intelligent vehicles. Integrating diverse and complementary sensors such…

Robotics · Computer Science 2024-09-20 Wei Liu , Jiaqi Zhu , Guirong Zhuo , Wufei Fu , Zonglin Meng , Yishi Lu , Min Hua , Feng Qiao , You Li , Yi He , Lu Xiong

Object detection in camera images, using deep learning has been proven successfully in recent years. Rising detection rates and computationally efficient network structures are pushing this technique towards application in production…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Maximilian Geisslinger , Markus Weber , Johannes Betz , Markus Lienkamp

Noise has always been nonnegligible trouble in object detection by creating confusion in model reasoning, thereby reducing the informativeness of the data. It can lead to inaccurate recognition due to the shift in the observed pattern, that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Xinyu Zhang , Zhiwei Li , Zhenhong Zou , Xin Gao , Yijin Xiong , Dafeng Jin , Jun Li , Huaping Liu

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

Multi-modal salient object detection (MSOD) aims to boost saliency detection performance by integrating visible sources with depth or thermal infrared ones. Existing methods generally design different fusion schemes to handle certain issues…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Kunpeng Wang , Zhengzheng Tu , Chenglong Li , Cheng Zhang , Bin Luo

Multi-Sensor Fusion (MSF) based perception systems have been the foundation in supporting many industrial applications and domains, such as self-driving cars, robotic arms, and unmanned aerial vehicles. Over the past few years, the fast…

Software Engineering · Computer Science 2023-08-30 Xinyu Gao , Zhijie Wang , Yang Feng , Lei Ma , Zhenyu Chen , Baowen Xu

In recent years, deep learning models have demonstrated remarkable success in various domains, such as computer vision, natural language processing, and speech recognition. However, the generalization capabilities of these models can be…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Neelesh Mungoli

Multi-modal 3D object detectors are dedicated to exploring secure and reliable perception systems for autonomous driving (AD).Although achieving state-of-the-art (SOTA) performance on clean benchmark datasets, they tend to overlook the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ziying Song , Guoxing Zhang , Lin Liu , Lei Yang , Shaoqing Xu , Caiyan Jia , Feiyang Jia , Li Wang

Autonomous systems and smart-industry deployments increasingly split computation across near-sensor, edge, and cloud resources, where tight energy, latency, and reliability budgets demand run-time adaptivity. In practice, deciding what to…

Machine Learning · Computer Science 2026-05-25 Sanggeon Yun , Ryozo Masukawa , Minhyoung Na , Hyunwoo Oh , Yoshiki Yamaguchi , Wenjun Huang , SungHeon Jeong , Mohsen Imani

Combining multiple sensors enables a robot to maximize its perceptual awareness of environments and enhance its robustness to external disturbance, crucial to robotic navigation. This paper proposes the FusionPortable benchmark, a complete…

The problem of information fusion from multiple data-sets acquired by multimodal sensors has drawn significant research attention over the years. In this paper, we focus on a particular problem setting consisting of a physical phenomenon or…

Machine Learning · Statistics 2018-11-21 Ori Katz , Ronen Talmon , Yu-Lun Lo , Hau-Tieng Wu