English
Related papers

Related papers: Sensor Fusion by Spatial Encoding for Autonomous D…

200 papers

We tackle a challenging task: multi-view and multi-modal event detection that detects events in a wide-range real environment by utilizing data from distributed cameras and microphones and their weak labels. In this task, distributed…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-21 Masahiro Yasuda , Yasunori Ohishi , Shoichiro Saito , Noboru Harada

Object detection in camera images, using deep learning has been proven successfully in recent years. Rising detection rates and computationally efficient network structures are pushing this technique towards application in production…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Maximilian Geisslinger , Markus Weber , Johannes Betz , Markus Lienkamp

Place recognition is one of the most crucial modules for autonomous vehicles to identify places that were previously visited in GPS-invalid environments. Sensor fusion is considered an effective method to overcome the weaknesses of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zijie Zhou , Jingyi Xu , Guangming Xiong , Junyi Ma

In recent times, there has been a growing focus on end-to-end autonomous driving technologies. This technology involves the replacement of the entire driving pipeline with a single neural network, which has a simpler structure and faster…

Robotics · Computer Science 2023-10-27 Hongkuan Zhou , Aifen Sui , Letian Shi , Yinxian Li

Perception of other road users is a crucial task for intelligent vehicles. Perception systems can use on-board sensors only or be in cooperation with other vehicles or with roadside units. In any case, the performance of perception systems…

Robotics · Computer Science 2023-11-20 Rémy Huet , Antoine Lima , Philippe Xu , Véronique Cherfaoui , Philippe Bonnifait

As more and more internet users post images online to express their daily emotions, image sentiment analysis has attracted increasing attention. Recently, researchers generally tend to design different neural networks to extract visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Bin Feng , Shulan Ruan , Mingzheng Yang , Dongxuan Han , Huijie Liu , Kai Zhang , Qi Liu

Accurate and robust navigation in unstructured environments requires fusing data from multiple sensors. Such fusion ensures that the robot is better aware of its surroundings, including areas of the environment that are not immediately…

Robotics · Computer Science 2024-03-12 Mateus Valverde Gasparino , Arun Narenthiran Sivakumar , Girish Chowdhary

Autonomous Vehicles (AVs) increasingly depend on Multi-Sensor Fusion (MSF) to combine complementary modalities such as cameras and LiDAR for robust perception. While this redundancy is intended to safeguard against single-sensor failures,…

Cryptography and Security · Computer Science 2026-04-24 Shahriar Rahman Khan , Raiful Hasan

Aerial vehicles are no longer limited to flying in open space: recent work has focused on aerial manipulation and up-close inspection. Such applications place stringent requirements on state estimation: the robot must combine state…

Robotics · Computer Science 2023-12-25 Christian Lanegger , Helen Oleynikova , Michael Pantic , Lionel Ott , Roland Siegwart

Semantic segmentation algorithms that can robustly segment objects across multiple camera viewpoints are crucial for assuring navigation and safety in emerging applications such as autonomous driving. Existing algorithms treat each image in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Brigit Schroeder , Hanlin Tang , Alexandre Alahi

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chiho Choi , Joon Hee Choi , Jiachen Li , Srikanth Malla

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chiho Choi , Joon Hee Choi , Srikanth Malla , Jiachen Li

Imaging across both the full transverse spatial and temporal dimensions of a scene with high precision in all three coordinates is key to applications ranging from LIDAR to fluorescence lifetime imaging. However, compromises that sacrifice,…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 C. Callenberg , A. Lyons , D. den Brok , A. Fatima , A. Turpin , V. Zickus , L. Machesky , J. Whitelaw , D. Faccio , M. B. Hullin

Multi-sensor fusion is crucial for improving the performance and robustness of end-to-end autonomous driving systems. Existing methods predominantly adopt either attention-based flatten fusion or bird's eye view fusion through geometric…

Robotics · Computer Science 2025-10-29 Shuai Liu , Quanmin Liang , Zefeng Li , Boyang Li , Kai Huang

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

The aim of multispectral image fusion is to combine object or scene features of images with different spectral characteristics to increase the perceptual quality. In this paper, we present a novel learning-based solution to image fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Ferhat Can Ataman , Gözde Bozdaği Akar

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

In remote sensing, each sensor can provide complementary or reinforcing information. It is valuable to fuse outputs from multiple sensors to boost overall performance. Previous supervised fusion methods often require accurate labels for…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Xiaoxiao Du , Alina Zare

Despite radar's popularity in the automotive industry, for fusion-based 3D object detection, most existing works focus on LiDAR and camera fusion. In this paper, we propose TransCAR, a Transformer-based Camera-And-Radar fusion solution for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Su Pang , Daniel Morris , Hayder Radha

Multi-sensor frameworks provide opportunities for ensemble learning and sensor fusion to make use of redundancy and supplemental information, helpful in real-world safety applications such as continuous driver state monitoring which…

Machine Learning · Computer Science 2023-10-02 Ross Greer , Mohan Trivedi