English
Related papers

Related papers: A Multimodal Fusion Framework for Bridge Defect De…

200 papers

Depth prediction is a critical problem in robotics applications especially autonomous driving. Generally, depth prediction based on binocular stereo matching and fusion of monocular image and laser point cloud are two mainstream methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Guancheng Chen , Junli Lin , Huabiao Qin

The fusion of multimodal sensor streams, such as camera, lidar, and radar measurements, plays a critical role in object detection for autonomous vehicles, which base their decision making on these inputs. While existing methods exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Mario Bijelic , Tobias Gruber , Fahim Mannan , Florian Kraus , Werner Ritter , Klaus Dietmayer , Felix Heide

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

Blind image quality assessment (BIQA) methods often incorporate auxiliary tasks to improve performance. However, existing approaches face limitations due to insufficient integration and a lack of flexible uncertainty estimation, leading to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yiwei Lou , Yuanpeng He , Rongchao Zhang , Yongzhi Cao , Hanpin Wang , Yu Huang

Multimodal survival prediction, a crucial yet challenging task, demands the integration of multimodal medical data (\eg Whole Slide Images (WSIs) and Genomic Profiles) to achieve accurate prognostic modeling. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Huayi Wang , Haochao Ying , Yuyang Xu , Qiyao Zheng , jun wang , Cheng Zhang , Ying Sun , Jian Wu

Cross-modality fusing complementary information from different modalities effectively improves object detection performance, making it more useful and robust for a wider range of applications. Existing fusion strategies combine different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Wenhao Dong , Haodong Zhu , Shaohui Lin , Xiaoyan Luo , Yunhang Shen , Xuhui Liu , Juan Zhang , Guodong Guo , Baochang Zhang

The threat to safety of aging bridges has been recognized as a critical concern to the general public due to the poor condition of many bridges in the U.S. Currently, the bridge inspection is conducted manually, and it is not efficient to…

Robotics · Computer Science 2017-04-26 Hung M. La , Nenad Gucunski , Kristin Dana , Seong-Hoon Kee

Visible-infrared object detection has gained sufficient attention due to its detection performance in low light, fog, and rain conditions. However, visible and infrared modalities captured by different sensors exist the information…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Wencong Wu , Xiuwei Zhang , Hanlin Yin , Shun Dai , Hongxi Zhang , Yanning Zhang

Ultrasound imaging is widely used in noninvasive medical diagnostics due to its efficiency, portability, and avoidance of ionizing radiation. However, its utility is limited by the quality of the signal. Signal-dependent speckle noise,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Soumee Guha , Scott T. Acton

Although multimodal fusion has made significant progress, its advancement is severely hindered by the lack of adequate evaluation benchmarks. Current fusion methods are typically evaluated on a small selection of public datasets, a limited…

Machine Learning · Computer Science 2026-05-07 Leyan Xue , Changqing Zhang , Kecheng Xue , Xiaohong Liu , Guangyu Wang , Zongbo Han

Information fusion is used widely to improve document classification by the integration of multiple data sources (multimodal) or representations (multiview). However, the field lacks a unified framework, a quantitative synthesis of its…

Computation and Language · Computer Science 2026-05-27 Marcin Michał Mirończuk

Breast cancer is a leading cause of cancer-related mortality worldwide, and timely accurate diagnosis is critical to improving survival outcomes. While convolutional neural networks (CNNs) have demonstrated strong performance on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Aditya Shribhagwan Khandelwal , Mohammad Samar Ansari , Asra Aslam

Accurate beam prediction is essential for maintaining reliable links and high spectral efficiency in dynamic low-altitude wireless networks. However, existing approaches often fail to capture the deep correlations across heterogeneous…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Xiaotong Zhao , Yuanhao Cui , Weijie Yuan , Ziye Jia , Heng Liu , Chengwen Xing

Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and 3D point clouds at…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Shaoqing Xu , Dingfu Zhou , Jin Fang , Junbo Yin , Zhou Bin , Liangjun Zhang

Structural crack detection is a critical task for public safety as it helps in preventing potential structural failures that could endanger lives. Manual detection by inexperienced personnel can be slow, inconsistent, and prone to human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Subhasis Dasgupta , Jaydip Sen , Tuhina Halder

Multi-task dense prediction aims at handling multiple pixel-wise prediction tasks within a unified network simultaneously for visual scene understanding. However, cross-task feature interactions of current methods are still suffering from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jingdong Zhang , Jiayuan Fan , Peng Ye , Bo Zhang , Hancheng Ye , Baopu Li , Yancheng Cai , Tao Chen

Bi-CamoDiffusion is introduced, an evolution of the CamoDiffusion framework for camouflaged object detection. It integrates edge priors into early-stage embeddings via a parameter-free injection process, which enhances boundary sharpness…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Patricia L. Suarez , Leo Thomas Ramos , Angel D. Sappa

Reliable UAV object detection requires robustness to illumination changes, motion blur, and scene dynamics that suppress RGB cues. Thermal long-wave infrared (LWIR) sensing preserves contrast in low light, and event cameras retain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Craig Iaboni , Pramod Abichandani

Velocity measurements made from multiple-epoch astronomical images of evolving objects with optically thin continuum emission (e.g. as relativistic jets or expanding supernova shells) may be confused as a result of the overlap of…

High Energy Astrophysical Phenomena · Physics 2016-02-17 F. Mertens , A. P. Lobanov

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang