English
Related papers

Related papers: TriFusion-AE: Language-Guided Depth and LiDAR Fusi…

200 papers

Sparse autoencoders (SAEs) offer a natural path toward comparable explanations across different representation spaces. However, current SAEs are trained per modality, producing dictionaries whose features are not directly understandable and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Difei Gu , Yunhe Gao , Gerasimos Chatzoudis , Zihan Dong , Guoning Zhang , Bangwei Guo , Yang Zhou , Mu Zhou , Dimitris Metaxas

Multi-modal 3D object detection is important for reliable perception in robotics and autonomous driving. However, its effectiveness remains limited under adverse weather conditions due to weather-induced distortions and misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Zhijian He , Feifei Liu , Yuwei Li , Zhanpeng Luo , Jintao Cheng , Xieyuanli Chen , Xiaoyu Tang

Integrated sensing and communications is a key enabler for the 6G wireless communication systems. The multiple sensing modalities will allow the base station to have a more accurate representation of the environment, leading to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Mohammad Farzanullah , Han Zhang , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

Multi-modal methods based on camera and LiDAR sensors have garnered significant attention in the field of 3D detection. However, many prevalent works focus on single or partial stage fusion, leading to insufficient feature extraction and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Zhiwei Ning , Zhaojiang Liu , Xuanang Gao , Yifan Zuo , Jie Yang , Yuming Fang , Wei Liu

Autonomous driving sensors generate an enormous amount of data. In this paper, we explore learned multimodal compression for autonomous driving, specifically targeted at 3D object detection. We focus on camera and LiDAR modalities and…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Hadi Hadizadeh , Ivan V. Bajić

Recent works on multi-modal emotion recognition move towards end-to-end models, which can extract the task-specific features supervised by the target task compared with the two-phase pipeline. However, previous methods only model the…

Computation and Language · Computer Science 2022-09-21 Yang Wu , Pai Peng , Zhenyu Zhang , Yanyan Zhao , Bing Qin

LiDAR point clouds have become the most common data source in autonomous driving. However, due to the sparsity of point clouds, accurate and reliable detection cannot be achieved in specific scenarios. Because of their complementarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Leichao Cui , Xiuxian Li , Min Meng , Xiaoyu Mo

LiDAR and camera are two critical sensors for multi-modal 3D semantic segmentation and are supposed to be fused efficiently and robustly to promise safety in various real-world scenarios. However, existing multi-modal methods face two key…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Feng Jiang , Chaoping Tu , Gang Zhang , Jun Li , Hanqing Huang , Junyu Lin , Di Feng , Jian Pu

With the growing interest in autonomous driving, there is an increasing demand for accurate and reliable road perception technologies. In complex environments without high-definition map support, autonomous vehicles must independently…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xuewei Tang , Mengmeng Yang , Tuopu Wen , Peijin Jia , Le Cui , Mingshang Luo , Kehua Sheng , Bo Zhang , Diange Yang , Kun Jiang

Registration of multiview point clouds conventionally relies on extensive pairwise matching to build a pose graph for global synchronization, which is computationally expensive and inherently ill-posed without holistic geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Haobo Jiang , Jin Xie , Jian Yang , Liang Yu , Jianmin Zheng

LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel

Audio-visual information fusion enables a performance improvement in speech recognition performed in complex acoustic scenarios, e.g., noisy environments. It is required to explore an effective audio-visual fusion strategy for audiovisual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Liangfa Wei , Jie Zhang , Junfeng Hou , Lirong Dai

Masked autoencoders (MAE) have shown tremendous potential for self-supervised learning (SSL) in vision and beyond. However, point clouds from LiDARs used in automated driving are particularly challenging for MAEs since large areas of the 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Mohamed Abdelsamad , Michael Ulrich , Claudius Gläser , Abhinav Valada

Recently proposed fine-grained 3D visual grounding is an essential and challenging task, whose goal is to identify the 3D object referred by a natural language sentence from other distractive objects of the same category. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Dailan He , Yusheng Zhao , Junyu Luo , Tianrui Hui , Shaofei Huang , Aixi Zhang , Si Liu

Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and 3D point clouds at…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Shaoqing Xu , Dingfu Zhou , Jin Fang , Junbo Yin , Zhou Bin , Liangjun Zhang

We present a systematic investigation of convolutional autoencoders for the reduced-order representation of three-dimensional interfacial multiphase flows. Focusing on the reconstruction of phase indicators, we examine how the choice of…

Computational Engineering, Finance, and Science · Computer Science 2025-12-29 Murray Cutforth , Shahab Mirjalili

Autoencoders are a class of artificial neural networks which have gained a lot of attention in the recent past. Using the encoder block of an autoencoder the input image can be compressed into a meaningful representation. Then a decoder is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Sayan Nag

High-quality point cloud data is a critical foundation for tasks such as autonomous driving and 3D reconstruction. However, LiDAR-based point cloud acquisition is often affected by various disturbances, resulting in a large number of noise…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Ge Zhang , Chunyang Wang , Bin Liu , Guan Xi

Code clone detection (CCD) supports software maintenance, refactoring, and security analysis. Although pre-trained models capture code semantics, most work reduces CCD to binary classification, overlooking the heterogeneity of clone types…

Software Engineering · Computer Science 2026-03-17 Mengdi Li , Yuming Liu , He Wang , Zifeng Xu , Yuqing Zhang

The rise of sixth-generation (6G) wireless networks sets high demands on UAV-assisted Free Space Optical (FSO) communications, where the channel environment becomes more complex and variable due to both atmospheric turbulence and…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Han Zeng , Haibo Wang , Kan Wang , Xutao Yu , Zaichen Zhang