English
Related papers

Related papers: LATFormer: Locality-Aware Point-View Fusion Transf…

200 papers

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan

In end-to-end autonomous driving, the utilization of existing sensor fusion techniques and navigational control methods for imitation learning proves inadequate in challenging situations that involve numerous dynamic agents. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Pedram Agand , Mohammad Mahdavian , Manolis Savva , Mo Chen

Most previous 3D object detection methods that leverage the multi-modality of LiDAR and cameras utilize the Bird's Eye View (BEV) space for intermediate feature representation. However, this space uses a low x, y-resolution and sacrifices…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hyeongseok Son , Jia He , Seung-In Park , Ying Min , Yunhao Zhang , ByungIn Yoo

3D object detection with point clouds and images plays an important role in perception tasks such as autonomous driving. Current methods show great performance on detection and pose estimation of standard-shaped vehicles but lack behind on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Benjamin Sick , Michael Walter , Jochen Abhau

Recently, deep learning-based tooth segmentation methods have been limited by the expensive and time-consuming processes of data collection and labeling. Achieving high-precision segmentation with limited datasets is critical. A viable…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Yuan Li , Huan Liu , Yubo Tao , Xiangyang He , Haifeng Li , Xiaohu Guo , Hai Lin

3D object detection is an important task that has been widely applied in autonomous driving. To perform this task, a new trend is to fuse multi-modal inputs, i.e., LiDAR and camera. Under such a trend, recent methods fuse these two…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yang Song , Lin Wang

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Existing multi-modal 3D detection models usually involve customized designs depending on the sensor combinations or setups. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Xuanyao Chen , Tianyuan Zhang , Yue Wang , Yilun Wang , Hang Zhao

Recent work on 3D object detection advocates point cloud voxelization in birds-eye view, where objects preserve their physical dimensions and are naturally separable. When represented in this view, however, point clouds are sparse and have…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Yin Zhou , Pei Sun , Yu Zhang , Dragomir Anguelov , Jiyang Gao , Tom Ouyang , James Guo , Jiquan Ngiam , Vijay Vasudevan

3D pedestrian detection is a challenging task in automated driving because pedestrians are relatively small, frequently occluded and easily confused with narrow vertical objects. LiDAR and camera are two commonly used sensor modalities for…

Robotics · Computer Science 2021-03-30 Juncong Fei , Wenbo Chen , Philipp Heidenreich , Sascha Wirges , Christoph Stiller

How should representations from complementary sensors be integrated for autonomous driving? Geometry-based sensor fusion has shown great promise for perception tasks such as object detection and motion forecasting. However, for the actual…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aditya Prakash , Kashyap Chitta , Andreas Geiger

Existing multi-focus image fusion (MFIF) methods often fail to preserve the uncertain transition region and detect small focus areas within large defocused regions accurately. To address this issue, this study proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xilai Li , Xiaosong Li , Haishu Tan , Jinyang Li

Multi-modal systems enhance performance in autonomous driving but face inefficiencies due to indiscriminate processing within each modality. Additionally, the independent feature learning of each modality lacks interaction, which results in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guoliang You , Xiaomeng Chu , Yifan Duan , Xingchen Li , Sha Zhang , Jianmin Ji , Yanyong Zhang

2D+3D facial expression recognition (FER) can effectively cope with illumination changes and pose variations by simultaneously merging 2D texture and more robust 3D depth information. Most deep learning-based approaches employ the simple…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Mingzhe Sui , Hanting Li , Zhaoqing Zhu , Feng Zhao

The research on recognizing the most discriminative regions provides referential information for weakly supervised object localization with only image-level annotations. However, the most discriminative regions usually conceal the other…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Yukun Zhou , Zailiang Chen , Hailan Shen , Qing Liu , Rongchang Zhao , Yixiong Liang

Extensive work has demonstrated the effectiveness of Vision Transformers. The plain Vision Transformer tends to obtain multi-scale features by selecting fixed layers, or the last layer of features aiming to achieve higher performance in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Fangjian Lin , Yizhe Ma , Shengwei Tian

3D object detection serves as the core basis of the perception tasks in autonomous driving. Recent years have seen the rapid progress of multi-modal fusion strategies for more robust and accurate 3D object detection. However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Bingqi Shen , Shuwei Dai , Yuyin Chen , Rong Xiong , Yue Wang , Yanmei Jiao

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

Existing LiDAR-based 3D object detectors typically rely on manually annotated labels for training to achieve good performance. However, obtaining high-quality 3D labels is time-consuming and labor-intensive. To address this issue, recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Mingqian Ji , Jian Yang , Shanshan Zhang

Change detection and irregular object extraction in 3D point clouds is a challenging task that is of high importance not only for autonomous navigation but also for updating existing digital twin models of various industrial environments.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Nikolaos Stathoulopoulos , Anton Koval , George Nikolakopoulos

Multispectral (MS) and panchromatic (PAN) images describe the same land surface, so these images not only have their own advantages, but also have a lot of similar information. In order to separate these similar information and their…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Wenping Ma , Boyou Xue , Mengru Ma , Chuang Chen , Hekai Zhang , Hao Zhu