English
Related papers

Related papers: Cross-Modality Knowledge Distillation Network for …

200 papers

Accurate 3D object detection is crucial to autonomous driving. Though LiDAR-based detectors have achieved impressive performance, the high cost of LiDAR sensors precludes their widespread adoption in affordable vehicles. Camera-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Yurong You , Cheng Perng Phoo , Carlos Andres Diaz-Ruiz , Katie Z Luo , Wei-Lun Chao , Mark Campbell , Bharath Hariharan , Kilian Q Weinberger

Monocular 3D object detection is a key problem for autonomous vehicles, as it provides a solution with simple configuration compared to typical multi-sensor systems. The main challenge in monocular 3D detection lies in accurately predicting…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Cody Reading , Ali Harakeh , Julia Chae , Steven L. Waslander

Facial Landmark Detection (FLD) in thermal imagery is critical for applications in challenging lighting conditions, but it is hampered by the lack of rich visual cues. Conventional cross-modal solutions, like feature fusion or image…

Machine Learning · Computer Science 2025-10-27 Qiyi Tong , Olivia Nocentini , Marta Lagomarsino , Kuanqi Cai , Marta Lorenzini , Arash Ajoudani

Cross-modal contrastive distillation has recently been explored for learning effective 3D representations. However, existing methods focus primarily on modality-shared features, neglecting the modality-specific features during the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yifan Zhang , Junhui Hou

Compact models can be effectively trained through Knowledge Distillation (KD), a technique that transfers knowledge from larger, high-performing teacher models. Two key challenges in Knowledge Distillation (KD) are: 1) balancing learning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zeeshan Hayder , Ali Cheraghian , Lars Petersson , Mehrtash Harandi

Monocular 3D object detection is one of the most challenging tasks in 3D scene understanding. Due to the ill-posed nature of monocular imagery, existing monocular 3D detection methods highly rely on training with the manually annotated 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Liang Peng , Senbo Yan , Boxi Wu , Zheng Yang , Xiaofei He , Deng Cai

Monocular 3D scene understanding tasks, such as object size estimation, heading angle estimation and 3D localization, is challenging. Successful modern day methods for 3D scene understanding require the use of a 3D sensor. On the other…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xinshuo Weng , Kris Kitani

The teacher-free online Knowledge Distillation (KD) aims to train an ensemble of multiple student models collaboratively and distill knowledge from each other. Although existing online KD methods achieve desirable performance, they often…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Chuanguang Yang , Zhulin An , Helong Zhou , Fuzhen Zhuang , Yongjun Xu , Qian Zhan

Crossmodal knowledge distillation (KD) aims to enhance a unimodal student using a multimodal teacher model. In particular, when the teacher's modalities include the student's, additional complementary information can be exploited to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Chenqi Guo , Mengshuo Rong , Qianli Feng , Rongfan Feng , Yinglong Ma

Recent advancements in multi-modal pre-training for 3D point clouds have demonstrated promising results by aligning heterogeneous features across 3D shapes and their corresponding 2D images and language descriptions. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Huiqun Wang , Yiping Bao , Panwang Pan , Zeming Li , Xiao Liu , Ruijie Yang , Di Huang

Single-domain generalization is essential for object detection, particularly when training models on a single source domain and evaluating them on unseen target domains. Domain shifts, such as changes in weather, lighting, or scene…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Junseok Lee , Sungho Shin , Seongju Lee , Kyoobin Lee

Accurate 3D object detection is vital for automated driving. While lidar sensors are well suited for this task, they are expensive and have limitations in adverse weather conditions. 3+1D imaging radar sensors offer a cost-effective, robust…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Patrick Palmer , Martin Krüger , Stefan Schütte , Richard Altendorfer , Ganesh Adam , Torsten Bertram

In practical applications of human pose estimation, low-resolution inputs frequently occur, and existing state-of-the-art models perform poorly with low-resolution images. This work focuses on boosting the performance of low-resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Zejun Gu , Zhong-Qiu Zhao , Henghui Ding , Hao Shen , Zhao Zhang , De-Shuang Huang

Developing accurate and efficient detectors for drone imagery is challenging due to the inherent complexity of aerial scenes. While some existing methods aim to achieve high accuracy by utilizing larger models, their computational cost is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Bowei Du , Zhixuan Liao , Yanan Zhang , Zhi Cai , Jiaxin Chen , Di Huang

Improving the performance of semantic segmentation models using multispectral information is crucial, especially for environments with low-light and adverse conditions. Multi-modal fusion techniques pursue either the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Aniruddh Sikdar , Jayant Teotia , Suresh Sundaram

Multi-modal RGB and Depth (RGBD) data are predominant in many domains such as robotics, autonomous driving and remote sensing. The combination of these multi-modal data enhances environmental perception by providing 3D spatial context,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Roger Ferrod , Cássio F. Dantas , Luigi Di Caro , Dino Ienco

Knowledge distillation (KD) has traditionally relied on a static teacher-student framework, where a large, well-trained teacher transfers knowledge to a single student model. However, these approaches often suffer from knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Md. Abdur Rahman , Mohaimenul Azam Khan Raiaan , Sami Azam , Asif Karim , Jemima Beissbarth , Amanda Leach

Recently, the performance of monocular depth estimation (MDE) has been significantly boosted with the integration of transformer models. However, the transformer models are usually computationally-expensive, and their effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Zhimeng Zheng , Tao Huang , Gongsheng Li , Zuyi Wang

Monocular 3D object detection is very challenging in autonomous driving due to the lack of depth information. This paper proposes a one-stage monocular 3D object detection algorithm based on multi-scale depth stratification, which uses the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Zhouzhen Xie , Yuying Song , Jingxuan Wu , Zecheng Li , Chunyi Song , Zhiwei Xu

Autonomous systems have advanced significantly, but challenges persist in accident-prone environments where robust decision-making is crucial. A single vehicle's limited sensor range and obstructed views increase the likelihood of…

Artificial Intelligence · Computer Science 2025-09-24 Rui Liu , Zikang Wang , Peng Gao , Yu Shen , Pratap Tokekar , Ming Lin