English
Related papers

Related papers: RadarDistill: Boosting Radar-based Object Detectio…

200 papers

Object detection has achieved remarkable accuracy through deep learning, yet these improvements often come with increased computational cost, limiting deployment on resource-constrained devices. Knowledge Distillation (KD) provides an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mahdi Golizadeh , Nassibeh Golizadeh , Mohammad Ali Keyvanrad , Hossein Shirazi

Previous knowledge distillation (KD) methods for object detection mostly focus on feature imitation instead of mimicking the prediction logits due to its inefficiency in distilling the localization information. In this paper, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Zhaohui Zheng , Rongguang Ye , Qibin Hou , Dongwei Ren , Ping Wang , Wangmeng Zuo , Ming-Ming Cheng

In many situations, we need to build and deploy separate models in related environments with different data qualities. For example, an environment with strong observation equipments (e.g., intensive care units) often provides high-quality…

Machine Learning · Computer Science 2019-08-27 Shenda Hong , Cao Xiao , Trong Nghia Hoang , Tengfei Ma , Hongyan Li , Jimeng Sun

Recent improvements in convolutional neural network (CNN)-based single image super-resolution (SISR) methods rely heavily on fabricating network architectures, rather than finding a suitable training algorithm other than simply minimizing…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 SeongUk Park , Nojun Kwak

Despite significant advancements of deep learning-based forgery detectors for distinguishing manipulated deepfake images, most detection approaches suffer from moderate to significant performance degradation with low-quality compressed…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Binh M. Le , Simon S. Woo

Knowledge distillation (KD) is a technique for transferring knowledge from complex teacher models to simpler student models, significantly enhancing model efficiency and accuracy. It has demonstrated substantial advancements in various…

Computation and Language · Computer Science 2025-04-21 Junjie Yang , Junhao Song , Xudong Han , Ziqian Bi , Tianyang Wang , Chia Xin Liang , Xinyuan Song , Yichao Zhang , Qian Niu , Benji Peng , Keyu Chen , Ming Liu

Multimodal 3D object detectors leverage the strengths of both geometry-aware LiDAR point clouds and semantically rich RGB images to enhance detection performance. However, the inherent heterogeneity between these modalities, including…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhuoqun Su , Huimin Lu , Shuaifeng Jiao , Junhao Xiao , Yaonan Wang , Xieyuanli Chen

Recently, CNN-based SISR has numerous parameters and high computational cost to achieve better performance, limiting its applicability to resource-constrained devices such as mobile. As one of the methods to make the network efficient,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 HyeonCheol Moon , JinWoo Jeong , SungJei Kim

Deep learning has shown its efficacy in extracting useful features to solve various computer vision tasks. However, when the structure of the data is complex and noisy, capturing effective information to improve performance is very…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Eun Som Jeon , Rahul Khurana , Aishani Pathak , Pavan Turaga

3D object detection from multiple image views is a fundamental and challenging task for visual scene understanding. Owing to its low cost and high efficiency, multi-view 3D object detection has demonstrated promising application prospects.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinhong Jiang , Feng Zhao

LiDAR and Radar are two complementary sensing approaches in that LiDAR specializes in capturing an object's 3D shape while Radar provides longer detection ranges as well as velocity hints. Though seemingly natural, how to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Yingjie Wang , Jiajun Deng , Yao Li , Jinshui Hu , Cong Liu , Yu Zhang , Jianmin Ji , Wanli Ouyang , Yanyong Zhang

With the exponential increase in image data, training an image restoration model is laborious. Dataset distillation is a potential solution to this problem, yet current distillation techniques are a blank canvas in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhuoran Zheng , Xin Su , Chen Wu , Xiuyi Jia

In the field of 3D object detection for autonomous driving, the sensor portfolio including multi-modality and single-modality is diverse and complex. Since the multi-modal methods have system complexity while the accuracy of single-modal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Shengchao Zhou , Weizhou Liu , Chen Hu , Shuchang Zhou , Chao Ma

Knowledge distillation (KD) has been proven to be useful for training compact object detection models. However, we observe that KD is often effective when the teacher model and student counterpart share similar proposal information. This…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Sheng Xu , Yanjing Li , Bohan Zeng , Teli ma , Baochang Zhang , Xianbin Cao , Peng Gao , Jinhu Lv

Camera-based temporal 3D object detection has shown impressive results in autonomous driving, with offline models improving accuracy by using future frames. Knowledge distillation (KD) can be an appealing framework for transferring rich…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Haowen Zheng , Hu Zhu , Lu Deng , Weihao Gu , Yang Yang , Yanyan Liang

In the surveillance and defense domain, multi-target detection and classification (MTD) is considered essential yet challenging due to heterogeneous inputs from diverse data sources and the computational complexity of algorithms designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ngoc Tuyen Do , Tri Nhu Do

As deep learning continues to advance, self-supervised learning has made considerable strides. It allows 2D image encoders to extract useful features for various downstream tasks, including those related to vision-based systems.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Wonjun Jo , Hyunwoo Ha , Kim Ji-Yeon , Hawook Jeong , Tae-Hyun Oh

Pre-trained on extensive and diverse multi-modal datasets, 2D foundation models excel at addressing 2D tasks with little or no downstream supervision, owing to their robust representations. The emergence of 2D-to-3D distillation frameworks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Anas Mahmoud , Ali Harakeh , Steven Waslander

Diffusion models have been applied to 3D LiDAR scene completion due to their strong training stability and high completion quality. However, the slow sampling speed limits the practical application of diffusion-based scene completion models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Shengyuan Zhang , An Zhao , Ling Yang , Zejian Li , Chenye Meng , Haoran Xu , Tianrun Chen , AnYang Wei , Perry Pengyun GU , Lingyun Sun

Segmenting or detecting objects in sparse Lidar point clouds are two important tasks in autonomous driving to allow a vehicle to act safely in its 3D environment. The best performing methods in 3D semantic segmentation or object detection…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Corentin Sautier , Gilles Puy , Spyros Gidaris , Alexandre Boulch , Andrei Bursuc , Renaud Marlet