English
Related papers

Related papers: Multi-Frame to Single-Frame: Knowledge Distillatio…

200 papers

In this paper, we focus on exploring the fusion of images and point clouds for 3D object detection in view of the complementary nature of the two modalities, i.e., images possess more semantic information while point clouds specialize in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ming Zhu , Chao Ma , Pan Ji , Xiaokang Yang

Recent advances in 3D object detection (3DOD) have obtained remarkably strong results for LiDAR-based models. In contrast, surround-view 3DOD models based on multiple camera images underperform due to the necessary view transformation of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Marvin Klingner , Shubhankar Borse , Varun Ravi Kumar , Behnaz Rezaei , Venkatraman Narayanan , Senthil Yogamani , Fatih Porikli

Depth estimation and scene segmentation are two important tasks in intelligent transportation systems. A joint modeling of these two tasks will reduce the requirement for both the storage and training efforts. This work explores how the…

Machine Learning · Computer Science 2025-05-16 Tiancong Cheng , Ying Zhang , Yuxuan Liang , Roger Zimmermann , Zhiwen Yu , Bin Guo

Knowledge distillation is an effective approach to learn compact models (students) with the supervision of large and strong models (teachers). As empirically there exists a strong correlation between the performance of teacher and student…

Machine Learning · Computer Science 2022-10-13 Chaofei Wang , Qisen Yang , Rui Huang , Shiji Song , Gao Huang

Smart monitoring using three-dimensional (3D) image sensors has been attracting attention in the context of smart cities. In smart monitoring, object detection from point cloud data acquired by 3D image sensors is implemented for detecting…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Kairi Tokuda , Ryoichi Shinkuma , Takehiro Sato , Eiji Oki

Knowledge distillation learns a lightweight student model that mimics a cumbersome teacher. Existing methods regard the knowledge as the feature of each instance or their relations, which is the instance-level knowledge only from the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Sanli Tang , Zhongyu Zhang , Zhanzhan Cheng , Jing Lu , Yunlu Xu , Yi Niu , Fan He

We present a scalable framework designed to craft efficient lightweight models for video object detection utilizing self-training and knowledge distillation techniques. We scrutinize methodologies for the ideal selection of training images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Dani Manjah , Davide Cacciarelli , Christophe De Vleeschouwer , Benoit Macq

This paper tackles the 3D object detection problem, which is of vital importance for applications such as autonomous driving. Our framework uses a Machine Learning (ML) pipeline on a combination of monocular camera and LiDAR data to detect…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Gustavo A. Salazar-Gomez , Miguel A. Saavedra-Ruiz , Victor A. Romero-Cano

In a real-world setting, object instances from new classes can be continuously encountered by object detectors. When existing object detectors are applied to such scenarios, their performance on old classes deteriorates significantly. A few…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 K J Joseph , Jathushan Rajasegaran , Salman Khan , Fahad Shahbaz Khan , Vineeth N Balasubramanian

In this paper, we propose a framework for predicting frame errors in the collaborative spectrally congested wireless environments of the DARPA Spectrum Collaboration Challenge (SC2) via a recently collected dataset. We employ distributed…

Networking and Internet Architecture · Computer Science 2021-04-14 Ahmed P. Mohamed , Abu Shafin Mohammad Mahdee Jameel , Aly El Gamal

Recent advances in deep learning has lead to rapid developments in the field of image retrieval. However, the best performing architectures incur significant computational cost. Recent approaches tackle this issue using knowledge…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zakaria Laskar , Juho Kannala

In recent years, the field of autonomous driving has witnessed remarkable advancements, driven by the integration of a multitude of sensors, including cameras and LiDAR systems, in different prototypes. However, with the proliferation of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Irene Cortés , Jorge Beltrán , Arturo de la Escalera , Fernando García

LiDAR point clouds are widely used in autonomous driving and consist of large numbers of 3D points captured at high frequency to represent surrounding objects such as vehicles, pedestrians, and traffic signs. While this dense data enables…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Z. Rozsa , Á. Madaras , Q. Wei , X. Lu , M. Golarits , H. Yuan , T. Sziranyi , R. Hamzaoui

This paper addresses the critical challenges of sparsity and occlusion in LiDAR-based 3D object detection. Current methods often rely on supplementary modules or specific architectural designs, potentially limiting their applicability to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Alexander Gambashidze , Aleksandr Dadukin , Maksim Golyadkin , Maria Razzhivina , Ilya Makarov

Object detection in documents is a key step to automate the structural elements identification process in a digital or scanned document through understanding the hierarchical structure and relationships between different elements. Large and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Ayan Banerjee , Sanket Biswas , Josep Lladós , Umapada Pal

3D object detection based on monocular camera data is a key enabler for autonomous driving. The task however, is ill-posed due to lack of depth information in 2D images. Recent deep learning methods show promising results to recover depth…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Fabian Brunhuber , Simon Janssen , Johannes Betz , Markus Lienkamp

Few-shot learning models learn representations with limited human annotations, and such a learning paradigm demonstrates practicability in various tasks, e.g., image classification, object detection, etc. However, few-shot object detection…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Jiangmeng Li , Yanan Zhang , Wenwen Qiang , Lingyu Si , Chengbo Jiao , Xiaohui Hu , Changwen Zheng , Fuchun Sun

Object detection has achieved remarkable accuracy through deep learning, yet these improvements often come with increased computational cost, limiting deployment on resource-constrained devices. Knowledge Distillation (KD) provides an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mahdi Golizadeh , Nassibeh Golizadeh , Mohammad Ali Keyvanrad , Hossein Shirazi

Efficient visual fault detection of freight trains is a critical part of ensuring the safe operation of railways under the restricted hardware environment. Although deep learning-based approaches have excelled in object detection, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Yang Zhang , Huilin Pan , Yang Zhou , Mingying Li , Guodong Sun

Knowledge distillation is the process of transferring the knowledge from a large model to a small model. In this process, the small model learns the generalization ability of the large model and retains the performance close to that of the…

Machine Learning · Computer Science 2021-03-26 Zhenyan Hou , Wenxuan Fan