English
Related papers

Related papers: Teach YOLO to Remember: A Self-Distillation Approa…

200 papers

Class-Incremental learning (CIL) refers to the ability of artificial agents to integrate new classes as they appear in a stream. It is particularly interesting in evolving environments where agents have limited access to memory and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Eden Belouadah , Arnaud Dapogny , Kevin Bailly

Large-scale visual learning is increasingly limited by training cost. Existing knowledge distillation methods transfer from a stronger teacher to a weaker student for compression or final-accuracy improvement. We instead investigate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Baiang Li , Wenhao Chai , Felix Heide

We present DistillFlow, a knowledge distillation approach to learning optical flow. DistillFlow trains multiple teacher models and a student model, where challenging transformations are applied to the input of the student model to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Pengpeng Liu , Michael R. Lyu , Irwin King , Jia Xu

In this paper, we propose the first self-distillation framework for general object detection, termed LGD (Label-Guided self-Distillation). Previous studies rely on a strong pretrained teacher to provide instructive knowledge that could be…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Peizhen Zhang , Zijian Kang , Tong Yang , Xiangyu Zhang , Nanning Zheng , Jian Sun

YOLO detectors are known for their fast inference speed, yet training them remains unexpectedly time-consuming due to their exhaustive pipeline that processes every training image in every epoch, even when many images have already been…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xingxing Xie , Jiahua Dong , Junwei Han , Gong Cheng

Foundation models, especially vision-language models (VLMs), offer compelling zero-shot object detection for applications like autonomous driving, a domain where manual labelling is prohibitively expensive. However, their detection latency…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Uday Bhaskar , Rishabh Bhattacharya , Avinash Patel , Sarthak Khoche , Praveen Anil Kulkarni , Naresh Manwani

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

With the continuous advancement of industrial automation, product quality inspection has become increasingly important in the manufacturing process. Traditional inspection methods, which often rely on manual checks or simple machine vision…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Zhen Qi , Liwei Ding , Xiangtian Li , Jiacheng Hu , Bin Lyu , Ao Xiang

Class-Incremental Learning (CIL) or continual learning is a desired capability in the real world, which requires a learning system to adapt to new tasks without forgetting former ones. While traditional CIL methods focus on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Da-Wei Zhou , Yuanhan Zhang , Yan Wang , Jingyi Ning , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Efficient and accurate annotation of datasets remains a significant challenge for deploying object detection models such as You Only Look Once (YOLO) in real-world applications, particularly in agriculture where rapid decision-making is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Mohamed Abdallah Salem , Ahmed Harb Rabia

The utilization of deep learning-based object detection is an effective approach to assist visually impaired individuals in avoiding obstacles. In this paper, we implemented seven different YOLO object detection models \textit{viz}.,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Chenhao He , Pramit Saha

As deep vision models grow increasingly complex to achieve higher performance, deployment efficiency has become a critical concern. Knowledge distillation (KD) mitigates this issue by transferring knowledge from large teacher models to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Chen Liu , Qizhen Lan , Zhicheng Ding , Xinyu Chu , Qing Tian

Fire detection in dynamic environments faces continuous challenges, including the interference of illumination changes, many false detections or missed detections, and it is difficult to achieve both efficiency and accuracy. To address the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Weichao Pan , Bohan Xu , Xu Wang , Chengze Lv , Shuoyang Wang , Zhenke Duan , Zhen Tian

Object detection and classification are crucial tasks across various application domains, particularly in the development of safe and reliable Advanced Driver Assistance Systems (ADAS). Existing deep learning-based methods such as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Rashed Al Amin , Roman Obermaisser

Federated Learning has been introduced as a new machine learning paradigm enhancing the use of local devices. At a server level, FL regularly aggregates models learned locally on distributed clients to obtain a more general model. Current…

Machine Learning · Computer Science 2022-07-19 Anastasiia Usmanova , François Portet , Philippe Lalanda , German Vega

Surface defect detection in industrial scenarios is both crucial and technically demanding due to the wide variability in defect types, irregular shapes and sizes, fine-grained requirements, and complex material textures. Although recent…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jiawei Hu

The field of Continual Learning investigates the ability to learn consecutive tasks without losing performance on those previously learned. Its focus has been mainly on incremental classification tasks. We believe that research in continual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Angelo G. Menezes , Gustavo de Moura , Cézanne Alves , André C. P. L. F. de Carvalho

Deep learning-based approaches have shown remarkable performance in the 3D object detection task. However, they suffer from a catastrophic performance drop on the originally trained classes when incrementally learning new classes without…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Na Zhao , Gim Hee Lee

Current convolution neural network (CNN) classification methods are predominantly focused on flat classification which aims solely to identify a specified object within an image. However, real-world objects often possess a natural…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Veska Tsenkova , Peter Stanchev , Daniel Petrov , Deyan Lazarov

Object detection remains an active area of research in the field of computer vision, and considerable advances and successes has been achieved in this area through the design of deep convolutional neural networks for tackling object…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Alexander Wong , Mahmoud Famuori , Mohammad Javad Shafiee , Francis Li , Brendan Chwyl , Jonathan Chung