English
Related papers

Related papers: Few-Shot Object Detection by Knowledge Distillatio…

200 papers

State-of-the-art vision pretraining methods rely on image-level self-distillation from object-centric datasets such as ImageNet, implicitly assuming each image contains a single object. This assumption does not always hold: many ImageNet…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Çağlar Hızlı , Çağatay Yıldız , Pekka Marttinen

This work aims to reproduce results from the CVPR 2020 paper by Gidaris et al. Self-supervised learning (SSL) is used to learn feature representations of an image using an unlabeled dataset. This work proposes to use bag-of-words (BoW) deep…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Harry Nguyen , Stone Yun , Hisham Mohammad

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones. This…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Umberto Michieli , Pietro Zanuttigh

Since visual perception can give rich information beyond text descriptions for world understanding, there has been increasing interest in leveraging visual grounding for language learning. Recently, vokenization (Tan and Bansal, 2020) has…

Computation and Language · Computer Science 2021-10-20 Zineng Tang , Jaemin Cho , Hao Tan , Mohit Bansal

Open-vocabulary object detection aims to provide object detectors trained on a fixed set of object categories with the generalizability to detect objects described by arbitrary text queries. Previous methods adopt knowledge distillation to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Luting Wang , Yi Liu , Penghui Du , Zihan Ding , Yue Liao , Qiaosong Qi , Biaolong Chen , Si Liu

Instruction following vision-language (VL) models offer a flexible interface that supports a broad range of multimodal tasks in a zero-shot fashion. However, interfaces that operate on full images do not directly enable the user to "point…

Labeling data is often expensive and time-consuming, especially for tasks such as object detection and instance segmentation, which require dense labeling of the image. While few-shot object detection is about training a model on novel…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Gabriel Huang , Issam Laradji , David Vazquez , Simon Lacoste-Julien , Pau Rodriguez

Few-shot object detection~(FSOD), which aims to detect novel objects with limited annotated instances, has made significant progress in recent years. However, existing methods still suffer from biased representations, especially for novel…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Zheng Wang , Yingjie Gao , Qingjie Liu , Yunhong Wang

The human visual system has the remarkably ability to be able to effortlessly learn novel concepts from only a few examples. Mimicking the same behavior on machine learning vision systems is an interesting and very challenging research…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Spyros Gidaris , Nikos Komodakis

Representation learning for sketch-based image retrieval has mostly been tackled by learning embeddings that discard modality-specific information. As instances from different modalities can often provide complementary information…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Abhra Chaudhuri , Massimiliano Mancini , Yanbei Chen , Zeynep Akata , Anjan Dutta

Recent advances in object detection have benefited significantly from rapid developments in deep neural networks. However, neural networks suffer from the well-known issue of catastrophic forgetting, which makes continual or lifelong…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Wang Zhou , Shiyu Chang , Norma Sosa , Hendrik Hamann , David Cox

Detecting rare objects from a few examples is an emerging problem. Prior works show meta-learning is a promising approach. But, fine-tuning techniques have drawn scant attention. We find that fine-tuning only the last layer of existing…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xin Wang , Thomas E. Huang , Trevor Darrell , Joseph E. Gonzalez , Fisher Yu

Since the wide employment of deep learning frameworks in video salient object detection, the accuracy of the recent approaches has made stunning progress. These approaches mainly adopt the sequential modules, based on optical flow or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yi Tang , Yuanman Li , Wenbin Zou

Optimizing neural networks with noisy labels is a challenging task, especially if the label set contains real-world noise. Networks tend to generalize to reasonable patterns in the early training stages and overfit to specific details of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Timo Kaiser , Lukas Ehmann , Christoph Reinders , Bodo Rosenhahn

We study multi-modal few-shot object detection (FSOD) in this paper, using both few-shot visual examples and class semantic information for detection, which are complementary to each other by definition. Most of the previous works on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Guangxing Han , Long Chen , Jiawei Ma , Shiyuan Huang , Rama Chellappa , Shih-Fu Chang

Vision-Language Pre-training (VLP) shows remarkable progress with the assistance of extremely heavy parameters, which challenges deployment in real applications. Knowledge distillation is well recognized as the essential procedure in model…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Huafeng Kuang , Jie Wu , Xiawu Zheng , Ming Li , Xuefeng Xiao , Rui Wang , Min Zheng , Rongrong Ji

Real-time object detectors like YOLO achieve exceptional performance when trained on large datasets for multiple epochs. However, in real-world scenarios where data arrives incrementally, neural networks suffer from catastrophic forgetting,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Riccardo De Monte , Davide Dalle Pezze , Gian Antonio Susto

This paper explores the application of knowledge distillation technology in target detection tasks, especially the impact of different distillation temperatures on the performance of student models. By using YOLOv5l as the teacher network…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Guanming Huang , Aoran Shen , Yuxiang Hu , Junliang Du , Jiacheng Hu , Yingbin Liang

Knowledge distillation has been applied to image classification successfully. However, object detection is much more sophisticated and most knowledge distillation methods have failed on it. In this paper, we point out that in object…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Zhendong Yang , Zhe Li , Xiaohu Jiang , Yuan Gong , Zehuan Yuan , Danpei Zhao , Chun Yuan

The field of visual few-shot classification aims at transferring the state-of-the-art performance of deep learning visual systems onto tasks where only a very limited number of training samples are available. The main solution consists in…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yassir Bendou , Lucas Drumetz , Vincent Gripon , Giulia Lioi , Bastien Pasdeloup