English
Related papers

Related papers: Learning Contrastive Self-Distillation for Ultra-F…

200 papers

Ultra-fine-grained visual categorization (Ultra-FGVC) aims to classify highly similar subcategories within fine-grained objects using limited training samples. However, holistic yet discriminative cues, such as leaf contours in extremely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Shijie Wang , Zijian Wang , Yadan Luo , Haojie Li , Zi Huang , Mahsa Baktashmotlagh

Deep learning methods show promising results for overlapping cervical cell instance segmentation. However, in order to train a model with good generalization ability, voluminous pixel-level annotations are demanded which is quite expensive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yanning Zhou , Hao Chen , Huangjing Lin , Pheng-Ann Heng

Self-supervised learning has been successfully applied to pre-train video representations, which aims at efficient adaptation from pre-training domain to downstream tasks. Existing approaches merely leverage contrastive loss to learn…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yuanze Lin , Xun Guo , Yan Lu

Convolutional neural networks (CNNs) have achieved a great success in face recognition, which unfortunately comes at the cost of massive computation and storage consumption. Many compact face recognition networks are thus proposed to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Yushu Feng , Huan Wang , Daniel T. Yi , Roland Hu

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

Semi-supervised learning is a sound measure to relieve the strict demand of abundant annotated datasets, especially for challenging multi-organ segmentation . However, most existing SSL methods predict pixels in a single image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Lu Wen , Zhenghao Feng , Yun Hou , Peng Wang , Xi Wu , Jiliu Zhou , Yan Wang

Self-supervised learning holds promise in leveraging large amounts of unlabeled data, however much of its progress has thus far been limited to highly curated pre-training data such as ImageNet. We explore the effects of contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yonglong Tian , Olivier J. Henaff , Aaron van den Oord

Self-supervised learning is emerging in fine-grained visual recognition with promising results. However, existing self-supervised learning methods are often susceptible to irrelevant patterns in self-supervised tasks and lack the capability…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 ShuaiHeng Li , Qing Cai , Fan Zhang , Menghuan Zhang , Yangyang Shu , Zhi Liu , Huafeng Li , Lingqiao Liu

With the rapid development of deep learning (DL) in recent years, automatic modulation recognition (AMR) with DL has achieved high accuracy. However, insufficient training signal data in complicated channel environments and large-scale DL…

Machine Learning · Computer Science 2024-01-01 Dongbin Hou , Lixin Li , Wensheng Lin , Junli Liang , Zhu Han

This paper presents Discriminative Part Network (DP-Net), a deep architecture with strong interpretation capabilities, which exploits a pretrained Convolutional Neural Network (CNN) combined with a part-based recognition module. This system…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ronan Sicre , Hanwei Zhang , Julien Dejasmin , Chiheb Daaloul , Stéphane Ayache , Thierry Artières

Fine-grained visual classification (FGVC) is a challenging computer vision problem, where the task is to automatically recognise objects from subordinate categories. One of its main difficulties is capturing the most discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Dmitry Demidov , Muhammad Hamza Sharif , Aliakbar Abdurahimov , Hisham Cholakkal , Fahad Shahbaz Khan

Prevailing deep graph learning models often suffer from label sparsity issue. Although many graph few-shot learning (GFL) methods have been developed to avoid performance degradation in face of limited annotated data, they excessively rely…

Machine Learning · Computer Science 2022-10-04 Chunhui Zhang , Hongfu Liu , Jundong Li , Yanfang Ye , Chuxu Zhang

Food recognition has a wide range of applications, such as health-aware recommendation and self-service restaurants. Most previous methods of food recognition firstly locate informative regions in some weakly-supervised manners and then…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yaohui Zhu , Linhu Liu , Jiang Tian

Real-world imagery is often characterized by a significant imbalance of the number of images per class, leading to long-tailed distributions. An effective and simple approach to long-tailed visual recognition is to learn feature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Ahmet Iscen , André Araujo , Boqing Gong , Cordelia Schmid

Creating fake images and videos such as "Deepfake" has become much easier these days due to the advancement in Generative Adversarial Networks (GANs). Moreover, recent research such as the few-shot learning can create highly realistic…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Hyeonseong Jeon , Youngoh Bang , Simon S. Woo

Instance segmentation demands costly per-pixel annotations and computationally expensive models. We introduce CAST, a semi-supervised knowledge distillation (SSKD) framework that compresses pre-trained vision foundation models (VFM) into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Pardis Taghavi , Tian Liu , Renjie Li , Reza Langari , Zhengzhong Tu

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

Most existing salient object detection (SOD) models are difficult to apply due to the complex and huge model structures. Although some lightweight models are proposed, the accuracy is barely satisfactory. In this paper, we design a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jin Zhang , Qiuwei Liang , Yanjiao Shi

In recent years, knowledge distillation methods based on contrastive learning have achieved promising results on image classification and object detection tasks. However, in this line of research, we note that less attention is paid to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jiawei Fan , Chao Li , Xiaolong Liu , Meina Song , Anbang Yao

Distribution Matching Distillation (DMD) distills score-based generative models into efficient one-step generators, without requiring a one-to-one correspondence with the sampling trajectories of their teachers. Yet, the limited capacity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xiangyu Fan , Zesong Qiu , Zhuguanyu Wu , Fanzhou Wang , Zhiqian Lin , Tianxiang Ren , Dahua Lin , Ruihao Gong , Lei Yang