English
Related papers

Related papers: A Self-Distillation Embedded Supervised Affinity A…

200 papers

As a promising approach in model compression, knowledge distillation improves the performance of a compact model by transferring the knowledge from a cumbersome one. The kind of knowledge used to guide the training of the student is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Tao Liu , Xi Yang , Chenshu Chen

While diffusion models effectively generate remarkable synthetic images, a key limitation is the inference inefficiency, requiring numerous sampling steps. To accelerate inference and maintain high-quality synthesis, teacher-student…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Chi Hong , Jiyue Huang , Robert Birke , Dick Epema , Stefanie Roos , Lydia Y. Chen

Lifelong few-shot customization for text-to-image diffusion aims to continually generalize existing models for new tasks with minimal data while preserving old knowledge. Current customization diffusion models excel in few-shot tasks but…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Nan Song , Xiaofeng Yang , Ze Yang , Guosheng Lin

Transformer-based Super-Resolution (SR) methods have demonstrated superior performance compared to convolutional neural network (CNN)-based SR approaches due to their capability to capture long-range dependencies. However, their high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Karam Park , Jae Woong Soh , Nam Ik Cho

Recently few-shot segmentation (FSS) has been extensively developed. Most previous works strive to achieve generalization through the meta-learning framework derived from classification tasks; however, the trained models are biased towards…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Chunbo Lang , Gong Cheng , Binfei Tu , Junwei Han

Few-shot segmentation, which aims to segment unseen-class objects given only a handful of densely labeled samples, has received widespread attention from the community. Existing approaches typically follow the prototype learning paradigm to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Chunbo Lang , Binfei Tu , Gong Cheng , Junwei Han

Conventional detection networks usually need abundant labeled training samples, while humans can learn new concepts incrementally with just a few examples. This paper focuses on a more challenging but realistic class-incremental few-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Pengyang Li , Yanan Li , Han Cui , Donghui Wang

In the surveillance and defense domain, multi-target detection and classification (MTD) is considered essential yet challenging due to heterogeneous inputs from diverse data sources and the computational complexity of algorithms designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ngoc Tuyen Do , Tri Nhu Do

The joint utilization of diverse data sources for medical imaging segmentation has emerged as a crucial area of research, aiming to address challenges such as data heterogeneity, domain shift, and data quality discrepancies. Integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Eddardaa B. Loussaief , Mohammed Ayad , Domenc Puig , Hatem A. Rashwan

Unsupervised anomaly detection encompasses diverse applications in industrial settings where a high-throughput and precision is imperative. Early works were centered around one-class-one-model paradigm, which poses significant challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Sushovan Jena , Vishwas Saini , Ujjwal Shaw , Pavitra Jain , Abhay Singh Raihal , Anoushka Banerjee , Sharad Joshi , Ananth Ganesh , Arnav Bhavsar

Existing few-shot segmentation (FSS) methods mainly focus on designing novel support-query matching and self-matching mechanisms to exploit implicit knowledge in pre-trained backbones. However, the performance of these methods is often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Shijie Chang , Lihe Zhang , Huchuan Lu

Few-shot semantic segmentation is vital for deep learning-based infrastructure inspection applications, where labeled training examples are scarce and expensive. Although existing deep learning frameworks perform well, the need for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Christina Thrainer , Md Meftahul Ferdaus , Mahdi Abdelguerfi , Christian Guetl , Steven Sloan , Kendall N. Niles , Ken Pathak

Point-level Supervised Instance Segmentation (PSIS) aims to enhance the applicability and scalability of instance segmentation by utilizing low-cost yet instance-informative annotations. Existing PSIS methods usually rely on positional…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Zipeng Wang , Xuehui Yu , Xumeng Han , Wenwen Yu , Zhixun Huang , Jianbin Jiao , Zhenjun Han

It is important to develop mathematically tractable models than can interpret knowledge extracted from the data and provide reasonable predictions. In this paper, we present a Linear Distillation Learning, a simple remedy to improve the…

Machine Learning · Computer Science 2019-10-14 Arip Asadulaev , Igor Kuznetsov , Andrey Filchenkov

The goal of this paper is to bypass the need for labelled examples in few-shot video understanding at run time. While proven effective, in many practical video settings even labelling a few examples appears unrealistic. This is especially…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Pengwan Yang , Yuki M. Asano , Pascal Mettes , Cees G. M. Snoek

As a general model compression paradigm, feature-based knowledge distillation allows the student model to learn expressive features from the teacher counterpart. In this paper, we mainly focus on designing an effective feature-distillation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Guang Yang , Yin Tang , Jun Li , Jianhua Xu , Xili Wan

Few-shot segmentation (FSS) aims to segment objects of new categories given only a handful of annotated samples. Previous works focus their efforts on exploring the support information while paying less attention to the mining of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yuan Wang , Naisong Luo , Tianzhu Zhang

Few-shot Semantic Segmentation (FSS) was proposed to segment unseen classes in a query image, referring to only a few annotated examples named support images. One of the characteristics of FSS is spatial inconsistency between query and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Leilei Cao , Yibo Guo , Ye Yuan , Qiangguo Jin

Knowledge distillation can lead to deploy-friendly networks against the plagued computational complexity problem, but previous methods neglect the feature hierarchy in detectors. Motivated by this, we propose a general framework for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Yangyang Qin , Hefei Ling , Zhenghai He , Yuxuan Shi , Lei Wu

Efficiently training accurate deep models for weakly supervised semantic segmentation (WSSS) with image-level labels is challenging and important. Recently, end-to-end WSSS methods have become the focus of research due to their high…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Rongtao Xu , Changwei Wang , Jiaxi Sun , Shibiao Xu , Weiliang Meng , Xiaopeng Zhang