English
Related papers

Related papers: Self-supervised Character-to-Character Distillatio…

200 papers

Domain adaptive person re-identification (re-ID) is a challenging task due to the large discrepancy between the source domain and the target domain. To reduce the domain discrepancy, existing methods mainly attempt to generate pseudo labels…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Junhui Yin , Jiayan Qiu , Siqing Zhang , Zhanyu Ma , Jun Guo

Hyperspectral image change detection (HSI-CD) has emerged as a crucial research area in remote sensing due to its ability to detect subtle changes on the earth's surface. Recently, diffusional denoising probabilistic models (DDPM) have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Xiangrong Zhang , Shunli Tian , Guanchun Wang , Huiyu Zhou , Licheng Jiao

Recent deep learning models have demonstrated strong capabilities for classifying text and non-text components in natural images. They extract a high-level feature computed globally from a whole image component (patch), where the cluttered…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Tong He , Weilin Huang , Yu Qiao , Jian Yao

High content imaging assays can capture rich phenotypic response data for large sets of compound treatments, aiding in the characterization and discovery of novel drugs. However, extracting representative features from high content images…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Johan Fredin Haslum , Christos Matsoukas , Karl-Johan Leuchowius , Erik Müllers , Kevin Smith

Convolutional Sparse Coding (CSC) is a well-established image representation model especially suited for image restoration tasks. In this work, we extend the applicability of this model by proposing a supervised approach to convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Lama Affara , Bernard Ghanem , Peter Wonka

High-quality annotation of fine-grained visual categories demands great expert knowledge, which is taxing and time consuming. Alternatively, learning fine-grained visual representation from enormous unlabeled images (e.g., species, brands)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Qi Bi , Wei Ji , Jingjun Yi , Haolan Zhan , Gui-Song Xia

Existing scene text recognition (STR) methods struggle to recognize challenging texts, especially for artistic and severely distorted characters. The limitation lies in the insufficient exploration of character morphologies, including the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yadong Qu , Yuxin Wang , Bangbang Zhou , Zixiao Wang , Hongtao Xie , Yongdong Zhang

An effective framework for learning 3D representations for perception tasks is distilling rich self-supervised image features via contrastive learning. However, image-to point representation learning for autonomous driving datasets faces…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Anas Mahmoud , Jordan S. K. Hu , Tianshu Kuai , Ali Harakeh , Liam Paull , Steven L. Waslander

The performance of nighttime semantic segmentation is restricted by the poor illumination and a lack of pixel-wise annotation, which severely limit its application in autonomous driving. Existing works, e.g., using the twilight as the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Huan Gao , Jichang Guo , Guoli Wang , Qian Zhang

Self-supervised learning has recently emerged as a strong alternative in document analysis. These approaches are now capable of learning high-quality image representations and overcoming the limitations of supervised methods, which require…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Marwa Dhiaf , Mohamed Ali Souibgui , Kai Wang , Yuyang Liu , Yousri Kessentini , Alicia Fornés , Ahmed Cheikh Rouhou

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Rui Li , Dong Liu

Video surveillance systems are crucial components for ensuring public safety and management in smart city. As a fundamental task in video surveillance, text-to-image person retrieval aims to retrieve the target person from an image gallery…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Bingjun Luo , Jinpeng Wang , Wang Zewen , Junjie Zhu , Xibin Zhao

Convolutional Neural Networks (CNNs) have significantly advanced Image Super-Resolution (SR), yet most CNN-based methods rely solely on pixel-based transformations, often leading to artifacts and blurring, particularly under severe…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Bingwen Hu , Heng Liu , Zhedong Zheng , Ping Liu

This paper is concerned with self-supervised learning for small models. The problem is motivated by our empirical studies that while the widely used contrastive self-supervised learning method has shown great progress on large model…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Zhiyuan Fang , Jianfeng Wang , Lijuan Wang , Lei Zhang , Yezhou Yang , Zicheng Liu

We present a simple but effective pixel-level self-supervised distillation framework friendly to dense prediction tasks. Our method, called Pixel-Wise Contrastive Distillation (PCD), distills knowledge by attracting the corresponding pixels…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Junqiang Huang , Zichao Guo

Score Distillation Sampling (SDS) has achieved remarkable success in text-to-3D content generation. However, SDS-based methods struggle to maintain semantic fidelity for user prompts, particularly when involving multiple objects with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Chenhan Jiang , Yihan Zeng , Dit-Yan Yeung

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Cross-domain text classification aims to adapt models to a target domain that lacks labeled data. It leverages or reuses rich labeled data from the different but related source domain(s) and unlabeled data from the target domain. To this…

Computation and Language · Computer Science 2024-04-11 Yunlong Feng , Bohan Li , Libo Qin , Xiao Xu , Wanxiang Che

Scarcity of labeled data has motivated the development of semi-supervised learning methods, which learn from large portions of unlabeled data alongside a few labeled samples. Consistency Regularization between model's predictions under…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Aamir Mustafa , Rafal K. Mantiuk

Customization of text-to-image models enables users to insert new concepts or objects and generate them in unseen settings. Existing methods either rely on comparatively expensive test-time optimization or train encoders on single-image…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Nupur Kumari , Xi Yin , Jun-Yan Zhu , Ishan Misra , Samaneh Azadi