English
Related papers

Related papers: Learning Common Rationale to Improve Self-Supervis…

200 papers

Semi-supervised learning (SSL) has a potential to improve the predictive performance of machine learning models using unlabeled data. Although there has been remarkable recent progress, the scope of demonstration in SSL has mainly been on…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Kihyuk Sohn , Zizhao Zhang , Chun-Liang Li , Han Zhang , Chen-Yu Lee , Tomas Pfister

We aim to provide a computationally cheap yet effective approach for fine-grained image classification (FGIC) in this letter. Unlike previous methods that rely on complex part localization modules, our approach learns fine-grained features…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Wei Luo , Hengmin Zhang , Jun Li , Xiu-Shen Wei

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuhong Liu , Beichen Zhang , Yuhang Zang , Yuhang Cao , Long Xing , Xiaoyi Dong , Haodong Duan , Dahua Lin , Jiaqi Wang

Self-supervised learning (SSL) has gained widespread attention in the remote sensing (RS) and earth observation (EO) communities owing to its ability to learn task-agnostic representations without human-annotated labels. Nevertheless, most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Dilxat Muhtar , Xueliang Zhang , Pengfeng Xiao , Zhenshi Li , Feng Gu

A good visual representation is an inference map from observations (images) to features (vectors) that faithfully reflects the hidden modularized generative factors (semantics). In this paper, we formulate the notion of "good"…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Tan Wang , Zhongqi Yue , Jianqiang Huang , Qianru Sun , Hanwang Zhang

Semi-supervised learning (SSL), exemplified by FixMatch (Sohn et al., 2020), has shown significant generalization advantages over supervised learning (SL), particularly in the context of deep neural networks (DNNs). However, it is still…

Machine Learning · Computer Science 2025-03-11 Jingyang Li , Jiachun Pan , Vincent Y. F. Tan , Kim-Chuan Toh , Pan Zhou

Fine-grained visual classification (FGVC) is much more challenging than traditional classification tasks due to the inherently subtle intra-class object variations. Recent works mainly tackle this problem by focusing on how to locate the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Ruoyi Du , Dongliang Chang , Ayan Kumar Bhunia , Jiyang Xie , Zhanyu Ma , Yi-Zhe Song , Jun Guo

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or detection, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Donghyun Kim , Kuniaki Saito , Samarth Mishra , Stan Sclaroff , Kate Saenko , Bryan A Plummer

Recent progress in self-supervised (SSL) visual representation learning has led to the development of several different proposed frameworks that rely on augmentations of images but use different loss functions. However, there are few…

Machine Learning · Computer Science 2025-01-20 Kumar Krishna Agrawal , Arna Ghosh , Shagun Sodhani , Adam Oberman , Blake Richards

Visual scene understanding is an important capability that enables robots to purposefully act in their environment. In this paper, we propose a novel approach to object-class segmentation from multiple RGB-D views using deep learning. We…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Lingni Ma , Jörg Stückler , Christian Kerl , Daniel Cremers

Representation learning on user-item graph for recommendation has evolved from using single ID or interaction history to exploiting higher-order neighbors. This leads to the success of graph convolution networks (GCNs) for recommendation…

Information Retrieval · Computer Science 2021-06-21 Jiancan Wu , Xiang Wang , Fuli Feng , Xiangnan He , Liang Chen , Jianxun Lian , Xing Xie

Recent advances in image-level self-supervised learning (SSL) have made significant progress, yet learning dense representations for patches remains challenging. Mainstream methods encounter an over-dispersion phenomenon that patches from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Peisong Wen , Qianqian Xu , Siran Dai , Runmin Cong , Qingming Huang

Recent advancements have highlighted the efficacy of self-supervised learning (SSL) features in various speech-related tasks, providing lightweight and versatile multi-view speech representations. However, our study reveals that while SSL…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Weiqiao Shan , Yuhao Zhang , Yuchen Han , Bei Li , Xiaofeng Zhao , Yuang Li , Min Zhang , Hao Yang , Tong Xiao , Jingbo Zhu

The field of self-supervised 3D representation learning has emerged as a promising solution to alleviate the challenge presented by the scarcity of extensive, well-annotated datasets. However, it continues to be hindered by the lack of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yunsong Wang , Na Zhao , Gim Hee Lee

We introduce S$^2$VS, a video similarity learning approach with self-supervision. Self-Supervised Learning (SSL) is typically used to train deep models on a proxy task so as to have strong transferability on target tasks after fine-tuning.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Giorgos Kordopatis-Zilos , Giorgos Tolias , Christos Tzelepis , Ioannis Kompatsiaris , Ioannis Patras , Symeon Papadopoulos

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

Machine Learning · Statistics 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

We address the problem of generalized category discovery (GCD) in this paper, i.e. clustering the unlabeled images leveraging the information from a set of seen classes, where the unlabeled images could contain both seen classes and unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Yixin Fei , Zhongkai Zhao , Siwei Yang , Bingchen Zhao

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

While most existing segmentation methods usually combined the powerful feature extraction capabilities of CNNs with Conditional Random Fields (CRFs) post-processing, the result always limited by the fault of CRFs . Due to the notoriously…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 ZengShun Zhaoa , Yulong Wang , Ke Liu , Haoran Yang , Qian Sun , Heng Qiao