English
Related papers

Related papers: On Learning Discriminative Features from Synthesiz…

200 papers

Supervised learning methods have been found to exhibit inductive biases favoring simpler features. When such features are spuriously correlated with the label, this can result in suboptimal performance on minority subgroups. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Kimia Hamidieh , Haoran Zhang , Swami Sankaranarayanan , Marzyeh Ghassemi

Current self-supervised learning (SSL) methods (e.g., SimCLR, DINO, VICReg,MOCOv3) target primarily on representations at instance level and do not generalize well to dense prediction tasks, such as object detection and segmentation.Towards…

Machine Learning · Computer Science 2023-11-07 Qing Su , Anton Netchaev , Hai Li , Shihao Ji

Sign language recognition (SLR) is a machine learning task aiming to identify signs in videos. Due to the scarcity of annotated data, unsupervised methods like contrastive learning have become promising in this field. They learn meaningful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ariel Basso Madjoukeng , Jérôme Fink , Pierre Poitier , Edith Belise Kenmogne , Benoit Frenay

Self-supervised learning (SSL) has recently shown notable success in various visual tasks. However, in terms of discriminability, SSL is still not on par with supervised learning (SL). This paper identifies a key issue, the ``crowding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zeen Song , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

Fine-grained image retrieval (FGIR) is to learn visual representations that distinguish visually similar objects while maintaining generalization. Existing methods propose to generate discriminative features, but rarely consider the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xin Jiang , Hao Tang , Rui Yan , Jinhui Tang , Zechao Li

Self supervised learning (SSL) has become a very successful technique to harness the power of unlabeled data, with no annotation effort. A number of developed approaches are evolving with the goal of outperforming supervised alternatives,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

The challenge in fine-grained visual categorization lies in how to explore the subtle differences between different subclasses and achieve accurate discrimination. Previous research has relied on large-scale annotated data and pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Tianxu Wu , Shuo Ye , Shuhuang Chen , Qinmu Peng , Xinge You

We evaluate the effectiveness of semi-supervised learning (SSL) on a realistic benchmark where data exhibits considerable class imbalance and contains images from novel classes. Our benchmark consists of two fine-grained classification…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jong-Chyi Su , Zezhou Cheng , Subhransu Maji

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Self-supervised learning (SSL) can be used to solve complex visual tasks without human labels. Self-supervised representations encode useful semantic information about images, and as a result, they have already been used for tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Paul Engstler , Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina

Self-supervised learning (SSL) is capable of learning remarkable representations from centrally available data. Recent works further implement federated learning with SSL to learn from rapidly growing decentralized unlabeled images (e.g.,…

Machine Learning · Computer Science 2022-04-12 Weiming Zhuang , Yonggang Wen , Shuai Zhang

Recent studies have demonstrated that vision models can effectively learn multimodal audio-image representations when paired. However, the challenge of enabling deep models to learn representations from unpaired modalities remains…

Sound · Computer Science 2025-04-15 Yasar Abbas Ur Rehman , Kin Wai Lau , Yuyang Xie , Ma Lan , JiaJun Shen

Robust object recognition systems usually rely on powerful feature extraction mechanisms from a large number of real images. However, in many realistic applications, collecting sufficient images for ever-growing new classes is unattainable.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Yang Long , Li Liu , Ling Shao , Fumin Shen , Guiguang Ding , Jungong Han

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

Recommender systems are widely deployed in various web environments, and self-supervised learning (SSL) has recently attracted significant attention in this field. Contrastive learning (CL) stands out as a major SSL paradigm due to its…

Information Retrieval · Computer Science 2025-01-17 Yu Zhang , Lei Sang , Yi Zhang , Yiwen Zhang , Yun Yang

Self-Supervised learning (SSL) has become the new state-of-art in several domain classification and segmentation tasks. Of these, one popular category in SSL is distillation networks such as BYOL. This work proposes RSDnet, which applies…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Pallavi Jain , Bianca Schoen-Phelan , Robert Ross

The premise of semi-supervised learning (SSL) is that combining labeled and unlabeled data yields significantly more accurate models. Despite empirical successes, the theoretical understanding of SSL is still far from complete. In this…

Machine Learning · Statistics 2024-09-06 Eyar Azar , Boaz Nadler

Self-supervised learning (SSL) has emerged as a crucial technique in image processing, encoding, and understanding, especially for developing today's vision foundation models that utilize large-scale datasets without annotations to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chuang Niu , Wenjun Xia , Hongming Shan , Ge Wang