English
Related papers

Related papers: Improving Self-supervised Learning with Hardness-a…

200 papers

Self-supervised learning (SSL) has recently shown notable success in various visual tasks. However, in terms of discriminability, SSL is still not on par with supervised learning (SL). This paper identifies a key issue, the ``crowding…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zeen Song , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

Incorporating heterogeneous representations from different architectures has facilitated various vision tasks, e.g., some hybrid networks combine transformers and convolutions. However, complementarity between such heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Zhong-Yu Li , Bo-Wen Yin , Yongxiang Liu , Li Liu , Ming-Ming Cheng

Self-supervised learning (SSL) is a powerful tool in machine learning, but understanding the learned representations and their underlying mechanisms remains a challenge. This paper presents an in-depth empirical analysis of SSL-trained…

Machine Learning · Computer Science 2023-06-01 Ido Ben-Shaul , Ravid Shwartz-Ziv , Tomer Galanti , Shai Dekel , Yann LeCun

Medical image analysis suffers from a shortage of data, whether annotated or not. This becomes even more pronounced when it comes to 3D medical images. Self-Supervised Learning (SSL) can partially ease this situation by using unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Fei Gao , Siwen Wang , Fandong Zhang , Hong-Yu Zhou , Yizhou Wang , Churan Wang , Gang Yu , Yizhou Yu

Recent self-supervised learning approaches focus on using a few thousand data points to learn policies for high-level, low-dimensional action spaces. However, scaling this framework for high-dimensional control require either scaling up the…

Robotics · Computer Science 2018-02-14 Adithyavairavan Murali , Lerrel Pinto , Dhiraj Gandhi , Abhinav Gupta

As a newly emerging unsupervised learning paradigm, self-supervised learning (SSL) recently gained widespread attention, which usually introduces a pretext task without manual annotation of data. With its help, SSL effectively learns the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Chuanxing Geng , Zhenghao Tan , Songcan Chen

Self-supervised learning (SSL) is a powerful technique for learning from unlabeled data. By learning to remain invariant to applied data augmentations, methods such as SimCLR and MoCo can reach quality on par with supervised approaches.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Marcin Przewięźlikowski , Mateusz Pyla , Bartosz Zieliński , Bartłomiej Twardowski , Jacek Tabor , Marek Śmieja

Whole-slide image (WSI) analysis plays a crucial role in cancer diagnosis and treatment. In addressing the demands of this critical task, self-supervised learning (SSL) methods have emerged as a valuable resource, leveraging their…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Gia-Bao Le , Van-Tien Nguyen , Trung-Nghia Le , Minh-Triet Tran

Over the last decade, supervised deep learning on manually annotated big data has been progressing significantly on computer vision tasks. But the application of deep learning in medical image analysis was limited by the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wei-Chien Wang , Euijoon Ahn , Dagan Feng , Jinman Kim

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

Machine Learning · Computer Science 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost

Adversarial training (AT) for robust representation learning and self-supervised learning (SSL) for unsupervised representation learning are two active research fields. Integrating AT into SSL, multiple prior works have accomplished a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Chaoning Zhang , Kang Zhang , Chenshuang Zhang , Axi Niu , Jiu Feng , Chang D. Yoo , In So Kweon

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most methods mainly focus on the instance level information (\ie,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek

Self-Supervised Learning (SSL) has shown great promise in learning representations from unlabeled data. The power of learning representations without the need for human annotations has made SSL a widely used technique in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Aryan Satpathy , Nilaksh Singh , Dhruva Rajwade , Somesh Kumar

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

Signal Processing · Electrical Eng. & Systems 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

Histopathological image segmentation is a laborious and time-intensive task, often requiring analysis from experienced pathologists for accurate examinations. To reduce this burden, supervised machine-learning approaches have been adopted…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Vishnuvardhan Purma , Suhas Srinath , Seshan Srirangarajan , Aanchal Kakkar , Prathosh A. P

Over the past decade, computer vision applications in minimally invasive surgery have rapidly increased. Despite this growth, the impact of surgical computer vision remains limited compared to other medical fields like pathology and…