English
Related papers

Related papers: On Linear Separation Capacity of Self-Supervised R…

200 papers

Improving a semi-supervised image segmentation task has the option of adding more unlabelled images, labelling the unlabelled images or combining both, as neither image acquisition nor expert labelling can be considered trivial in most…

Image and Video Processing · Electrical Eng. & Systems 2019-08-23 Yunguan Fu , Maria R. Robu , Bongjin Koo , Crispin Schneider , Stijn van Laarhoven , Danail Stoyanov , Brian Davidson , Matthew J. Clarkson , Yipeng Hu

Predicting phenotypes from gene expression data is a crucial task in biomedical research, enabling insights into disease mechanisms, drug responses, and personalized medicine. Traditional machine learning and deep learning rely on…

Machine Learning · Computer Science 2025-09-18 Kevin Dradjat , Massinissa Hamidi , Pierre Bartet , Blaise Hanczar

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of unclassified data, to perform a classification in situations when, typically, there is little labeled data. Even though this is not…

Machine Learning · Statistics 2020-12-11 Alejandro Cholaquidis , Ricardo Fraiman , Mariela Sued

In self-supervised learning, a system is tasked with achieving a surrogate objective by defining alternative targets on a set of unlabeled data. The aim is to build useful representations that can be used in downstream tasks, without costly…

Machine Learning · Computer Science 2020-11-11 Massimiliano Patacchiola , Amos Storkey

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of not classified data, to perform classification, in situations when, typically, the labelled data are few. Even though this is not…

Statistics Theory · Mathematics 2017-12-18 Alejandro Cholaquidis , Ricardo Fraiman , Mariela Sued

Unsupervised learning allows us to leverage unlabelled data, which has become abundantly available, and to create embeddings that are usable on a variety of downstream tasks. However, the typical lack of interpretability of unsupervised…

Machine Learning · Computer Science 2023-09-29 Gregory Scafarto , Madalina Ciortan , Simon Tihon , Quentin Ferre

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis

Self-supervised learning of deep neural networks has become a prevalent paradigm for learning representations that transfer to a variety of downstream tasks. Similar to proposed models of the ventral stream of biological vision, it is…

Machine Learning · Computer Science 2023-06-26 Kion Fallah , Alec Helbling , Kyle A. Johnsen , Christopher J. Rozell

In video surveillance, person re-identification is the task of searching person images in non-overlapping cameras. Though supervised methods for person re-identification have attained impressive performance, obtaining large scale cross-view…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 T M Feroz Ali , Subhasis Chaudhuri

In this study, we propose the integration of competitive learning into convolutional neural networks (CNNs) to improve the representation learning and efficiency of fine-tuning. Conventional CNNs use back propagation learning, and it…

Machine Learning · Computer Science 2018-04-27 Takashi Shinozaki

Deep learning-based analysis of high-frequency, high-resolution micro-ultrasound data shows great promise for prostate cancer detection. Previous approaches to analysis of ultrasound data largely follow a supervised learning paradigm.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Paul F. R. Wilson , Mahdi Gilany , Amoon Jamzad , Fahimeh Fooladgar , Minh Nguyen Nhat To , Brian Wodlinger , Purang Abolmaesumi , Parvin Mousavi

Self-supervised representation learning often uses data augmentations to induce some invariance to "style" attributes of the data. However, with downstream tasks generally unknown at training time, it is difficult to deduce a priori which…

In recent years, self-supervised learning has played a pivotal role in advancing machine learning by allowing models to acquire meaningful representations from unlabeled data. An intriguing research avenue involves developing…

Machine Learning · Computer Science 2023-10-30 Denis Janiak , Jakub Binkowski , Piotr Bielak , Tomasz Kajdanowicz

A key challenge for machine intelligence is to learn new visual concepts without forgetting the previously acquired knowledge. Continual learning is aimed towards addressing this challenge. However, there is a gap between existing…

Machine Learning · Computer Science 2024-02-01 Yan Luo , Yongkang Wong , Mohan Kankanhalli , Qi Zhao

Representation learning that leverages large-scale labelled datasets, is central to recent progress in machine learning. Access to task relevant labels at scale is often scarce or expensive, motivating the need to learn from unlabelled…

Machine Learning · Computer Science 2022-02-14 Arna Ghosh , Arnab Kumar Mondal , Kumar Krishna Agrawal , Blake Richards

Deep learning demands a huge amount of well-labeled data to train the network parameters. How to use the least amount of labeled data to obtain the desired classification accuracy is of great practical significance, because for many…

Machine Learning · Computer Science 2019-12-20 Xiao Han , Zihao Wang , Enmei Tu , Gunnam Suryanarayana , Jie Yang

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

In class-incremental semantic segmentation, we have no access to the labeled data of previous tasks. Therefore, when incrementally learning new classes, deep neural networks suffer from catastrophic forgetting of previously learned…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Lu Yu , Xialei Liu , Joost van de Weijer