English
Related papers

Related papers: Self-Supervised Learning for Few-Shot Bird Sound C…

200 papers

Everyday sound recognition aims to infer types of sound events in audio streams. While many works succeeded in training models with high performance in a fully-supervised manner, they are still restricted to the demand of large quantities…

Sound · Computer Science 2022-12-20 Jinhua Liang , Huy Phan , Emmanouil Benetos

Humans do not acquire perceptual abilities in the way we train machines. While machine learning algorithms typically operate on large collections of randomly-chosen, explicitly-labeled examples, human acquisition relies more heavily on…

In Self-Supervised Learning (SSL), pre-training and evaluation are resource intensive. In the speech domain, current indicators of the quality of SSL models during pre-training, such as the loss, do not correlate well with downstream…

Sound · Computer Science 2025-06-03 Ryan Whetten , Lucas Maison , Titouan Parcollet , Marco Dinarelli , Yannick Estève

Few-shot learning and self-supervised learning address different facets of the same problem: how to train a model with little or no labeled data. Few-shot learning aims for optimization methods and models that can learn efficiently to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Spyros Gidaris , Andrei Bursuc , Nikos Komodakis , Patrick Pérez , Matthieu Cord

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

We explore an ASR-free method for isolated word reading assessment in low-resource settings. Our few-shot approach compares input child speech to a small set of adult-provided reference templates. Inputs and templates are encoded using…

Computation and Language · Computer Science 2025-07-17 Reuben Smit , Retief Louw , Herman Kamper

Self-supervised learning (SSL) is the latest breakthrough in speech processing, especially for label-scarce downstream tasks by leveraging massive unlabeled audio data. The noise robustness of the SSL is one of the important challenges to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-25 Hiroshi Sato , Ryo Masumura , Tsubasa Ochiai , Marc Delcroix , Takafumi Moriya , Takanori Ashihara , Kentaro Shinayama , Saki Mizuno , Mana Ihori , Tomohiro Tanaka , Nobukatsu Hojo

Self-supervised learning (SSL) speech models, which can serve as powerful upstream models to extract meaningful speech representations, have achieved unprecedented success in speech representation learning. However, their effectiveness on…

Sound · Computer Science 2023-02-01 Tung-Yu Wu , Chen-An Li , Tzu-Han Lin , Tsu-Yuan Hsu , Hung-Yi Lee

Self supervised learning (SSL) is a machine learning paradigm where models learn to understand the underlying structure of data without explicit supervision from labeled samples. The acquired representations from SSL have demonstrated…

Machine Learning · Computer Science 2025-12-11 Yunshan Duan , Sinead Williamson

To understand why self-supervised learning (SSL) models have empirically achieved strong performances on several speech-processing downstream tasks, numerous studies have focused on analyzing the encoded information of the SSL layer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-07 Jialu Li , Mark Hasegawa-Johnson , Nancy L. McElwain

Federated learning is an effective way of extracting insights from different user devices while preserving the privacy of users. However, new classes with completely unseen data distributions can stream across any device in a federated…

Machine Learning · Computer Science 2021-06-21 Gautham Krishna Gudur , Satheesh K. Perepu

Self-Supervised Learning (SSL) is a reliable learning mechanism in which a robot uses an original, trusted sensor cue for training to recognize an additional, complementary sensor cue. We study for the first time in SSL how a robot's…

Robotics · Computer Science 2016-03-29 Kevin van Hecke , Guido de Croon , Laurens van der Maaten , Daniel Hennes , Dario Izzo

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

Machine Learning · Computer Science 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

We examine the text-free speech representations of raw audio obtained from a self-supervised learning (SSL) model by analyzing the synthesized speech using the SSL representations instead of conventional text representations. Since raw…

Computation and Language · Computer Science 2024-12-05 Joonyong Park , Daisuke Saito , Nobuaki Minematsu

Self-supervised learning (SSL) learns knowledge from a large amount of unlabeled data, and then transfers the knowledge to a specific problem with a limited number of labeled data. SSL has achieved promising results in various domains. This…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-08 Xian Li , Xiaofei Li

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Chao Tao , Ji Qi , Weipeng Lu , Hao Wang , Haifeng Li

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Automated plant recognition plays a crucial role in biodiversity monitoring and conservation, yet current approaches rely heavily on supervised learning, which is limited by the availability of expert-labeled data. Self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Ilyass Moummad , Kawtar Zaher , Hervé Goëau , Jean-Christophe Lombardo , Pierre Bonnet , Alexis Joly

Self-supervised learning (SSL) has attracted increased attention for learning meaningful speech representations. Speech SSL models, such as WavLM, employ masked prediction training to encode general-purpose representations. In contrast,…

Computation and Language · Computer Science 2024-02-01 Takanori Ashihara , Marc Delcroix , Takafumi Moriya , Kohei Matsuura , Taichi Asami , Yusuke Ijima