中文
相关论文

相关论文: Spectal Harmonics: Bridging Spectral Embedding and…

200 篇论文

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

声音 · 计算机科学 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

Semi-supervised learning (SSL) is an efficient framework that can train models with both labeled and unlabeled data, but may generate ambiguous and non-distinguishable representations when lacking adequate labeled samples. With…

计算机视觉与模式识别 · 计算机科学 2022-08-08 Xinkai Yuan , Zilinghan Li , Gaoang Wang

Self-supervised learning (SSL) excels at finding general-purpose latent representations from complex data, yet lacks a unifying theoretical framework that explains the diverse existing methods and guides the design of new ones. We cast SSL…

机器学习 · 计算机科学 2026-05-28 Fabian A Mikulasch , Friedemann Zenke

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

机器学习 · 计算机科学 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

While semi-supervised learning (SSL) algorithms provide an efficient way to make use of both labelled and unlabelled data, they generally struggle when the number of annotated samples is very small. In this work, we consider the problem of…

计算机视觉与模式识别 · 计算机科学 2020-04-23 Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Kai Han , Andrea Vedaldi , Andrew Zisserman

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix

Self-supervised learning (SSL) representation for speech has achieved state-of-the-art (SOTA) performance on several downstream tasks. However, there remains room for improvement in speech enhancement (SE) tasks. In this study, we used a…

音频与语音处理 · 电气工程与系统科学 2022-07-06 Kuo-Hsuan Hung , Szu-wei Fu , Huan-Hsin Tseng , Hsin-Tien Chiang , Yu Tsao , Chii-Wann Lin

We witnessed a massive growth in the supervised learning paradigm in the past decade. Supervised learning requires a large amount of labeled data to reach state-of-the-art performance. However, labeling the samples requires a lot of human…

计算机视觉与模式识别 · 计算机科学 2021-11-04 Mrinal Anand , Aditya Garg

We propose a novel paradigm of semi-supervised learning (SSL)--the semi-supervised multiple representation behavior learning (SSMRBL). SSMRBL aims to tackle the difficulty of learning a grammar for natural language parsing where the data…

计算与语言 · 计算机科学 2019-10-22 Ruqian Lu , Shengluan Hou

We study the data-generating mechanism for reconstructive SSL to shed light on its effectiveness. With an infinite amount of labeled samples, we provide a sufficient and necessary condition for perfect linear approximation. The condition…

机器学习 · 统计学 2024-05-29 Kang Du , Yu Xiang

Semi-supervised Learning (SSL) has witnessed great success owing to the impressive performances brought by various methods based on pseudo labeling and consistency regularization. However, we argue that existing methods might fail to…

Self-supervised learning (SSL) has made enormous progress and largely narrowed the gap with the supervised ones, where the representation learning is mainly guided by a projection into an embedding space. During the projection, current…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Lang Huang , Shan You , Mingkai Zheng , Fei Wang , Chen Qian , Toshihiko Yamasaki

This work tackles the problem of semi-supervised learning of image classifiers. Our main insight is that the field of semi-supervised learning can benefit from the quickly advancing field of self-supervised visual representation learning.…

计算机视觉与模式识别 · 计算机科学 2019-07-24 Xiaohua Zhai , Avital Oliver , Alexander Kolesnikov , Lucas Beyer

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

机器学习 · 计算机科学 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

While the harmonic function solution performs well in many semi-supervised learning (SSL) tasks, it is known to scale poorly with the number of samples. Recent successful and scalable methods, such as the eigenfunction method focus on…

机器学习 · 统计学 2016-01-22 Daniele Calandriello , Alessandro Lazaric , Michal Valko , Ioannis Koutis

Self-supervised learning (SSL) has become a popular method for generating invariant representations without the need for human annotations. Nonetheless, the desired invariant representation is achieved by utilising prior online…

机器学习 · 计算机科学 2024-09-30 Foivos Ntelemis , Yaochu Jin , Spencer A. Thomas

In recent years, neural architecture-based recommender systems have achieved tremendous success, but they still fall short of expectation when dealing with highly sparse data. Self-supervised learning (SSL), as an emerging technique for…

信息检索 · 计算机科学 2023-06-05 Junliang Yu , Hongzhi Yin , Xin Xia , Tong Chen , Jundong Li , Zi Huang

In recent years, self-supervised learning (SSL) frameworks have been extensively applied to sensor-based Human Activity Recognition (HAR) in order to learn deep representations without data annotations. While SSL frameworks reach…

机器学习 · 计算机科学 2023-08-01 Bulat Khaertdinov , Stylianos Asteriadis

This study explores the application of self-supervised learning (SSL) for improved target recognition in synthetic aperture sonar (SAS) imagery. The unique challenges of underwater environments make traditional computer vision techniques,…

计算机视觉与模式识别 · 计算机科学 2023-07-31 BW Sheffield