English
Related papers

Related papers: C3-DINO: Joint Contrastive and Non-contrastive Sel…

200 papers

Self-supervised learning (SSL) is a method that learns the data representation by utilizing supervision inherent in the data. This learning method is in the spotlight in the drug field, lacking annotated data due to time-consuming and…

Biomolecules · Quantitative Biology 2022-08-19 Kisung Moon , Sunyoung Kwon

The sequential recommendation aims at predicting the next items in user behaviors, which can be solved by characterizing item relationships in sequences. Due to the data sparsity and noise issues in sequences, a new self-supervised learning…

Machine Learning · Computer Science 2022-03-30 Zhiwei Liu , Yongjun Chen , Jia Li , Man Luo , Philip S. Yu , Caiming Xiong

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

Machine Learning · Computer Science 2023-09-07 Konstantinos Christopher Tsiolis

While Self-Supervised Learning has helped reap the benefit of the scale from the available unlabeled data, the learning paradigms are continuously being bettered. We present a new pre-training strategy named ccc-wav2vec 2.0, which uses…

Computation and Language · Computer Science 2023-05-16 Vasista Sai Lodagala , Sreyan Ghosh , S. Umesh

EEG signals are usually simple to obtain but expensive to label. Although supervised learning has been widely used in the field of EEG signal analysis, its generalization performance is limited by the amount of annotated data.…

Machine Learning · Computer Science 2021-09-17 Xue Jiang , Jianhui Zhao , Bo Du , Zhiyong Yuan

Learning-based multi-view stereo (MVS) methods have made impressive progress and surpassed traditional methods in recent years. However, their accuracy and completeness are still struggling. In this paper, we propose a new method to enhance…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Yikang Ding , Zhenyang Li , Dihe Huang , Zhiheng Li , Kai Zhang

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

Modern speaker verification systems primarily rely on speaker embeddings, followed by verification based on cosine similarity between the embedding vectors of the enrollment and test utterances. While effective, these methods struggle with…

Sound · Computer Science 2025-07-04 Wan Lin , Junhui Chen , Tianhao Wang , Zhenyu Zhou , Lantian Li , Dong Wang

Speech fluency/disfluency can be evaluated by analyzing a range of phonetic and prosodic features. Deep neural networks are commonly trained to map fluency-related features into the human scores. However, the effectiveness of deep…

Computation and Language · Computer Science 2023-05-22 Kaiqi Fu , Shaojun Gao , Shuju Shi , Xiaohai Tian , Wei Li , Zejun Ma

Spoofing-robust automatic speaker verification (SASV) aims to integrate automatic speaker verification (ASV) and countermeasure (CM). A popular solution is fusion of independent ASV and CM scores. To better modeling SASV, some frameworks…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-19 Kai Tan , Lin Zhang , Ruiteng Zhang , Johan Rohdin , Leibny Paola García-Perera , Zexin Cai , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training…

Machine Learning · Computer Science 2023-12-13 Xuyang Zhao , Tianqi Du , Yisen Wang , Jun Yao , Weiran Huang

In self-supervised learning (SSL), representations are learned via an auxiliary task without annotated labels. A common task is to classify augmentations or different modalities of the data, which share semantic content (e.g. an object in…

Machine Learning · Computer Science 2024-10-16 Alice Bizeul , Bernhard Schölkopf , Carl Allen

Conventional semi-supervised contrastive learning methods assign pseudo-labels only to samples whose highest predicted class probability exceeds a predefined threshold, and then perform supervised contrastive learning using those selected…

Machine Learning · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Self-supervised learning (SSL) has proven effective in solving various problems by generating internal supervisory signals. Unsupervised anomaly detection, which faces the high cost of obtaining true labels, is an area that can greatly…

Machine Learning · Computer Science 2023-07-14 Jaemin Yoo , Yue Zhao , Lingxiao Zhao , Leman Akoglu

Sequential Recommendationdescribes a set of techniques to model dynamic user behavior in order to predict future interactions in sequential user data. At their core, such approaches model transition probabilities between items in a…

Information Retrieval · Computer Science 2021-08-17 Zhiwei Liu , Yongjun Chen , Jia Li , Philip S. Yu , Julian McAuley , Caiming Xiong

Long-tailed semi-supervised learning poses a significant challenge in training models with limited labeled data exhibiting a long-tailed label distribution. Current state-of-the-art LTSSL approaches heavily rely on high-quality…

Machine Learning · Computer Science 2024-10-10 Zi-Hao Zhou , Siyuan Fang , Zi-Jing Zhou , Tong Wei , Yuanyu Wan , Min-Ling Zhang

This paper finds that contrastive learning can produce superior sentence embeddings for pre-trained models but is also vulnerable to backdoor attacks. We present the first backdoor attack framework, BadCSE, for state-of-the-art sentence…

Computation and Language · Computer Science 2022-10-21 Xiaoyi Chen , Baisong Xin , Shengfang Zhai , Shiqing Ma , Qingni Shen , Zhonghai Wu

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart