中文
相关论文

相关论文: SimPer: Simple Self-Supervised Learning of Periodi…

200 篇论文

Self-supervised learning (SSL) has recently achieved impressive performance on various time series tasks. The most prominent advantage of SSL is that it reduces the dependence on labeled data. Based on the pre-training and fine-tuning…

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

机器学习 · 计算机科学 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Recently, there has been a significant advancement in designing Self-Supervised Learning (SSL) frameworks for time series data to reduce the dependency on data labels. Among these works, hierarchical contrastive learning-based SSL…

机器学习 · 计算机科学 2025-02-18 Kevin Garcia , Juan Manuel Perez , Yifeng Gao

Semi-supervised learning (SSL) has witnessed great progress with various improvements in the self-training framework with pseudo labeling. The main challenge is how to distinguish high-quality pseudo labels against the confirmation bias.…

机器学习 · 计算机科学 2024-02-21 Siyuan Li , Weiyang Jin , Zedong Wang , Fang Wu , Zicheng Liu , Cheng Tan , Stan Z. Li

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

We propose SigCLR: Sigmoid Contrastive Learning of Visual Representations. SigCLR utilizes the logistic loss that only operates on pairs and does not require a global view as in the cross-entropy loss used in SimCLR. We show that logistic…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Ömer Veysel Çağatan

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

机器学习 · 计算机科学 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Personalized search plays a crucial role in improving user search experience owing to its ability to build user profiles based on historical behaviors. Previous studies have made great progress in extracting personal signals from the query…

信息检索 · 计算机科学 2021-11-25 Yujia Zhou , Zhicheng Dou , Yutao Zhu , Ji-Rong Wen

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

机器学习 · 计算机科学 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Detection of periodic patterns of interest within noisy time series data plays a critical role in various tasks, spanning from health monitoring to behavior analysis. Existing learning techniques often rely on labels or clean versions of…

机器学习 · 计算机科学 2025-06-24 Berken Utku Demirel , Christian Holz

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

机器学习 · 计算机科学 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

机器学习 · 计算机科学 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

In recent years, semi-supervised learning (SSL) has shown tremendous success in leveraging unlabeled data to improve the performance of deep learning models, which significantly reduces the demand for large amounts of labeled data. Many SSL…

机器学习 · 计算机科学 2020-06-02 Song-Bo Yang , Tian-li Yu

Semi-supervised learning (SSL) has been a powerful strategy to incorporate few labels in learning better representations. In this paper, we focus on a practical scenario that one aims to apply SSL when unlabeled data may contain…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Jongjin Park , Sukmin Yun , Jongheon Jeong , Jinwoo Shin

In the realms of computer vision, it is evident that deep neural networks perform better in a supervised setting with a large amount of labeled data. The representations learned with supervision are not only of high quality but also helps…

机器学习 · 计算机科学 2020-09-28 Souradip Chakraborty , Aritra Roy Gosthipaty , Sayak Paul

Semi-supervised learning (SSL) can reduce the need for large labelled datasets by incorporating unlabelled data into the training. This is particularly interesting for semantic segmentation, where labelling data is very costly and…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Sebastian Scherer , Robin Schön , Rainer Lienhart

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

机器人学 · 计算机科学 2024-10-18 Ankit Shaw

Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scenarios where the…

机器学习 · 计算机科学 2024-10-30 Yulin Wang , Jiayi Guo , Shiji Song , Gao Huang

Self-supervised learning (SSL) is a powerful tool in machine learning, but understanding the learned representations and their underlying mechanisms remains a challenge. This paper presents an in-depth empirical analysis of SSL-trained…

机器学习 · 计算机科学 2023-06-01 Ido Ben-Shaul , Ravid Shwartz-Ziv , Tomer Galanti , Shai Dekel , Yann LeCun