中文
相关论文

相关论文: Improving Self-supervised Molecular Representation…

200 篇论文

Self-supervised learning (SSL) has made enormous progress and largely narrowed the gap with the supervised ones, where the representation learning is mainly guided by a projection into an embedding space. During the projection, current…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Lang Huang , Shan You , Mingkai Zheng , Fei Wang , Chen Qian , Toshihiko Yamasaki

Despite recent advancements in deep learning, its application in real-world medical settings, such as phonocardiogram (PCG) classification, remains limited. A significant barrier is the lack of high-quality annotated datasets, which hampers…

机器学习 · 计算机科学 2025-04-08 Aristotelis Ballas , Vasileios Papapanagiotou , Christos Diou

Self-supervised learning (SSL) is a growing torrent that has recently transformed machine learning and its many real world applications, by learning on massive amounts of unlabeled data via self-generated supervisory signals. Unsupervised…

机器学习 · 计算机科学 2023-08-29 Leman Akoglu , Jaemin Yoo

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

机器学习 · 计算机科学 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective…

机器学习 · 计算机科学 2024-12-06 Mingyuan Zhou , Xudong Jian , Ye Xia , Zhilu Lai

Semi-supervised learning (SSL) has tremendous value in practice due to its ability to utilize both labeled data and unlabelled data. An important class of SSL methods is to naturally represent data as graphs such that the label information…

机器学习 · 计算机科学 2021-03-01 Zixing Song , Xiangli Yang , Zenglin Xu , Irwin King

To synthesize high-fidelity samples, diffusion models typically require auxiliary data to guide the generation process. However, it is impractical to procure the painstaking patch-level annotation effort required in specialized domains like…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Alexandros Graikos , Srikar Yellapragada , Minh-Quan Le , Saarthak Kapse , Prateek Prasanna , Joel Saltz , Dimitris Samaras

Recent semi-supervised learning (SSL) methods are commonly based on pseudo labeling. Since the SSL performance is greatly influenced by the quality of pseudo labels, mutual learning has been proposed to effectively suppress the noises in…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Pan Zhang , Bo Zhang , Ting Zhang , Dong Chen , Fang Wen

Topological Data Analysis (TDA) offers a suite of computational tools that provide quantified shape features in high dimensional data that can be used by modern statistical and predictive machine learning (ML) models. In particular,…

密码学与安全 · 计算机科学 2023-07-06 Dominic Gold , Koray Karabina , Francis C. Motta

This paper introduces a novel approach to improving the training stability of self-supervised learning (SSL) methods by leveraging a non-parametric memory of seen concepts. The proposed method involves augmenting a neural network with a…

计算机视觉与模式识别 · 计算机科学 2024-07-26 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Nowadays, supervised deep learning techniques yield the best state-of-the-art prediction performances for a wide variety of computer vision tasks. However, such supervised techniques generally require a large amount of manually labeled…

计算机视觉与模式识别 · 计算机科学 2020-06-09 Florent Chiaroni , Mohamed-Cherif Rahal , Nicolas Hueber , Frederic Dufaux

Cell recognition is a fundamental task in digital histopathology image analysis. Point-based cell recognition (PCR) methods normally require a vast number of annotations, which is extremely costly, time-consuming and labor-intensive.…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Zhongyi Shui , Yizhi Zhao , Sunyi Zheng , Yunlong Zhang , Honglin Li , Shichuan Zhang , Xiaoxuan Yu , Chenglu Zhu , Lin Yang

In this paper, we propose a new self-supervised learning (SSL) method for representations that enable logic operations. Representation learning has been applied to various tasks, such as image generation and retrieval. The logical…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Hiroki Nakamura , Masashi Okada , Tadahiro Taniguchi

3-D shape is important to chemistry, but how important? Machine learning works best when the inputs are simple and match the problem well. Chemistry datasets tend to be very small compared to those generally used in machine learning so we…

机器学习 · 计算机科学 2023-04-18 Ella Gale

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

机器学习 · 计算机科学 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

In recent years, self-supervised learning (SSL) has emerged as a promising approach for extracting valuable representations from unlabeled data. One successful SSL method is contrastive learning, which aims to bring positive examples closer…

机器学习 · 计算机科学 2023-07-20 Zeen Song , Xingzhe Su , Jingyao Wang , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

Recent advances in image-level self-supervised learning (SSL) have made significant progress, yet learning dense representations for patches remains challenging. Mainstream methods encounter an over-dispersion phenomenon that patches from…

计算机视觉与模式识别 · 计算机科学 2025-09-12 Peisong Wen , Qianqian Xu , Siran Dai , Runmin Cong , Qingming Huang

Image-level weak-to-strong consistency serves as the predominant paradigm in semi-supervised learning~(SSL) due to its simplicity and impressive performance. Nonetheless, this approach confines all perturbations to the image level and…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Zhiyu Wu , Jinshi Cui

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

计算机视觉与模式识别 · 计算机科学 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan