中文
相关论文

相关论文: On the Provable Advantage of Unsupervised Pretrain…

200 篇论文

Semi-supervised learning has attracted significant attention due to the proliferation of applications featuring limited labeled data but abundant unlabeled data. In this paper, we examine the statistical inference problem in an…

统计方法学 · 统计学 2026-03-31 Chao Ying , Siyi Deng , Yang Ning , Jiwei Zhao , Heping Zhang

Recent studies have shown great promise in unsupervised representation learning (URL) for multivariate time series, because URL has the capability in learning generalizable representation for many downstream tasks without using inaccessible…

机器学习 · 计算机科学 2024-08-20 Zhiyu Liang , Jianfeng Zhang , Chen Liang , Hongzhi Wang , Zheng Liang , Lujia Pan

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

机器学习 · 计算机科学 2021-02-12 Mengjiao Yang , Ofir Nachum

While semi-supervised learning (SSL) algorithms provide an efficient way to make use of both labelled and unlabelled data, they generally struggle when the number of annotated samples is very small. In this work, we consider the problem of…

计算机视觉与模式识别 · 计算机科学 2020-04-23 Sylvestre-Alvise Rebuffi , Sebastien Ehrhardt , Kai Han , Andrea Vedaldi , Andrew Zisserman

Parameter prediction is essential for many applications, facilitating insightful interpretation and decision-making. However, in many real life domains, such as power systems, medicine, and engineering, it can be very expensive to acquire…

机器学习 · 计算机科学 2024-02-16 Zimeng Lyu , Alexander Ororbia , Rui Li , Travis Desell

Amortized Bayesian inference (ABI) with neural networks can solve probabilistic inverse problems orders of magnitude faster than classical methods. However, ABI is not yet sufficiently robust for widespread and safe application. When…

The premise of semi-supervised learning (SSL) is that combining labeled and unlabeled data yields significantly more accurate models. Despite empirical successes, the theoretical understanding of SSL is still far from complete. In this…

机器学习 · 统计学 2024-09-06 Eyar Azar , Boaz Nadler

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

机器学习 · 统计学 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

One of the ways to improve the performance of a target task is to learn the transfer of abundant knowledge of a pre-trained network. However, learning of the pre-trained network requires high computation capability and large-scale labeled…

计算机视觉与模式识别 · 计算机科学 2019-08-30 Dae Ha Kim , Seung Hyun Lee , Byung Cheol Song

Unsupervised/self-supervised pre-training methods for graph representation learning have recently attracted increasing research interests, and they are shown to be able to generalize to various downstream applications. Yet, the adversarial…

机器学习 · 计算机科学 2021-05-31 Jiarong Xu , Yang Yang , Junru Chen , Chunping Wang , Xin Jiang , Jiangang Lu , Yizhou Sun

Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model…

计算机视觉与模式识别 · 计算机科学 2019-10-01 Xinzhe Li , Qianru Sun , Yaoyao Liu , Shibao Zheng , Qin Zhou , Tat-Seng Chua , Bernt Schiele

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of unclassified data, to perform a classification in situations when, typically, there is little labeled data. Even though this is not…

机器学习 · 统计学 2020-12-11 Alejandro Cholaquidis , Ricardo Fraiman , Mariela Sued

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Consider semi-supervised learning for classification, where both labeled and unlabeled data are available for training. The goal is to exploit both datasets to achieve higher prediction accuracy than just using labeled data alone. We…

机器学习 · 统计学 2019-06-20 Xinwei Zhang , Zhiqiang Tan

Unsupervised pre-training can equip reinforcement learning agents with prior knowledge and accelerate learning in downstream tasks. A promising direction, grounded in human development, investigates agents that learn by setting and pursuing…

机器学习 · 计算机科学 2026-01-28 Octavio Pappalardo

Unsupervised reinforcement learning (URL) poses a promising paradigm to learn useful behaviors in a task-agnostic environment without the guidance of extrinsic rewards to facilitate the fast adaptation of various downstream tasks. Previous…

机器学习 · 计算机科学 2023-02-23 Yifu Yuan , Jianye Hao , Fei Ni , Yao Mu , Yan Zheng , Yujing Hu , Jinyi Liu , Yingfeng Chen , Changjie Fan

A straightforward application of semi-supervised machine learning to the problem of treatment effect estimation would be to consider data as "unlabeled" if treatment assignment and covariates are observed but outcomes are unobserved.…

统计方法学 · 统计学 2020-09-15 Andrew Herren , P. Richard Hahn

Most existing few-shot learning (FSL) methods require a large amount of labeled data in meta-training, which is a major limit. To reduce the requirement of labels, a semi-supervised meta-training (SSMT) setting has been proposed for FSL,…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Xingping Dong , Tianran Ouyang , Shengcai Liao , Bo Du , Ling Shao

From only positive (P) and unlabeled (U) data, a binary classifier could be trained with PU learning, in which the state of the art is unbiased PU learning. However, if its model is very flexible, empirical risks on training data will go…

机器学习 · 计算机科学 2017-11-07 Ryuichi Kiryo , Gang Niu , Marthinus C. du Plessis , Masashi Sugiyama

In this paper, we address learning problems for high dimensional data. Previously, oblivious random projection based approaches that project high dimensional features onto a random subspace have been used in practice for tackling…

机器学习 · 计算机科学 2016-12-07 Yi Xu , Haiqin Yang , Lijun Zhang , Tianbao Yang