中文
相关论文

相关论文: Meta-Learning Update Rules for Unsupervised Repres…

200 篇论文

Applying machine learning to tasks that operate with code changes requires their numerical representation. In this work, we propose an approach for obtaining such representations during pre-training and evaluate them on two different…

软件工程 · 计算机科学 2021-07-12 Mikhail Pravilov , Egor Bogomolov , Yaroslav Golubev , Timofey Bryksin

Neural network-based anomaly detection methods have shown to achieve high performance. However, they require a large amount of training data for each task. We propose a neural network-based meta-learning method for supervised anomaly…

机器学习 · 统计学 2021-03-02 Tomoharu Iwata , Atsutoshi Kumagai

The amount of manually labeled data is limited in medical applications, so semi-supervised learning and automatic labeling strategies can be an asset for training deep neural networks. However, the quality of the automatically generated…

机器学习 · 计算机科学 2022-03-04 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Representation learning with small labeled data have emerged in many problems, since the success of deep neural networks often relies on the availability of a huge amount of labeled data that is expensive to collect. To address it, many…

计算机视觉与模式识别 · 计算机科学 2021-01-05 Guo-Jun Qi , Jiebo Luo

Training deep neural networks requires massive amounts of training data, but for many tasks only limited labeled data is available. This makes weak supervision attractive, using weak or noisy signals like the output of heuristic methods or…

机器学习 · 计算机科学 2017-12-08 Mostafa Dehghani , Aliaksei Severyn , Sascha Rothe , Jaap Kamps

Few-shot or one-shot learning of classifiers requires a significant inductive bias towards the type of task to be learned. One way to acquire this is by meta-learning on tasks similar to the target task. In this paper, we propose UMTRA, an…

计算机视觉与模式识别 · 计算机科学 2019-11-11 Siavash Khodadadeh , Ladislau Bölöni , Mubarak Shah

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Learning the optimized solution as a function of environmental parameters is effective in solving numerical optimization in real time for time-sensitive applications. Existing works of learning to optimize train deep neural networks (DNN)…

机器学习 · 计算机科学 2019-05-28 Chengjian Sun , Chenyang Yang

Deep learning perception models require a massive amount of labeled training data to achieve good performance. While unlabeled data is easy to acquire, the cost of labeling is prohibitive and could create a tremendous burden on companies or…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Xinnan Du , William Zhang , Jose M. Alvarez

Semi-supervised learning algorithms attempt to take advantage of relatively inexpensive unlabeled data to improve learning performance. In this work, we consider statistical models where the data distributions can be characterized by…

机器学习 · 计算机科学 2023-07-18 Jingge Zhu

Unsupervised learning allows us to leverage unlabelled data, which has become abundantly available, and to create embeddings that are usable on a variety of downstream tasks. However, the typical lack of interpretability of unsupervised…

机器学习 · 计算机科学 2023-09-29 Gregory Scafarto , Madalina Ciortan , Simon Tihon , Quentin Ferre

Semi-supervised learning is a setting in which one has labeled and unlabeled data available. In this survey we explore different types of theoretical results when one uses unlabeled data in classification and regression tasks. Most methods…

机器学习 · 计算机科学 2020-07-31 Alexander Mey , Marco Loog

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of unclassified data, to perform a classification in situations when, typically, there is little labeled data. Even though this is not…

机器学习 · 统计学 2020-12-11 Alejandro Cholaquidis , Ricardo Fraiman , Mariela Sued

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used…

计算与语言 · 计算机科学 2018-11-02 Shao-Yen Tseng , Brian Baucom , Panayiotis Georgiou

We present a novel self-taught framework for unsupervised metric learning, which alternates between predicting class-equivalence relations between data through a moving average of an embedding model and learning the model with the predicted…

计算机视觉与模式识别 · 计算机科学 2022-05-05 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

机器学习 · 计算机科学 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Self-supervised learning aims to learn good representations with unlabeled data. Recent works have shown that larger models benefit more from self-supervised learning than smaller models. As a result, the gap between supervised and…

计算机视觉与模式识别 · 计算机科学 2020-10-29 Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

This article reviews meta-learning also known as learning-to-learn which seeks rapid and accurate model adaptation to unseen tasks with applications in highly automated AI, few-shot learning, natural language processing and robotics. Unlike…

机器学习 · 计算机科学 2020-10-27 Huimin Peng

Few-shot meta-learning methods consider the problem of learning new tasks from a small, fixed number of examples, by meta-learning across static data from a set of previous tasks. However, in many real world settings, it is more natural to…

机器学习 · 计算机科学 2020-12-15 Tianhe Yu , Xinyang Geng , Chelsea Finn , Sergey Levine

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

机器学习 · 计算机科学 2020-07-03 Huanru Henry Mao