English
Related papers

Related papers: Towards Self-Supervised Covariance Estimation in D…

200 papers

Uncertainty quantification (UQ) in deep learning regression is of wide interest, as it supports critical applications including sequential decision making and risk-sensitive tasks. In heteroskedastic regression, where the uncertainty of the…

Machine Learning · Computer Science 2026-03-03 Mikkel Jordahn , Jonas Vestergaard Jensen , James Harrison , Michael Riis Andersen , Mikkel N. Schmidt

Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Nir Ailon

Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool.…

Computation and Language · Computer Science 2022-12-21 Mozhdeh Gheini , Tatiana Likhomanenko , Matthias Sperber , Hendra Setiawan

Neural sequence labeling (NSL) aims at assigning labels for input language tokens, which covers a broad range of applications, such as named entity recognition (NER) and slot filling, etc. However, the satisfying results achieved by…

Computation and Language · Computer Science 2023-02-20 Jianing Wang , Chengyu Wang , Jun Huang , Ming Gao , Aoying Zhou

The problem of fully supervised classification is that it requires a tremendous amount of annotated data, however, in many datasets a large portion of data is unlabeled. To alleviate this problem semi-supervised learning (SSL) leverages the…

Machine Learning · Computer Science 2022-07-26 Ehsan Kazemi

In machine learning, one must acquire labels to help supervise a model that will be able to generalize to unseen data. However, the labeling process can be tedious, long, costly, and error-prone. It is often the case that most of our data…

Machine Learning · Computer Science 2020-09-29 Bruno Klaus de Aquino Afonso , Lilian Berton

Self-supervised learning aims to learn representations from the data itself without explicit manual supervision. Existing efforts ignore a crucial aspect of self-supervised learning - the ability to scale to large amount of data because…

Computer Vision and Pattern Recognition · Computer Science 2019-06-07 Priya Goyal , Dhruv Mahajan , Abhinav Gupta , Ishan Misra

Semi-supervised learning has the potential to improve the data-efficiency of training data-hungry deep neural networks, which is especially important for medical image analysis tasks where labeled data is scarce. In this work, we present a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Boon Peng Yap , Beng Koon Ng

Few-shot node classification poses a significant challenge for Graph Neural Networks (GNNs) due to insufficient supervision and potential distribution shifts between labeled and unlabeled nodes. Self-training has emerged as a widely popular…

Machine Learning · Computer Science 2024-01-22 Fali Wang , Tianxiang Zhao , Suhang Wang

The scarcity of labeled data often limits the application of supervised deep learning techniques for medical image segmentation. This has motivated the development of semi-supervised techniques that learn from a mixture of labeled and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Gerda Bortsova , Florian Dubost , Laurens Hogeweg , Ioannis Katramados , Marleen de Bruijne

We study the problem of treatment effect estimation in randomized experiments with high-dimensional covariate information, and show that essentially any risk-consistent regression adjustment can be used to obtain efficient estimates of the…

Methodology · Statistics 2022-06-08 Stefan Wager , Wenfei Du , Jonathan Taylor , Robert Tibshirani

The problem of estimating the probability distribution of labels has been widely studied as a label distribution learning (LDL) problem, whose applications include age estimation, emotion analysis, and semantic segmentation. We propose a…

Machine Learning · Computer Science 2021-03-02 Ayato Toyokuni , Sho Yokoi , Hisashi Kashima , Makoto Yamada

Distribution regression refers to the supervised learning problem where labels are only available for groups of inputs instead of individual inputs. In this paper, we develop a rigorous mathematical framework for distribution regression…

Machine Learning · Computer Science 2021-09-30 Maud Lemercier , Cristopher Salvi , Theodoros Damoulas , Edwin V. Bonilla , Terry Lyons

Regressing 3D rotations of objects from 2D images is a crucial yet challenging task, with broad applications in autonomous driving, virtual reality, and robotic control. Existing rotation regression models often rely on large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Mei Li , Huayi Zhou , Suizhi Huang , Yuxiang Lu , Yue Ding , Hongtao Lu

Graph-based semi-supervised regression (SSR) is the problem of estimating the value of a function on a weighted graph from its values (labels) on a small subset of the vertices. This paper is concerned with the consistency of SSR in the…

Machine Learning · Statistics 2021-10-27 Andrea L. Bertozzi , Bamdad Hosseini , Hao Li , Kevin Miller , Andrew M. Stuart

Competitive point cloud semantic segmentation results usually rely on a large amount of labeled data. However, data annotation is a time-consuming and labor-intensive task, particularly for three-dimensional point cloud data. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Puzuo Wang , Wei Yao

While supervised learning has achieved remarkable success, obtaining large-scale labeled datasets in biomedical imaging is often impractical due to high costs and the time-consuming annotations required from radiologists. Semi-supervised…

Image and Video Processing · Electrical Eng. & Systems 2024-01-19 Yuanbin Chen , Tao Wang , Hui Tang , Longxuan Zhao , Ruige Zong , Shun Chen , Tao Tan , Xinlin Zhang , Tong Tong

Supervised deep learning performance is heavily tied to the availability of high-quality labels for training. Neural networks can gradually overfit corrupted labels if directly trained on noisy datasets, leading to severe performance…

Machine Learning · Computer Science 2021-02-02 Ziyi Huang , Haofeng Zhang , Andrew Laine , Elsa Angelini , Christine Hendon , Yu Gan

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Unsupervised Domain Adaptation aims to learn a model on a source domain with labeled data in order to perform well on unlabeled data of a target domain. Current approaches focus on learning \textit{Domain Invariant Representations}. It…

Machine Learning · Computer Science 2019-07-30 Victor Bouvier , Philippe Very , Céline Hudelot , Clément Chastagnol