中文
相关论文

相关论文: Linear Regression with Shuffled Labels

200 篇论文

In this paper, we study the problem of sparse mixed linear regression on an unlabeled dataset that is generated from linear measurements from two different regression parameter vectors. Since the data is unlabeled, our task is not only to…

机器学习 · 计算机科学 2022-09-12 Adarsh Barik , Jean Honorio

We consider the problem of finding an approximate solution to $\ell_1$ regression while only observing a small number of labels. Given an $n \times d$ unlabeled data matrix $X$, we must choose a small set of $m \ll n$ rows to observe the…

机器学习 · 计算机科学 2021-05-21 Aditya Parulekar , Advait Parulekar , Eric Price

In this paper, we consider a statistical problem of learning a linear model from noisy samples. Existing work has focused on approximating the least squares solution by using leverage-based scores as an importance sampling distribution.…

机器学习 · 统计学 2016-02-11 Siheng Chen , Rohan Varma , Aarti Singh , Jelena Kovačević

This paper addresses a regression problem in which output label values are the results of sensing the magnitude of a phenomenon. A low value of such labels can mean either that the actual magnitude of the phenomenon was low or that the…

机器学习 · 计算机科学 2023-06-01 Takayuki Katsuki , Takayuki Osogami

Real-world data is frequently noisy and ambiguous. In crowdsourcing, for example, human annotators may assign conflicting class labels to the same instances. Partial-label learning (PLL) addresses this challenge by training classifiers when…

机器学习 · 计算机科学 2026-01-12 Tobias Fuchs , Nadja Klein

Noise in data appears to be inevitable in most real-world machine learning applications and would cause severe overfitting problems. Not only can data features contain noise, but labels are also prone to be noisy due to human input. In this…

机器学习 · 计算机科学 2025-05-09 Weipeng Huang , Qin Li , Yang Xiao , Cheng Qiao , Tie Cai , Junwei Liang , Neil J. Hurley , Guangyuan Piao

In semi-supervised learning, the prevailing understanding suggests that observing additional unlabeled samples improves estimation accuracy for linear parameters only in the case of model misspecification. In this work, we challenge such a…

统计方法学 · 统计学 2025-09-03 Kai Chen , Yuqian Zhang

Manual labelling of training examples is common practice in supervised learning. When the labelling task is of non-trivial difficulty, the supplied labels may not be equal to the ground-truth labels, and label noise is introduced into the…

机器学习 · 统计学 2021-04-08 Daniel Ahfock , Geoffrey J. McLachlan

We establish theoretical guarantees for the expected prediction error of the exponential weighting aggregate in the case of multivariate regression that is when the label vector is multidimensional. We consider the regression model with…

统计理论 · 数学 2018-06-26 Arnak S. Dalalyan

Learning with Noisy Labels (LNL) has attracted significant attention from the research community. Many recent LNL methods rely on the assumption that clean samples tend to have "small loss". However, this assumption always fails to…

机器学习 · 计算机科学 2022-11-17 MingCai Chen , Yu Zhao , Bing He , Zongbo Han , Bingzhe Wu , Jianhua Yao

One of the most common machine learning setups is logistic regression. In many classification models, including neural networks, the final prediction is obtained by applying a logistic link function to a linear score. In binary logistic…

机器学习 · 统计学 2026-03-24 Avrajit Ghosh , Bin Yu , Manfred Warmuth , Peter Bartlett

We propose to solve a label ranking problem as a structured output regression task. We adopt a least square surrogate loss approach that solves a supervised learning problem in two steps: the regression step in a well-chosen feature space…

机器学习 · 统计学 2018-07-09 Anna Korba , Alexandre Garcia , Florence d'Alché Buc

Partial-label learning is a popular weakly supervised learning setting that allows each training example to be annotated with a set of candidate labels. Previous studies on partial-label learning only focused on the classification setting…

机器学习 · 计算机科学 2023-06-16 Xin Cheng , Deng-Bao Wang , Lei Feng , Min-Ling Zhang , Bo An

In supervised learning, we typically leverage a fully labeled dataset to design methods for function estimation or prediction. In many practical situations, we are able to obtain alternative feedback, possibly at a low cost. A broad goal is…

机器学习 · 统计学 2020-10-27 Yichong Xu , Sivaraman Balakrishnan , Aarti Singh , Artur Dubrawski

Collecting labeled data is costly and thus a critical bottleneck in real-world classification tasks. To mitigate this problem, we propose a novel setting, namely learning from complementary labels for multi-class classification. A…

机器学习 · 统计学 2017-11-15 Takashi Ishida , Gang Niu , Weihua Hu , Masashi Sugiyama

The sample selection approach is very popular in learning with noisy labels. As deep networks learn pattern first, prior methods built on sample selection share a similar training procedure: the small-loss examples can be regarded as clean…

机器学习 · 计算机科学 2023-09-06 Xiaobo Xia , Pengqian Lu , Chen Gong , Bo Han , Jun Yu , Jun Yu , Tongliang Liu

Recent research shows that in-context learning (ICL) can be effective even when demonstrations have missing or incorrect labels. To shed light on this capability, we examine a canonical setting where the demonstrations are drawn according…

机器学习 · 计算机科学 2026-01-27 Yingcong Li , Xiangyu Chang , Muti Kara , Xiaofeng Liu , Amit Roy-Chowdhury , Samet Oymak

We develop a classification algorithm for estimating posterior distributions from positive-unlabeled data, that is robust to noise in the positive labels and effective for high-dimensional data. In recent years, several algorithms have been…

机器学习 · 统计学 2017-02-02 Shantanu Jain , Martha White , Predrag Radivojac

This paper studies the problem of shuffled linear regression, where the correspondence between predictors and responses in a linear model is obfuscated by a latent permutation. Specifically, we consider the model $y = \Pi_* X \beta_* + w$,…

统计理论 · 数学 2024-02-16 Leon Lufkin , Yihong Wu , Jiaming Xu

Label noise - incorrect labels assigned to observations - can substantially degrade the performance of supervised classifiers. This paper proposes a label noise cleaning method based on Bernoulli random sampling. We show that the mean label…

统计方法学 · 统计学 2026-03-17 Yuxin Liu , Xiong Jin , Yang Han