English
Related papers

Related papers: Estimating and Explaining Model Performance When B…

200 papers

Is it possible to perform linear regression on datasets whose labels are shuffled with respect to the inputs? We explore this question by proposing several estimators that recover the weights of a noisy linear model from labels that are…

Machine Learning · Statistics 2017-05-05 Abubakar Abid , Ada Poon , James Zou

A novel framework of compressed sensing, namely statistical compressed sensing (SCS), that aims at efficiently sampling a collection of signals that follow a statistical distribution, and achieving accurate reconstruction on average, is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-27 Guoshen Yu , Guillermo Sapiro

An assumption often made in supervised learning is that the training and testing sets have the same label distribution. However, in real-life scenarios, this assumption rarely holds. For example, medical diagnosis result distributions…

Machine Learning · Computer Science 2026-04-03 Yunrui Zhang , Gustavo Batista , Salil S. Kanhere

Weakly-Supervised Semantic Segmentation (WSSS) aims to train segmentation models by weak labels, which is receiving significant attention due to its low annotation cost. Existing approaches focus on generating pseudo labels for supervision…

Image and Video Processing · Electrical Eng. & Systems 2024-03-21 Linshan Wu , Zhun Zhong , Jiayi Ma , Yunchao Wei , Hao Chen , Leyuan Fang , Shutao Li

Network data are increasingly common in the social sciences and infectious disease epidemiology. Analyses often link network structure to node-level covariates, but existing methods falter with sparse networks and high-dimensional node…

Methodology · Statistics 2026-02-05 Emma G Crenshaw , Yuhua Zhang , Jukka-Pekka Onnela

Faced with distribution shift between training and test set, we wish to detect and quantify the shift, and to correct our classifiers without test set labels. Motivated by medical diagnosis, where diseases (targets) cause symptoms…

Machine Learning · Computer Science 2018-07-27 Zachary C. Lipton , Yu-Xiang Wang , Alex Smola

The paper proposes a systematic framework for building data-driven stochastic differential equation (SDE) models from sparse, noisy observations. Unlike traditional parametric approaches, which assume a known functional form for the drift,…

Machine Learning · Statistics 2025-08-18 Arnab Ganguly , Riten Mitra , Jinpu Zhou

Instance-dependent label noise is realistic but rather challenging, where the label-corruption process depends on instances directly. It causes a severe distribution shift between the distributions of training and test data, which impairs…

Machine Learning · Computer Science 2022-10-12 Manyi Zhang , Yuxin Ren , Zihao Wang , Chun Yuan

In learning tasks with label noise, improving model robustness against overfitting is a pivotal challenge because the model eventually memorizes labels, including the noisy ones. Identifying the samples with noisy labels and preventing the…

Machine Learning · Computer Science 2023-09-28 Reihaneh Torkzadehmahani , Reza Nasirigerdeh , Daniel Rueckert , Georgios Kaissis

Aiming at improving performance of visual classification in a cost-effective manner, this paper proposes an incremental semi-supervised learning paradigm called Deep Co-Space (DCS). Unlike many conventional semi-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Ziliang Chen , Keze Wang , Xiao Wang , Pai Peng , Ebroul Izquierdo , Liang Lin

Addressing runtime uncertainties in Machine Learning-Enabled Systems (MLS) is crucial for maintaining Quality of Service (QoS). The Machine Learning Model Balancer is a concept that addresses these uncertainties by facilitating dynamic ML…

Software Engineering · Computer Science 2024-02-12 Arya Marda , Shubham Kulkarni , Karthik Vaidhyanathan

We study a regression problem where for some part of the data we observe both the label variable ($Y$) and the predictors (${\bf X}$), while for other part of the data only the predictors are given. Such a problem arises, for example, when…

Statistics Theory · Mathematics 2021-04-14 David Azriel , Lawrence D. Brown , Michael Sklar , Richard Berk , Andreas Buja , Linda Zhao

Mixture models are flexible tools in density estimation and classification problems. Bayesian estimation of such models typically relies on sampling from the posterior distribution using Markov chain Monte Carlo. Label switching arises…

Applications · Statistics 2014-03-11 Wanchuang Zhu , Yanan Fan

Machine learning models, meticulously optimized for source data, often fail to predict target data when faced with distribution shifts (DSs). Previous benchmarking studies, though extensive, have mainly focused on simple DSs. Recognizing…

Machine Learning · Computer Science 2025-01-09 Myeongho Jeon , Suhwan Choi , Hyoje Lee , Teresa Yeo

Semi-supervised learning (SSL) approaches have been successfully applied in a wide range of engineering and scientific fields. This paper investigates the generative model framework with a missingness mechanism for unclassified…

Machine Learning · Statistics 2024-01-01 Ziyang Lyu

Quantification learning deals with the task of estimating the target label distribution under label shift. In this paper, we first present a unifying framework, distribution feature matching (DFM), that recovers as particular instances…

Machine Learning · Statistics 2023-07-04 Bastien Dussap , Gilles Blanchard , Badr-Eddine Chérief-Abdellatif

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

Methodology · Statistics 2011-11-21 Zhou Fang

Modern applications of machine learning (ML) deal with increasingly heterogeneous datasets comprised of data collected from overlapping latent subpopulations. As a result, traditional models trained over large datasets may fail to recognize…

Machine Learning · Statistics 2019-10-16 Benjamin Lengerich , Bryon Aragam , Eric P. Xing

Regularized regression models are well studied and, under appropriate conditions, offer fast and statistically interpretable results. However, large data in many applications are heterogeneous in the sense of harboring distributional…

Methodology · Statistics 2022-10-25 Konstantinos Perrakis , Thomas Lartigue , Frank Dondelinger , Sach Mukherjee

We propose a regression model in which the responses are spherical variables and the covariates include linear and/or spherical variables. A novel link function is introduced by extending the M\"obius transformation on the sphere. This link…

Methodology · Statistics 2025-09-09 Shogo Kato , Kassel L. Hingee , Janice L. Scealy , Andrew T. A. Wood