English
Related papers

Related papers: Practical targeted learning from large data sets b…

200 papers

Supervisory signals have the potential to make low-dimensional data representations, like those learned by mixture and topic models, more interpretable and useful. We propose a framework for training latent variable models that explicitly…

In risk-sensitive learning, one aims to find a hypothesis that minimizes a risk-averse (or risk-seeking) measure of loss, instead of the standard expected loss. In this paper, we propose to study the generalization properties of…

Machine Learning · Statistics 2021-01-05 Jaeho Lee , Sejun Park , Jinwoo Shin

In this paper, we present a simple and efficient method for training deep neural networks in a semi-supervised setting where only a small portion of training data is labeled. We introduce self-ensembling, where we form a consensus…

Neural and Evolutionary Computing · Computer Science 2017-03-16 Samuli Laine , Timo Aila

Non-parametric maximum likelihood estimation encompasses a group of classic methods to estimate distribution-associated functions from potentially censored and truncated data, with extensive applications in survival analysis. These methods,…

Methodology · Statistics 2021-08-05 Justin D. Tubbs , Lane Guolan Chen , Thuan Quoc Thach , Pak C. Sham

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

Machine Learning · Computer Science 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

Random-effects models are central to meta-analysis, yet the between-study variance is often underestimated when the number of studies is small. In such settings, confidence intervals become unduly narrow and fail to attain the nominal…

Methodology · Statistics 2025-11-18 Keisuke Hanada , Tomoyuki Sugimoto

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled during training. However, losses are generated on-the-fly based on the model being trained with noisy labels,…

Machine Learning · Computer Science 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama

We study the sample complexity of learning threshold functions under the constraint of differential privacy. It is assumed that each labeled example in the training data is the information of one individual and we would like to come up with…

Data Structures and Algorithms · Computer Science 2019-11-25 Haim Kaplan , Katrina Ligett , Yishay Mansour , Moni Naor , Uri Stemmer

In this work, we propose a simple yet effective semi-supervised learning approach called Augmented Distribution Alignment. We reveal that an essential sampling bias exists in semi-supervised learning due to the limited number of labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Qin Wang , Wen Li , Luc Van Gool

Empirical risk minimization is the main tool for prediction problems, but its extension to relational data remains unsolved. We solve this problem using recent ideas from graph sampling theory to (i) define an empirical risk for relational…

Machine Learning · Statistics 2019-02-25 Victor Veitch , Morgane Austern , Wenda Zhou , David M. Blei , Peter Orbanz

Subsampling is a computationally efficient and scalable method to draw inference in large data settings based on a subset of the data rather than needing to consider the whole dataset. When employing subsampling techniques, a crucial…

Methodology · Statistics 2025-10-08 Amalan Mahendran , Helen Thompson , James M. McGree

We discuss a new way of constructing pointwise confidence intervals for the distribution function in the current status model. The confidence intervals are based on the smoothed maximum likelihood estimator (SMLE) and constructed using…

Statistics Theory · Mathematics 2017-03-27 Piet Groeneboom , Kim Hendrickx

Unsupervised estimation of latent variable models is a fundamental problem central to numerous applications of machine learning and statistics. This work presents a principled approach for estimating broad classes of such models, including…

Machine Learning · Statistics 2013-05-27 Animashree Anandkumar , Daniel Hsu , Adel Javanmard , Sham M. Kakade

This paper is concerned with learning decision makers' preferences using data on observed choices from a finite set of risky alternatives. We propose a discrete choice model with unobserved heterogeneity in consideration sets and in…

Econometrics · Economics 2021-01-07 Levon Barseghyan , Francesca Molinari , Matthew Thirkettle

Few-shot learning is a rapidly evolving area of research in machine learning where the goal is to classify unlabeled data with only one or "a few" labeled exemplary samples. Neural networks are typically trained to minimize a distance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Samuel Hess , Gregory Ditzler

Obtaining high certainty in predictive models is crucial for making informed and trustworthy decisions in many scientific and engineering domains. However, extensive experimentation required for model accuracy can be both costly and…

Machine Learning · Computer Science 2024-12-17 Giorgio Morales , John Sheppard

Tuning parameters are parameters involved in an estimating procedure for the purpose of reducing the risk of some other estimator. Examples include the degree of penalization in penalized regression and likelihood problems, as well as the…

Statistics Theory · Mathematics 2026-03-31 Ingrid Dæhlen , Nils Lid Hjort , Ingrid Hobæk Haff

Learning the minimum/maximum mean among a finite set of distributions is a fundamental sub-task in planning, game tree search and reinforcement learning. We formalize this learning task as the problem of sequentially testing how the minimum…

Machine Learning · Statistics 2018-06-05 Emilie Kaufmann , Wouter Koolen , Aurelien Garivier

In situations with non-manipulable exposures, interventions can be targeted to shift the distribution of intermediate variables between exposure groups to define interventional disparity indirect effects. In this work, we present a…

Methodology · Statistics 2023-05-18 Helene C. W. Rytgaard , Amalie Lykkemark Møller , Thomas A. Gerds

The limit distribution of the nonparametric maximum likelihood estimator for interval censored data with more than one observation time per unobservable observation, is still unknown in general. For the so-called separated case, where one…

Statistics Theory · Mathematics 2026-02-12 Piet Groeneboom