English
Related papers

Related papers: Generalization for Adaptively-chosen Estimators vi…

200 papers

Data that is gathered adaptively --- via bandit algorithms, for example --- exhibits bias. This is true both when gathering simple numeric valued data --- the empirical means kept track of by stochastic bandit algorithms are biased…

Machine Learning · Computer Science 2018-06-07 Seth Neel , Aaron Roth

The adaptive Iterative Soft-Thresholding Algorithm (ISTA) has been a popular algorithm for finding a desirable solution to the LASSO problem without explicitly tuning the regularization parameter $\lambda$. Despite that the adaptive ISTA is…

Machine Learning · Statistics 2025-07-04 Yining Feng , Ivan Selesnick

(Gradient) Expectation Maximization (EM) is a widely used algorithm for estimating the maximum likelihood of mixture models or incomplete data problems. A major challenge facing this popular technique is how to effectively preserve the…

Machine Learning · Computer Science 2022-01-19 Di Wang , Jiahao Ding , Lijie Hu , Zejun Xie , Miao Pan , Jinhui Xu

We introduce local expectation gradients which is a general purpose stochastic variational inference algorithm for constructing stochastic gradients through sampling from the variational distribution. This algorithm divides the problem of…

Machine Learning · Statistics 2015-03-06 Michalis K. Titsias

There are several applications of stochastic optimization where one can benefit from a robust estimate of the gradient. For example, domains such as distributed learning with corrupted nodes, the presence of large outliers in the training…

Machine Learning · Statistics 2025-10-30 Fabian Schaipp , Guillaume Garrigos , Umut Simsekli , Robert Gower

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu

In this paper, we initiate a principled study of how the generalization properties of approximate differential privacy can be used to perform adaptive hypothesis testing, while giving statistically valid $p$-value corrections. We do this by…

Machine Learning · Computer Science 2016-09-12 Ryan Rogers , Aaron Roth , Adam Smith , Om Thakkar

We consider the problem of mean estimation under user-level local differential privacy, where $n$ users are contributing through their local pool of data samples. Previous work assume that the number of data samples is the same across…

Methodology · Statistics 2024-10-15 Corentin Pla , Hugo Richard , Maxime Vono

We study the design of differentially private algorithms for adaptive analysis of dynamically growing databases, where a database accumulates new data entries while the analysis is ongoing. We provide a collection of tools for machine…

Data Structures and Algorithms · Computer Science 2018-03-20 Rachel Cummings , Sara Krehbiel , Kevin A. Lai , Uthaipon Tantipongpipat

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey

We study person-level differentially private (DP) mean estimation in the case where each person holds multiple samples. DP here requires the usual notion of distributional stability when $\textit{all}$ of a person's datapoints can be…

Data Structures and Algorithms · Computer Science 2024-07-22 Sushant Agarwal , Gautam Kamath , Mahbod Majid , Argyris Mouzakis , Rose Silver , Jonathan Ullman

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

Methodology · Statistics 2009-05-16 Nicolai Meinshausen , Peter Buehlmann

Reachability analysis is an important method in providing safety guarantees for systems with unknown or uncertain dynamics. Due to the computational intractability of exact reachability analysis for general nonlinear, high-dimensional…

Systems and Control · Electrical Eng. & Systems 2025-09-12 Elizabeth Dietrich , Rosalyn Devonport , Stephen Tu , Murat Arcak

The machine learning literature contains several constructions for prediction intervals that are intuitively reasonable but ultimately ad-hoc in that they do not come with provable performance guarantees. We present methods from the…

Machine Learning · Statistics 2020-02-25 Danijel Kivaranovic , Kory D. Johnson , Hannes Leeb

Transformer-based scientific foundation models are increasingly deployed in high-stakes settings, but current architectures give deterministic outputs and provide limited support for calibrated predictive uncertainty. We propose Stochastic…

Machine Learning · Computer Science 2026-05-12 Akash Yadav , Taiwo A. Adebiyi , Ruda Zhang

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

A new line of work [Dwork et al. STOC 2015], [Hardt and Ullman FOCS 2014], [Steinke and Ullman COLT 2015], [Bassily et al. STOC 2016] demonstrates how differential privacy [Dwork et al. TCC 2006] can be used as a mathematical tool for…

Machine Learning · Computer Science 2017-03-07 Kobbi Nissim , Uri Stemmer

Robust estimators, like the median of a point set, are important for data analysis in the presence of outliers. We study robust estimators for locationally uncertain points with discrete distributions. That is, each point in a data set has…

Discrete Mathematics · Computer Science 2018-03-14 Kevin Buchin , Jeff M. Phillips , Pingfan Tang

We design an $(\varepsilon, \delta)$-differentially private algorithm to estimate the mean of a $d$-variate distribution, with unknown covariance $\Sigma$, that is adaptive to $\Sigma$. To within polylogarithmic factors, the estimator…

Machine Learning · Statistics 2023-01-18 John Duchi , Saminul Haque , Rohith Kuditipudi

We establish a data-dependent notion of algorithmic stability for Stochastic Gradient Descent (SGD), and employ it to develop novel generalization bounds. This is in contrast to previous distribution-free algorithmic stability results for…

Machine Learning · Computer Science 2018-02-19 Ilja Kuzborskij , Christoph H. Lampert