English
Related papers

Related papers: Adaptive confidence sets for matrix completion

200 papers

We present a new method for generating confidence sets within the split conformal prediction framework. Our method performs a trainable transformation of any given conformity score to improve conditional coverage while ensuring exact…

In statistical inference, it is rarely realistic that the hypothesized statistical model is well-specified, and consequently it is important to understand the effects of misspecification on inferential procedures. When the hypothesized…

Methodology · Statistics 2025-09-01 Beomjo Park , Sivaraman Balakrishnan , Larry Wasserman

The accurate representation of epistemic uncertainty is a challenging yet essential task in machine learning. A widely used representation corresponds to convex sets of probabilistic predictors, also known as credal sets. One popular way of…

Machine Learning · Computer Science 2025-07-30 Mira Jürgens , Thomas Mortier , Eyke Hüllermeier , Viktor Bengs , Willem Waegeman

We investigate two empirical Bayes methods and a hierarchical Bayes method for adapting the scale of a Gaussian process prior in a nonparametric regression model. We show that all methods lead to a posterior contraction rate that adapts to…

Statistics Theory · Mathematics 2015-04-30 Suzanne Sniekers , Aad van der Vaart

We extend the method of conformal prediction beyond the case relying on labeled calibration data. Replacing the calibration scores by suitable estimates, we identify conformity sets $C$ for classification and regression models that rely on…

Methodology · Statistics 2025-09-15 Jonas Flechsig , Maximilian Pilz

This study develops a framework for testing hypotheses on structural parameters in incomplete models. Such models make set-valued predictions and hence do not generally yield a unique likelihood function. The model structure, however,…

Econometrics · Economics 2019-12-03 Hiroaki Kaido , Yi Zhang

We focus on causal discovery in the presence of measurement error in linear systems where the mixing matrix, i.e., the matrix indicating the independent exogenous noise terms pertaining to the observed variables, is identified up to…

Machine Learning · Computer Science 2022-11-09 Yuqin Yang , AmirEmad Ghassami , Mohamed Nafea , Negar Kiyavash , Kun Zhang , Ilya Shpitser

We develop a conformal inference method to construct a joint confidence region for a given group of missing entries within a sparsely observed matrix, focusing primarily on entries from the same column. Our method is model-agnostic and can…

Methodology · Statistics 2025-02-11 Ziyi Liang , Tianmin Xie , Xin Tong , Matteo Sesia

Understanding statistical inference under possibly non-sparse high-dimensional models has gained much interest recently. For a given component of the regression coefficient, we show that the difficulty of the problem depends on the sparsity…

Statistics Theory · Mathematics 2022-08-22 Jelena Bradic , Jianqing Fan , Yinchu Zhu

This manuscript studies a general approach to construct confidence sets for the solution of stochastic optimization, rendering empirical risk minimization as special cases. Statistical inference for stochastic optimization poses significant…

Statistics Theory · Mathematics 2026-05-22 Kenta Takatsu , Arun Kumar Kuchibhotla

In structured system theory, a pattern matrix is a matrix with entries either fixed to zero or free to take arbitrary numbers. The (generic) rank of a pattern matrix is the rank of almost all its realizations. The resilience of various…

Information Theory · Computer Science 2024-11-19 Yuan Zhang , Yuanqing Xia , Gang Wang

We introduce credal two-sample testing, a new hypothesis testing framework for comparing credal sets -- convex sets of probability measures where each element captures aleatoric uncertainty and the set itself represents epistemic…

Machine Learning · Statistics 2025-03-14 Siu Lun Chau , Antonin Schrab , Arthur Gretton , Dino Sejdinovic , Krikamol Muandet

This paper develops new tools to quantify uncertainty in optimal decision making and to gain insight into which variables one should collect information about given the potential cost of measuring a large number of variables. We investigate…

Methodology · Statistics 2021-05-11 Yunan Wu , Lan Wang , Haoda Fu

We consider the matrix completion problem with a deterministic pattern of observed entries. In this setting, we aim to answer the question: under what condition there will be (at least locally) unique solution to the matrix completion…

Machine Learning · Computer Science 2019-01-30 Alexander Shapiro , Yao Xie , Rui Zhang

Reliable Confidence Estimates are hugely important for any machine learning model to be truly useful. In this paper, we argue that any confidence estimates based upon standard machine learning point prediction algorithms are fundamentally…

Machine Learning · Computer Science 2021-09-06 Rhys Green , Matthew Rowe , Alberto Polleri

Regression modeling is the workhorse of statistics and there is a vast literature on estimation of the regression function. It is realized in recent years that in regression analysis the ultimate aim may be the estimation of a level set of…

Methodology · Statistics 2022-07-27 Fang Wan , Wei Liu , Frank Bretz

We construct minimax optimal non-asymptotic confidence sets for low rank matrix recovery algorithms such as the Matrix Lasso or Dantzig selector. These are employed to devise adaptive sequential sampling procedures that guarantee recovery…

Statistics Theory · Mathematics 2019-12-10 Alexandra Carpentier , Jens Eisert , David Gross , Richard Nickl

Matrix completion is a modern missing data problem where both the missing structure and the underlying parameter are high dimensional. Although missing structure is a key component to any missing data problems, existing matrix completion…

Machine Learning · Statistics 2020-03-23 Xiaojun Mao , Raymond K. W. Wong , Song Xi Chen

Artificial intelligence is applied in a range of sectors, and is relied upon for decisions requiring a high level of trust. For regression methods, trust is increased if they approximate the true input-output relationships and perform…

Machine Learning · Computer Science 2021-05-05 A. I. Parkes , A. J. Sobey , D. A. Hudson

Learning-to-rank (LTR) is a class of supervised learning techniques that apply to ranking problems dealing with a large number of features. The popularity and widespread application of LTR models in prioritizing information in a variety of…

Machine Learning · Computer Science 2020-05-19 Jaspreet Singh , Zhenye Wang , Megha Khosla , Avishek Anand