English
Related papers

Related papers: Confidence Sets under Weak Identification: Theory …

200 papers

We address functional uncertainty quantification for ill-posed inverse problems where it is possible to evaluate a possibly rank-deficient forward model, the observation noise distribution is known, and there are known parameter…

Methodology · Statistics 2025-02-06 Michael Stanley , Pau Batlle , Pratik Patil , Houman Owhadi , Mikael Kuusela

In this paper, we present a novel and effective inference approach to conduct both finite- and large-sample inference for high-dimensional linear regression models. This approach is developed under the so-called repro samples framework, in…

Methodology · Statistics 2025-12-01 Peng Wang , Min-Ge Xie , Linjun Zhang

We introduce PseudoNet, a new pseudolikelihood-based estimator of the inverse covariance matrix, that has a number of useful statistical and computational properties. We show, through detailed experiments with synthetic and also real-world…

Methodology · Statistics 2016-10-17 Alnur Ali , Kshitij Khare , Sang-Yun Oh , Bala Rajaratnam

Conformal prediction constructs a confidence set for an unobserved response of a feature vector based on previous identically distributed and exchangeable observations of responses and features. It has a coverage guarantee at any nominal…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye , Ichiro Takeuchi

Probabilistic graphical models offer a powerful framework to account for the dependence structure between variables, which is represented as a graph. However, the dependence between variables may render inference tasks intractable. In this…

Prediction sets capture uncertainty by predicting sets of labels rather than individual labels, enabling downstream decisions to conservatively account for all plausible outcomes. Conformal inference algorithms construct prediction sets…

Machine Learning · Statistics 2023-10-20 Wenwen Si , Sangdon Park , Insup Lee , Edgar Dobriban , Osbert Bastani

The issue of honesty in constructing confidence sets arises in nonparametric regression. While optimal rate in nonparametric estimation can be achieved and utilized to construct sharp confidence sets, severe degradation of confidence level…

Methodology · Statistics 2021-07-30 Kun Zhou , Ker-Chau Li , Qing Zhou

We propose and implement an approach to inference in linear instrumental variables models which is simultaneously robust and computationally tractable. Inference is based on self-normalization of sample moment conditions, and allows for…

Econometrics · Economics 2022-11-29 Eric Gautier , Christiern Rose

The goal of confidence-set learning in the binary classification setting is to construct two sets, each with a specific probability guarantee to cover a class. An observation outside the overlap of the two sets is deemed to be from one of…

Machine Learning · Statistics 2018-10-01 Wenbo Wang , Xingye Qiao

This paper presents a simple method for carrying out inference in a wide variety of possibly nonlinear IV models under weak assumptions. The method is non-asymptotic in the sense that it provides a finite sample bound on the difference…

Econometrics · Economics 2018-09-12 Joel L. Horowitz

We study the impact of weak identification in discrete choice models, and provide insights into the determinants of identification strength in these models. Using these insights, we propose a novel test that can consistently detect weak…

Econometrics · Economics 2021-01-21 David T. Frazier , Eric Renault , Lina Zhang , Xueyan Zhao

Certifiable, adaptive uncertainty estimates for unknown quantities are an essential ingredient of sequential decision-making algorithms. Standard approaches rely on problem-dependent concentration results and are limited to a specific…

Machine Learning · Computer Science 2023-11-09 Nicolas Emmenegger , Mojmír Mutný , Andreas Krause

This paper considers inference in a linear instrumental variable regression model with many potentially weak instruments, in the presence of heterogeneous treatment effects. I first show that existing test procedures, including those that…

Econometrics · Economics 2025-04-24 Luther Yap

Deep learning architectures have proved versatile in a number of drug discovery applications, including the modelling of in vitro compound activity. While controlling for prediction confidence is essential to increase the trust,…

Machine Learning · Computer Science 2018-10-23 Isidro Cortes-Ciriano , Andreas Bender

Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the…

Methodology · Statistics 2014-04-03 Adel Javanmard , Andrea Montanari

Inference amortization methods share information across multiple posterior-inference problems, allowing each to be carried out more efficiently. Generally, they require the inversion of the dependency structure in the generative model, as…

Machine Learning · Statistics 2018-11-30 Stefan Webb , Adam Golinski , Robert Zinkov , N. Siddharth , Tom Rainforth , Yee Whye Teh , Frank Wood

We develop a concept of weak identification in linear IV models in which the number of instruments can grow at the same rate or slower than the sample size. We propose a jackknifed version of the classical weak identification-robust…

Econometrics · Economics 2021-10-06 Anna Mikusheva , Liyang Sun

Empirical instrumental variables (IV) studies often report separate results based on low-dimensional instruments and many base instruments. This paper proposes a combination test that integrates these commonly reported statistics. The test…

Econometrics · Economics 2026-03-25 Liyu Dou , Pengjin Min , Wenjie Wang , Yichong Zhang

This paper revisits a fundamental problem in statistical inference from a non-asymptotic theoretical viewpoint $\unicode{x2013}$ the construction of confidence sets. We establish a finite-sample bound for the estimator, characterizing its…

Statistics Theory · Mathematics 2023-01-03 Lang Liu , Zaid Harchaoui

The instrumental-variables (IV) setting is standard for partial identification of causal effects when unobserved confounding makes point identification impossible. Existing approaches face methodological bottlenecks: closed-form bound…

Machine Learning · Computer Science 2026-05-14 Vahid Balazadeh , Hamidreza Kamkari , Medha Barath , Ricardo Silva , Rahul G. Krishnan