English
Related papers

Related papers: Debiased Inference for High-Dimensional Regression…

200 papers

In this article the package High-dimensional Metrics (\texttt{hdm}) is introduced. It is a collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on…

Methodology · Statistics 2017-09-28 Victor Chernozhukov , Chris Hansen , Martin Spindler

Learning probabilistic models that can estimate the density of a given set of samples, and generate samples from that density, is one of the fundamental challenges in unsupervised machine learning. We introduce a new generative model based…

Machine Learning · Computer Science 2020-06-11 Siavash A. Bigdeli , Geng Lin , Tiziano Portenier , L. Andrea Dunbar , Matthias Zwicker

Purpose: Biophysical tissue models are increasingly used in the interpretation of diffusion MRI (dMRI) data, with the potential to provide specific biomarkers of brain microstructural changes. However, the general Standard Model has…

Biological Physics · Physics 2019-03-19 Santiago Coelho , Jose M. Pozo , Sune N. Jespersen , Derek K. Jones , Alejandro F. Frangi

Double (debiased) machine learning (DML) has seen widespread use in recent years for learning causal/structural parameters, in part due to its flexibility and adaptability to high-dimensional nuisance functions as well as its ability to…

Methodology · Statistics 2024-09-12 Abhinandan Dalal , Patrick Blöbaum , Shiva Kasiviswanathan , Aaditya Ramdas

Random-effects meta-analyses are very commonly used in medical statistics. Recent methodological developments include multivariate (multiple outcomes) and network (multiple treatments) meta-analysis. Here we provide a new model and…

Methodology · Statistics 2017-08-16 Dan Jackson , Sylwia Bujkiewicz , Martin Law , Richard D Riley , Ian White

Dimensionality reduction is essential in simulation-based shape design, where high-dimensional parameterizations hinder optimization, surrogate modeling, and systematic design-space exploration. Parametric Model Embedding (PME) addresses…

Computational Engineering, Finance, and Science · Computer Science 2026-05-13 Andrea Serani , Giorgio Palma , Matteo Diez

We present a parameter estimation method for nonlinear mixed effect models based on ordinary differential equations (NLME-ODEs). The method presented here aims at regularizing the estimation problem in presence of model misspecifications,…

Methodology · Statistics 2021-02-24 Quentin Clairon , Chloé Pasin , Irene Balelli , Rodolphe Thiébaut , Mélanie Prague

In this paper, we provide a novel Model-free approach based on Deep Neural Network (DNN) to accomplish point prediction and prediction interval under a general regression setting. Usually, people rely on parametric or non-parametric models…

Machine Learning · Statistics 2024-09-13 Kejin Wu , Dimitris N. Politis

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

Inference for high-dimensional logistic regression models using penalized methods has been a challenging research problem. As an illustration, a major difficulty is the significant bias of the Lasso estimator, which limits its direct…

Methodology · Statistics 2024-10-29 Yuming Zhang , Stéphane Guerrier , Runze Li

We consider the problem of estimating (diagonally dominant) M-matrices as precision matrices in Gaussian graphical models. These models exhibit intriguing properties, such as the existence of the maximum likelihood estimator with merely two…

Machine Learning · Statistics 2023-06-12 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar

Nonlinear dimensionality reduction methods provide a valuable means to visualize and interpret high-dimensional data. However, many popular methods can fail dramatically, even on simple two-dimensional manifolds, due to problems such as…

Machine Learning · Statistics 2020-07-08 Daniel Ting , Michael I. Jordan

In this paper, we introduce an innovative testing procedure for assessing individual hypotheses in high-dimensional linear regression models with measurement errors. This method remains robust even when either the X-model or Y-model is…

Methodology · Statistics 2025-01-14 Shijie Cui , Xu Guo , Songshan Yang , Zhe Zhang

This work introduces a novel deep learning-based architecture, termed the Deep Belief Markov Model (DBMM), which provides efficient, model-formulation agnostic inference in Partially Observable Markov Decision Process (POMDP) problems. The…

Machine Learning · Computer Science 2025-03-18 Giacomo Arcieri , Konstantinos G. Papakonstantinou , Daniel Straub , Eleni Chatzi

The penalized profile sampler for semiparametric inference is an extension of the profile sampler method (Lee, Kosorok and Fine, 2005) obtained by profiling a penalized log-likelihood. The idea is to base inference on the posterior…

Statistics Theory · Mathematics 2007-06-13 Guang Cheng , Michael R. Kosorok

Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal…

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

We propose a new method to estimate structural parameters in multi-way networks while controlling for rich structures of fixed effects. The method is based on a series of classification tasks and is agnostic to both the number and structure…

Econometrics · Economics 2026-01-08 Lucas Resende , Guillaume Lecué , Lionel Wilner , Philippe Choné

We examine the linear regression problem in a challenging high-dimensional setting with correlated predictors where the vector of coefficients can vary from sparse to dense. In this setting, we propose a combination of probabilistic…

Methodology · Statistics 2025-05-13 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

Motivated by the poor performance of cross-validation in settings where data are scarce, we propose a novel estimator of the out-of-sample performance of a policy in data-driven optimization.Our approach exploits the optimization problem's…

Optimization and Control · Mathematics 2022-08-04 Vishal Gupta , Michael Huang , Paat Rusmevichientong