English
Related papers

Related papers: Penalized GMM Framework for Inference on Functiona…

200 papers

Sparse regularized regression methods are now widely used in genome-wide association studies (GWAS) to address the multiple testing burden that limits discovery of potentially important predictors. Linear mixed models (LMMs) have become an…

Methodology · Statistics 2022-06-27 Julien St-Pierre , Karim Oualkacha , Sahir Rai Bhatnagar

This paper provides estimation and inference methods for an identified set's boundary (i.e., support function) where the selection among a very large number of covariates is based on modern regularized tools. I characterize the boundary…

Machine Learning · Statistics 2022-12-14 Vira Semenova

Sampled network data are widely used in empirical research because collecting complete network information is costly. However, empirical analyses based on sampled networks may lead to biased estimators. We propose a nonparametric imputation…

Econometrics · Economics 2026-05-12 Ge Sun , Weisheng Zhang

Derivatives are a key nonparametric functional in wide-ranging applications where the rate of change of an unknown function is of interest. In the Bayesian paradigm, Gaussian processes (GPs) are routinely used as a flexible prior for…

Statistics Theory · Mathematics 2025-12-30 Zejian Liu , Meng Li

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

Methodology · Statistics 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

Empirical researchers increasingly use upstream machine-learning (ML) methods to construct proxies for latent target variables from complex, unstructured data. A naive plug-in use of such proxies in downstream econometric models, however,…

Econometrics · Economics 2026-04-14 Lixiong Li

The Gaussian graphical model (GGM) incorporates an undirected graph to represent the conditional dependence between variables, with the precision matrix encoding partial correlation between pair of variables given the others. To achieve…

Methodology · Statistics 2023-07-03 Yueqi Qian , Xianghong Hu , Can Yang

We propose a partially linear additive Gaussian graphical model (PLA-GGM) for the estimation of associations between random variables distorted by observed confounders. Model parameters are estimated using an $L_1$-regularized maximal…

Machine Learning · Computer Science 2019-06-11 Sinong Geng , Minhao Yan , Mladen Kolar , Oluwasanmi Koyejo

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

Eigenvector perturbation analysis plays a vital role in various data science applications. A large body of prior works, however, focused on establishing $\ell_{2}$ eigenvector perturbation bounds, which are often highly inadequate in…

Statistics Theory · Mathematics 2022-07-06 Gen Li , Changxiao Cai , H. Vincent Poor , Yuxin Chen

We consider a semiparametric partly linear model identified by instrumental variables. We propose an estimation method that does not smooth on the instruments and we extend the Landweber-Fridman regularization scheme to the estimation of…

Econometrics · Economics 2023-10-26 Jean-Pierre Florens , Elia Lapenta

In the classic measurement error framework, covariates are contaminated by independent additive noise. This paper considers parameter estimation in such a linear errors-in-variables model where the unknown measurement error distribution is…

Methodology · Statistics 2023-10-24 Linh H. Nghiem , Cornelis J. Potgieter

Mendelian randomization (MR) is a widely used tool for causal inference in the presence of unmeasured confounders, which uses single nucleotide polymorphisms (SNPs) as instrumental variables to estimate causal effects. However, SNPs often…

Methodology · Statistics 2025-04-29 Ruoyu Wang , Haoyu Zhang , Xihong Lin

We study the problem of estimating the derivatives of a regression function, which has a wide range of applications as a key nonparametric functional of unknown functions. Standard analysis may be tailored to specific derivative orders, and…

Machine Learning · Statistics 2023-08-29 Zejian Liu , Meng Li

We propose a unified framework for establishing existence of nonparametric M-estimators, computing the corresponding estimates, and proving their strong consistency when the class of functions is exceptionally rich. In particular, the…

Statistics Theory · Mathematics 2019-09-11 Johannes O. Royset , Roger J-B Wets

It is often of interest to make inference on an unknown function that is a local parameter of the data-generating mechanism, such as a density or regression function. Such estimands can typically only be estimated at a…

Methodology · Statistics 2021-05-17 Aaron Hudson , Marco Carone , Ali Shojaie

In this paper, we introduce a novel high-dimensional Factor-Adjusted sparse Partially Linear regression Model (FAPLM), to integrate the linear effects of high-dimensional latent factors with the nonparametric effects of low-dimensional…

Methodology · Statistics 2025-01-14 Yanmei Shi , Meiling Hao , Yanlin Tang , Xu Guo

Many causal and policy effects of interest are defined by linear functionals of high-dimensional or non-parametric regression functions. $\sqrt{n}$-consistent and asymptotically normal estimation of the object of interest requires debiasing…

Machine Learning · Computer Science 2022-06-16 Victor Chernozhukov , Whitney K. Newey , Victor Quintas-Martinez , Vasilis Syrgkanis

A generalized Gaussian process model (GGPM) is a unifying framework that encompasses many existing Gaussian process (GP) models, such as GP regression, classification, and counting. In the GGPM framework, the observation likelihood of the…

Machine Learning · Statistics 2013-11-28 Lifeng Shang , Antoni B. Chan

Probability theory has become the predominant framework for quantifying uncertainty across scientific and engineering disciplines, with a particular focus on measurement and control systems. However, the widespread reliance on simple…