English
Related papers

Related papers: Simple robust two-stage estimation and inference f…

200 papers

Stochastic processes are a flexible and widely used family of models for statistical modeling. While stochastic processes offer attractive properties such as inclusion of uncertainty properties, their inference is typically intractable,…

Methodology · Statistics 2026-02-10 Teemu Härkönen , Simo Särkkä

We present a multivariate Gaussian process regression approach for parameter field reconstruction based on the field's measurements collected at two different scales, the coarse and fine scales. The proposed approach treats the parameter…

Methodology · Statistics 2018-04-19 David A. Barajas-Solano , Alexandre M. Tartakovsky

The widespread use of maximum Jeffreys'-prior penalized likelihood in binomial-response generalized linear models, and in logistic regression, in particular, are supported by the results of Kosmidis and Firth (2021, Biometrika), who show…

Methodology · Statistics 2024-06-10 Patrick Zietkiewicz , Ioannis Kosmidis

This paper concerns statistical inference for the components of a high-dimensional regression parameter despite possible endogeneity of each regressor. Given a first-stage linear model for the endogenous regressors and a second-stage linear…

Statistics Theory · Mathematics 2019-11-25 David Gold , Johannes Lederer , Jing Tao

We study the problem of high-dimensional variable selection via some two-step procedures. First we show that given some good initial estimator which is $\ell_{\infty}$-consistent but not necessarily variable selection consistent, we can…

Statistics Theory · Mathematics 2008-10-10 Jian Zhang , Xinge Jessie Jeng , Han Liu

Local projections (LP) and vector autoregressions (VAR) are the two standard tools for impulse response analysis, but they often display a finite-sample trade-off: LP is typically less biased but more volatile, while VAR is more precise but…

Econometrics · Economics 2026-05-08 Chaoyi Chen , Elena Pesavento , Balazs Vonnak

Social scientists are often interested in using ordinal indicators to estimate latent traits that change over time. Frequently, this is done with item response theoretic (IRT) models that describe the relationship between those latent…

Methodology · Statistics 2025-04-04 Yehu Chen , Jacob Montgomery , Roman Garnett

Maximum Likelihood Estimation of continuous variable models can be very challenging in high dimensions, due to potentially complex probability distributions. The existence of multiple interdependencies among variables can make it very…

Machine Learning · Statistics 2024-09-06 Jean-Sébastien Brouillon , Florian Dörfler , Giancarlo Ferrari-Trecate

Solving linear systems is often the computational bottleneck in real-life problems. Iterative solvers are the only option due to the complexity of direct algorithms or because the system matrix is not explicitly known. Here, we develop a…

Numerical Analysis · Computer Science 2020-10-08 Joris Tavernier , Jaak Simm , Karl Meerbergen , Yves Moreau

We propose a novel distributional regression model for a multivariate response vector based on a copula process over the covariate space. It uses the implicit copula of a Gaussian multivariate regression, which we call a ``regression…

Methodology · Statistics 2024-03-06 Nadja Klein , Michael Stanley Smith , David Nott , Ryan Chisholm

Regression models with both high-dimensional responses and covariates have attracted growing attention. Standard multivariate regression models become inadequate when the response variables depend not only on observed covariates but also on…

Methodology · Statistics 2026-05-01 Jing Ouyang , Chengyu Cui , Yunxiao Chen , Kean Ming Tan , Gongjun Xu

Two-phase sampling designs have been widely adopted in epidemiological studies to reduce costs when measuring certain biomarkers is prohibitively expensive. Under these designs, investigators commonly relate survival outcomes to risk…

Methodology · Statistics 2025-12-12 Jooho Kim , Yei Eun Shin

Iteratively Re-weighted Least Squares (IRLS) is a method for solving minimization problems involving non-quadratic cost functions, perhaps non-convex and non-smooth, which however can be described as the infimum over a family of quadratic…

Numerical Analysis · Mathematics 2016-02-24 Massimo Fornasier , Steffen Peter , Holger Rauhut , Stephan Worm

The discovery of non-linear causal relationship under additive non-Gaussian noise models has attracted considerable attention recently because of their high flexibility. In this paper, we propose a novel causal inference algorithm called…

Machine Learning · Statistics 2011-03-31 Makoto Yamada , Masashi Sugiyama , Jun Sese

We consider jointly estimating the coefficient matrix and the error precision matrix in high-dimensional multivariate linear regression models. Bayesian methods in this context often face computational challenges, leading to previous…

Methodology · Statistics 2025-08-25 Xuan Cao , Kyoungjae Lee

We consider a finite impulse response system with centered independent sub-Gaussian design covariates and noise components that are not necessarily identically distributed. We derive non-asymptotic near-optimal estimation and prediction…

Statistics Theory · Mathematics 2019-12-02 Boualem Djehiche , Othmane Mazhar , Cristian R. Rojas

This study extends the Bayesian nonparametric instrumental variable regression model to determine the structural effects of covariates on the conditional quantile of the response variable. The error distribution is nonparametrically…

Methodology · Statistics 2016-08-30 Genya Kobayashi , Kota Ogasawara

We consider a pure-jump stable Cox-Ingersoll-Ross ($\alpha$-stable CIR) process driven by a non-symmetric stable L{\'e}vy process with jump activity $\alpha$ $\in$ (1, 2) and we address the joint estimation of drift, scaling and jump…

Probability · Mathematics 2024-02-13 Elise Bayraktar , Emmanuelle Clément

Global sensitivity analysis (GSA) of numerical simulators aims at studying the global impact of the input uncertainties on the output. To perform the GSA, statistical tools based on inputs/output dependence measures are commonly used. We…

Statistics Theory · Mathematics 2019-02-20 Anouar Meynaoui , Amandine Marrel , Béatrice Laurent

In this paper we develop inference for high dimensional linear models, with serially correlated errors. We examine Lasso under the assumption of strong mixing in the covariates and error process, allowing for fatter tails in their…

Econometrics · Economics 2023-10-05 Ilias Chronopoulos , Katerina Chrysikou , George Kapetanios