English
Related papers

Related papers: Parameters on the boundary in predictive regressio…

200 papers

Accurate statistical inference in logistic regression models remains a critical challenge when the ratio between the number of parameters and sample size is not negligible. This is because approximations based on either classical asymptotic…

Methodology · Statistics 2022-08-19 Qian Zhao , Emmanuel J. Candes

We study the problem of detection of a p-dimensional sparse vector of parameters in the linear regression model with Gaussian noise. We establish the detection boundary, i.e., the necessary and sufficient conditions for the possibility of…

Statistics Theory · Mathematics 2010-09-13 Yuri I. Ingster , Alexandre B. Tsybakov , Nicolas Verzelen

In this paper we propose a solution to the problem of parameter estimation of nonlinearly parameterized regressions--continuous or discrete time--and apply it for system identification and adaptive control. We restrict our attention to…

Optimization and Control · Mathematics 2019-10-18 Romeo Ortega , Vladislav Gromov , Emmanuel Nuño , Anton Pyrkin , Jose Guadalupe Romero

Under model misspecification, it is known that Bayesian posteriors often do not properly quantify uncertainty about true or pseudo-true parameters. Even more fundamentally, misspecification leads to a lack of reproducibility in the sense…

Methodology · Statistics 2023-11-06 Jonathan H. Huggins , Jeffrey W. Miller

We introduce a rigorous mathematical framework for Granger causality in extremes, designed to identify causal links from extreme events in time series. Granger causality plays a pivotal role in uncovering directional relationships among…

Machine Learning · Statistics 2024-10-21 Juraj Bodik , Olivier C. Pasche

A widely applied approach to causal inference from a non-experimental time series $X$, often referred to as "(linear) Granger causal analysis", is to regress present on past and interpret the regression matrix $\hat{B}$ causally. However,…

Machine Learning · Statistics 2015-12-23 Philipp Geiger , Kun Zhang , Mingming Gong , Dominik Janzing , Bernhard Schölkopf

Existing generalization bounds fail to explain crucial factors that drive the generalization of modern neural networks. Since such bounds often hold uniformly over all parameters, they suffer from over-parametrization and fail to account…

Machine Learning · Statistics 2023-11-14 Songyan Hou , Parnian Kassraie , Anastasis Kratsios , Andreas Krause , Jonas Rothfuss

Inference about a scalar parameter of interest typically relies on the asymptotic normality of common likelihood pivots, such as the signed likelihood root, the score and Wald statistics. Nevertheless, the resulting inferential procedures…

Statistics Theory · Mathematics 2022-01-07 Ruggero Bellio , Ioannis Kosmidis , Alessandra Salvan , Nicola Sartori

In this paper, we study the trace regression when a matrix of parameters B* is estimated via the convex relaxation of a rank-regularized regression or via regularized non-convex optimization. It is known that these estimators satisfy…

Machine Learning · Computer Science 2023-08-31 Nima Hamidi , Mohsen Bayati

Practical inference procedures for quantile regression models of panel data have been a pervasive concern in empirical work, and can be especially challenging when the panel is observed over many time periods and temporal dependence needs…

Econometrics · Economics 2025-07-25 Antonio F. Galvao , Carlos Lamarche , Thomas Parker

Strict stationarity is a common assumption used in the time series literature in order to derive asymptotic distributional results for second-order statistics, like sample autocovariances and sample autocorrelations. Focusing on weak…

Statistics Theory · Mathematics 2023-02-28 Yunyi Zhang , Efstathios Paparoditis , Dimitris N. Politis

The purpose of this talk is to sketch some recent progress which has been made in calculating non-perturbatively the reflection factors for the sinh-Gordon model restricted to a half-line by integrable boundary conditions. The essential…

High Energy Physics - Theory · Physics 2007-05-23 E. Corrigan

Many problems in computational science and engineering become one-to-many after coarse graining, partial observation, or inverse reconstruction: a resolved state may not determine a unique subgrid forcing, a structural descriptor may not…

Machine Learning · Statistics 2026-05-28 Junfeng Chen

Westling and Carone (2020) proposed a framework for studying the large sample distributional properties of generalized Grenander-type estimators, a versatile class of nonparametric estimators of monotone functions. The limiting distribution…

Statistics Theory · Mathematics 2024-07-08 Matias D. Cattaneo , Michael Jansson , Kenichi Nagasawa

We consider a heteroscedastic regression model in which some of the regression coefficients are zero but it is not known which ones. Penalized quantile regression is a useful approach for analyzing such data. By allowing different…

Methodology · Statistics 2018-07-23 Lan Wang , Ingrid Van Keilegrom , Adam Maidman

A bootstrap procedure for constructing prediction bands for a stationary functional time series is proposed. The procedure exploits a general vector autoregressive representation of the time-reversed series of Fourier coefficients appearing…

Statistics Theory · Mathematics 2023-07-17 Efstathios Paparoditis , Han Lin Shang

Granger causality is widely used for causal structure discovery in complex systems from multivariate time series data. Traditional Granger causality tests based on linear models often fail to detect even mild non-linear causal…

Machine Learning · Computer Science 2025-10-23 Ziyi Zhang , Shaogang Ren , Xiaoning Qian , Nick Duffield

Large-scale datasets are increasingly being used to inform decision making. While this effort aims to ground policy in real-world evidence, challenges have arisen as selection bias and other forms of distribution shifts often plague…

Methodology · Statistics 2023-11-07 Santiago Cortes-Gomez , Mateo Dulce , Carlos Patino , Bryan Wilder

We develop a practical and novel method for inference on intersection bounds, namely bounds defined by either the infimum or supremum of a parametric or nonparametric function, or equivalently, the value of a linear programming problem with…

Statistics Theory · Mathematics 2013-05-06 Victor Chernozhukov , Sokbae Lee , Adam M. Rosen

The wild bootstrap is a popular resampling method in the context of time-to-event data analyses. Previous works established the large sample properties of it for applications to different estimators and test statistics. It can be used to…

Methodology · Statistics 2023-10-27 Marina T. Dietrich , Dennis Dobler , Mathisca C. M. de Gunst