English
Related papers

Related papers: Asymptotically optimal inference in sparse sequenc…

200 papers

Models can be simple for different reasons: because they yield a simple and computationally efficient interpretation of a generic dataset (e.g. in terms of pairwise dependences) - as in statistical learning - or because they capture the…

Disordered Systems and Neural Networks · Physics 2018-10-17 Alberto Beretta , Claudia Battistin , Clélia de Mulatier , Iacopo Mastromatteo , Matteo Marsili

For many important problems the quantity of interest is an unknown function of the parameters, which is a random vector with known statistics. Since the dependence of the output on this random vector is unknown, the challenge is to identify…

Machine Learning · Statistics 2021-04-28 Themistoklis P. Sapsis

In the context of a high-dimensional linear regression model, we propose the use of an empirical correlation-adaptive prior that makes use of information in the observed predictor variable matrix to adaptively address high collinearity,…

Methodology · Statistics 2022-07-04 Chang Liu , Yue Yang , Howard Bondell , Ryan Martin

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

Statistics Theory · Mathematics 2015-08-13 Jana Jankova , Sara van de Geer

Sparse deep learning has become a popular technique for improving the performance of deep neural networks in areas such as uncertainty quantification, variable selection, and large-scale network compression. However, most existing research…

Machine Learning · Statistics 2023-10-06 Mingxuan Zhang , Yan Sun , Faming Liang

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

Methodology · Statistics 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

This paper considers inference for conditional moment inequality models using a multiscale statistic. We derive the asymptotic distribution of this test statistic and use the result to propose feasible critical values that have a simple…

Applications · Statistics 2015-12-10 Timothy B. Armstrong , Hock Peng Chan

Analyzing time series in the frequency domain enables the development of powerful tools for investigating the second-order characteristics of multivariate processes. Parameters like the spectral density matrix and its inverse, the coherence…

Methodology · Statistics 2024-01-19 Jonas Krampe , Efstathios Paparoditis

In this paper, a robust non-parametric measure of statistical dependence, or correlation, between two random variables is presented. The proposed coefficient is a permutation-like statistic that quantifies how much the observed sample S_n :…

Methodology · Statistics 2020-07-27 Rami Mahdi

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

We present a framework which incorporates three aspects of the estimation problem, namely, sparse sensor configuration, optimal precision, and robustness in the presence of model uncertainty. The problem is formulated in the…

Systems and Control · Electrical Eng. & Systems 2020-09-07 Vedang M. Deshpande , Raktim Bhattacharya

In this work we explore the possibility of using sparse statistical modeling in condensed matter physics. The procedure is employed to two well known problems: elemental superconductors and heavy fermions, and was shown that in most cases…

Superconductivity · Physics 2026-01-21 J. McGee , S. V. Dordevic

Distance queries are a basic tool in data analysis. They are used for detection and localization of change for the purpose of anomaly detection, monitoring, or planning. Distance queries are particularly useful when data sets such as…

Data Structures and Algorithms · Computer Science 2015-03-20 Edith Cohen

The semivarying coefficient models are widely used in the application of finance, economics, medical science and many other areas. The functional coefficients are commonly estimated by local smoothing methods, e.g. local linear estimator.…

Methodology · Statistics 2020-01-01 Heng Peng , Chuanlong Xie , Jingxin Zhao

This paper revisits the simple, but empirically salient, problem of inference on a real-valued parameter that is partially identified through upper and lower bounds with asymptotically normal estimators. A simple confidence interval is…

Econometrics · Economics 2021-01-01 Jörg Stoye

Over the past decades, linear mixed models have attracted considerable attention in various fields of applied statistics. They are popular whenever clustered, hierarchical or longitudinal data are investigated. Nonetheless, statistical…

Methodology · Statistics 2021-09-20 Katarzyna Reluga , María José Lombardía , Stefan Andreas Sperlich

We study high-dimensional distribution learning in an agnostic setting where an adversary is allowed to arbitrarily corrupt an $\varepsilon$-fraction of the samples. Such questions have a rich history spanning statistics, machine learning…

Data Structures and Algorithms · Computer Science 2019-03-18 Ilias Diakonikolas , Gautam Kamath , Daniel Kane , Jerry Li , Ankur Moitra , Alistair Stewart

We propose a novel resampling-based method to construct an asymptotically exact test for any subset of hypotheses on coefficients in high-dimensional linear regression. It can be embedded into any multiple testing procedure to make…

Methodology · Statistics 2022-05-26 Anna Vesely , Jelle J. Goeman , Livio Finos

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

We study asymptotic behavior of one-step $M$-estimators based on samples from arrays of not necessarily identically distributed random variables and representing explicit approximations to the corresponding consistent $M$-estimators. These…

Statistics Theory · Mathematics 2016-04-12 Yu. Yu. Linke