English
Related papers

Related papers: A Note on Harmonic Underspecification in Log-Norma…

200 papers

This paper studies regularized least square recovery of signals whose samples' prior distributions are nonidentical, e.g., signals with time-variant sparsity. For this model, Bayesian framework suggests to regularize the least squares term…

Information Theory · Computer Science 2018-05-31 Ali Bereyhi , Mohammad Ali Sedaghat , Ralf R. Müller

Period estimation is one of the central topics in astronomical time series analysis, where data is often unevenly sampled. Especially challenging are studies of stellar magnetic cycles, as there the periods looked for are of the order of…

Solar and Stellar Astrophysics · Physics 2018-07-25 N. Olspert , J. Pelt , M. J. Käpylä , J. Lehtinen

The dramatic growth of big datasets presents a new challenge to data storage and analysis. Data reduction, or subsampling, that extracts useful information from datasets is a crucial step in big data analysis. We propose an orthogonal…

Methodology · Statistics 2021-06-01 Lin Wang , Jake Elmstedt , Weng Kee Wong , Hongquan Xu

Random feature models (RFMs), two-layer networks with a randomly initialized fixed first layer and a trained linear readout, are among the simplest nonlinear predictors. Prior asymptotic analyses in the proportional high-dimensional regime…

Machine Learning · Statistics 2026-02-20 Samet Demir , Zafer Dogan

Nonlinear optimisation techniques are commonly employed to minimise complex cost functions, with their effectiveness determined largely by the structure of the underlying error landscape. These methods require initial parameter values, and…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Tilo Strutz

We introduce and study the Group Square-Root Lasso (GSRL) method for estimation in high dimensional sparse regression models with group structure. The new estimator minimizes the square root of the residual sum of squares plus a penalty…

Statistics Theory · Mathematics 2013-08-01 Florentina Bunea , Johannes Lederer , Yiyuan She

In this paper, we consider the estimation of regression coefficients and signal-to-noise (SNR) ratio in high-dimensional Generalized Linear Models (GLMs), and explore their implications in inferring popular estimands such as average…

Statistics Theory · Mathematics 2025-05-07 Xingyu Chen , Lin Liu , Rajarshi Mukherjee

Tensor-valued data arise naturally in multidimensional signal and imaging problems, such as biomedical imaging. When incorporated into generalized linear models (GLMs), naive vectorization can destroy their multi-way structure and lead to…

Machine Learning · Statistics 2026-04-07 Xiao Liang , Shuang Li

Conformal prediction methods construct prediction regions for iid data that are valid in finite samples. We provide two parametric conformal prediction regions that are applicable for a wide class of continuous statistical models. This…

Methodology · Statistics 2019-10-29 Daniel J. Eck , Forrest W. Crawford

When the regressors of a econometric linear model are nonorthogonal, it is well known that their estimation by ordinary least squares can present various problems that discourage the use of this model. The ridge regression is the most…

Generalized linear models and the quasi-likelihood method extend the ordinary regression models to accommodate more general conditional distributions of the response. Nonparametric methods need no explicit parametric specification, and the…

Statistics Theory · Mathematics 2009-11-23 Jianqing Fan , Yichao Wu , Yang Feng

This paper addresses the asymptotic performance of popular spatial regression estimators of the linear effect of an exposure on an outcome under ``spatial confounding" -- the presence of an unmeasured spatially-structured variable…

Methodology · Statistics 2024-09-19 Brian Gilbert , Elizabeth L. Ogburn , Abhirup Datta

Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological…

Methodology · Statistics 2021-12-07 Solmaz Seifollahi , Kaniav Kamary , Hossein Bevrani

It has been observed that an interesting class of non-Gaussian stationary processes is obtained when in the harmonics of a signal with random amplitudes and phases, frequencies can also vary randomly. In the resulting models, the…

Probability · Mathematics 2019-11-19 Anastassia Baxevani , Krzysztof Podgórski

We develop a uniform inference theory for high-dimensional slope parameters in threshold regression models, allowing for either cross-sectional or time series data. We first establish oracle inequalities for prediction errors, and L1…

Econometrics · Economics 2025-09-16 Jiatong Li , Hongqiang Yan

Linear mixed models (LMMs) are used as an important tool in the data analysis of repeated measures and longitudinal studies. The most common form of LMMs utilize a normal distribution to model the random effects. Such assumptions can often…

Methodology · Statistics 2016-02-16 Hien D. Nguyen , Geoffrey J. McLachlan

The problem of matrix sensing, or trace regression, is a problem wherein one wishes to estimate a low-rank matrix from linear measurements perturbed with noise. A number of existing works have studied both convex and nonconvex approaches to…

Statistics Theory · Mathematics 2025-06-26 Joshua Agterberg , René Vidal

Power law scaling models have been used to understand the complexity of systems as diverse as cities, neurological activity, and rainfall and lightning. In the scaling framework, power laws and standard linear regression methods are widely…

Methodology · Statistics 2024-04-16 Jack Sutton , Golnaz Shahtahmassebi , Quentin S. Hanley , Haroldo V. Ribeiro

The estimation problem in a high regression model with structured sparsity is investigated. An algorithm using a two steps block thresholding procedure called GR-LOL is provided. Convergence rates are produced: they depend on simple…

Statistics Theory · Mathematics 2012-07-10 Mathilde Mougeot , Dominique Picard , Karine Tribouley

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang