English
Related papers

Related papers: Precise Asymptotics for Spectral Methods in Mixed …

200 papers

Higher-order spectra (or polyspectra), defined as the Fourier Transform of a stationary process' autocumulants, are useful in the analysis of nonlinear and non Gaussian processes. Polyspectral means are weighted averages over Fourier…

Statistics Theory · Mathematics 2024-10-23 Dhrubajyoti Ghosh , Tucker McElroy , Soumendra Lahiri

This paper addresses the problem of separating spectral sources which are linearly mixed with unknown proportions. The main difficulty of the problem is to ensure the full additivity (sum-to-one) of the mixing coefficients and…

Methodology · Statistics 2010-08-30 Nicolas Dobigeon , Said Moussaoui , Jean-Yves Tourneret , Cedric Carteret

In this paper, we propose a perceptually-guided visualization sharpening technique. We analyze the spectral behavior of an established comprehensive perceptual model to arrive at our approximated model based on an adapted weighting of the…

Graphics · Computer Science 2019-07-25 Liang Zhou , Rudolf Netzel , Daniel Weiskopf , Chris Johnson

We introduce a new method for two-sample testing of high-dimensional linear regression coefficients without assuming that those coefficients are individually estimable. The procedure works by first projecting the matrices of covariates and…

Statistics Theory · Mathematics 2023-05-11 Fengnan Gao , Tengyao Wang

We consider the problem of parameter estimation from a generalized linear model with a random design matrix that is orthogonally invariant in law. Such a model allows the design have an arbitrary distribution of singular values and only…

Statistics Theory · Mathematics 2026-02-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

We consider the problem of estimating a signal from measurements obtained via a generalized linear model. We focus on estimators based on approximate message passing (AMP), a family of iterative algorithms with many appealing features: the…

Machine Learning · Statistics 2021-02-18 Marco Mondelli , Ramji Venkataramanan

We obtain an asymptotic normality result that reveals the precise asymptotic behavior of the maximum likelihood estimators of parameters for a very general class of linear mixed models containing cross random effects. In achieving the…

Statistics Theory · Mathematics 2026-02-10 Jiming Jiang , Matt P. Wand , Swarnadip Ghosh

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

We consider general high-dimensional spiked sample covariance models and show that their leading sample spiked eigenvalues and their linear spectral statistics are asymptotically independent when the sample size and dimension are…

Statistics Theory · Mathematics 2020-09-25 Zhixiang Zhang , Shurong Zheng , Guangming Pan , Pingshou Zhong

Hidden Markov models (HMMs) are widely used statistical models for modeling sequential data. The parameter estimation for HMMs from time series data is an important learning problem. The predominant methods for parameter estimation are…

Machine Learning · Computer Science 2014-04-30 Carl Mattfeld

Supervised topic models simultaneously model the latent topic structure of large collections of documents and a response variable associated with each document. Existing inference methods are based on variational approximation or Monte…

Machine Learning · Computer Science 2016-02-22 Yong Ren , Yining Wang , Jun Zhu

The sequential multiple testing problem is considered under two generalized error metrics. Under the first one, the probability of at least $k$ mistakes, of any kind, is controlled. Under the second, the probabilities of at least $k_1$…

Statistics Theory · Mathematics 2019-02-18 Yanglei Song , Georgios Fellouris

Shuffled linear regression (SLR) seeks to estimate latent features through a linear transformation, complicated by unknown permutations in the measurement dimensions. This problem extends traditional least-squares (LS) and Least Absolute…

Statistics Theory · Mathematics 2025-04-17 Hang Liu , Anna Scaglione

Analysis and synthesis of safety-critical autonomous systems are carried out using models which are often dynamic. Two central features of these dynamic systems are parameters and unmodeled dynamics. This paper addresses the use of a…

Systems and Control · Electrical Eng. & Systems 2022-03-17 Arnab Sarker , Peter Fisher , Joseph E. Gaudio , Anuradha M. Annaswamy

In this paper, we address the line spectral estimation problem with multiple measurement corrupted vectors. Such scenarios appear in many practical applications such as radar, optics, and seismic imaging in which the signal of interest can…

Signal Processing · Electrical Eng. & Systems 2022-09-26 Hoomaan Maskan , Sajad Daei , Mohammad Hossein Kahaei

Self-adjoint operators on infinite-dimensional spaces with continuous spectra are abundant but do not possess a basis of eigenfunctions. Rather, diagonalization is achieved through spectral measures. The SpecSolve package [SIAM Rev., 63(3)…

Numerical Analysis · Mathematics 2022-01-06 Matthew J. Colbrook , Andrew Horning

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

Gaussian process emulators of computationally expensive computer codes provide fast statistical approximations to model physical processes. The training of these surrogates depends on the set of design points chosen to run the simulator.…

Computation · Statistics 2016-08-16 A. Garbuno-Inigo , F. A. DiazDelaO , K. M. Zuev

Spectral methods provide an elegant and efficient way of numerically solving differential equations of all kinds. For smooth problems, truncation error for spectral methods vanishes exponentially in the infinity norm and $L_2$-norm.…

Numerical Analysis · Computer Science 2019-10-09 Joanna Piotrowska , Jonah M. Miller , Erik Schnetter