English
Related papers

Related papers: Spectral Estimators for Structured Generalized Lin…

200 papers

Designing efficient sparse recovery algorithms that could handle noisy quantized measurements is important in a variety of applications -- from radar to source localization, spectrum sensing and wireless networking. We take advantage of the…

Signal Processing · Electrical Eng. & Systems 2022-05-24 Shuai Huang , Deqiang Qiu , Trac D. Tran

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

A fast forward feature selection algorithm is presented in this paper. It is based on a Gaussian mixture model (GMM) classifier. GMM are used for classifying hyperspectral images. The algorithm selects iteratively spectral features that…

Computer Vision and Pattern Recognition · Computer Science 2015-01-06 Mathieu Fauvel , Clement Dechesne , Anthony Zullo , Frédéric Ferraty

In this work, we propose an adaptive spectral element algorithm for solving nonlinear optimal control problems. The method employs orthogonal collocation at the shifted Gegenbauer-Gauss points combined with very accurate and stable…

Optimization and Control · Mathematics 2023-03-06 Kareem T. Elgindy

Spectral estimation (SE) aims to identify how the energy of a signal (e.g., a time series) is distributed across different frequencies. This can become particularly challenging when only partial and noisy observations of the signal are…

Machine Learning · Statistics 2019-01-15 Felipe Tobar

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

We consider the problem of signal estimation in a generalized linear model (GLM). GLMs include many canonical problems in statistical estimation, such as linear regression, phase retrieval, and 1-bit compressed sensing. Recent work has…

Information Theory · Computer Science 2024-10-29 Pablo Pascual Cobo , Kuan Hsieh , Ramji Venkataramanan

Image segmentation algorithms often depend on appearance models that characterize the distribution of pixel values in different image regions. We describe a new approach for estimating appearance models directly from an image, without…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Jeova F. S. Rocha Neto , Pedro Felzenszwalb , Marilyn Vazquez

Although there is an extensive literature on the eigenvalues of high-dimensional sample covariance matrices, much of it is specialized to independent components (IC) models -- in which observations are represented as linear transformations…

Statistics Theory · Mathematics 2023-05-05 Siyao Wang , Miles E. Lopes

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

Stochastic spectral methods have achieved great success in the uncertainty quantification of many engineering problems, including electronic and photonic integrated circuits influenced by fabrication process variations. Existing techniques…

Numerical Analysis · Mathematics 2018-12-06 Chunfeng Cui , Zheng Zhang

We present large sample results for partitioning-based least squares nonparametric regression, a popular method for approximating conditional expectation functions in statistics, econometrics, and machine learning. First, we obtain a…

Statistics Theory · Mathematics 2020-07-20 Matias D. Cattaneo , Max H. Farrell , Yingjie Feng

Linear mixture models are commonly used to represent hyperspectral datacube as a linear combinations of endmember spectra. However, determining of the number of endmembers for images embedded in noise is a crucial task. This paper proposes…

Applications · Statistics 2016-06-29 A. Halimi , P. Honeine , M. Kharouf , C. Richard , J. -Y. Tourneret

We consider the problem of estimating the common mean of independently sampled data, where samples are drawn in a possibly non-identical manner from symmetric, unimodal distributions with a common mean. This generalizes the setting of…

Statistics Theory · Mathematics 2019-07-09 Ankit Pensia , Varun Jog , Po-Ling Loh

Maximizing the likelihood has been widely used for estimating the unknown covariance parameters of spatial Gaussian processes. However, evaluating and optimizing the likelihood function can be computationally intractable, particularly for…

Statistics Theory · Mathematics 2019-07-16 Hossein Keshavarz , XuanLong Nguyen , Clayton Scott

Improved performance in higher-order spectral density estimation is achieved using a general class of infinite-order kernels. These estimates are asymptotically less biased but with the same order of variance as compared to the classical…

Statistics Theory · Mathematics 2007-06-13 Arthur Berg , Dimitris Politis

We propose a one-step procedure to estimate the latent positions in random dot product graphs efficiently. Unlike the classical spectral-based methods such as the adjacency and Laplacian spectral embedding, the proposed one-step procedure…

Statistics Theory · Mathematics 2020-11-16 Fangzheng Xie , Yanxun Xu

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

Statistics Theory · Mathematics 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

In this work, we address the efficient computation of parameterized systems of linear equations, with possible nonlinear parameter dependence. When the matrix is highly sensitive to the parameters, mean-based preconditioning might not be…

Numerical Analysis · Mathematics 2026-05-29 Wouter Gerrit van Harten , Laura Scarabosio

Implicit models, which allow for the generation of samples but not for point-wise evaluation of probabilities, are omnipresent in real-world problems tackled by machine learning and a hot topic of current research. Some examples include…

Machine Learning · Statistics 2018-04-27 Yingzhen Li , Richard E. Turner