English
Related papers

Related papers: A framework for the analytical performance assessm…

200 papers

In this note we develop a prelimit analysis of performance measures for importance sampling schemes related to small noise diffusion processes. In importance sampling the performance of any change of measure is characterized by its second…

Probability · Mathematics 2014-07-30 Konstantinos Spiliopoulos

The Rasch model is widely used for item response analysis in applications ranging from recommender systems to psychology, education, and finance. While a number of estimators have been proposed for the Rasch model over the last decades, the…

Machine Learning · Statistics 2018-06-12 Andrew S. Lan , Mung Chiang , Christoph Studer

This paper provides a unified framework for analyzing tensor estimation problems that allow for nonlinear observations, heteroskedastic noise, and covariate information. We study a general class of high-dimensional models where each…

Information Theory · Computer Science 2025-06-10 Riccardo Rossetti , Galen Reeves

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad

This dissertation presents two signal processing methods using specially designed localized kernels for parameter recovery under noisy condition. The first method addresses the estimation of frequencies and amplitudes in multidimensional…

Signal Processing · Electrical Eng. & Systems 2025-08-08 Sippanon Kitimoon

In this paper, we present a stochastic gradient algorithm for minimizing a smooth objective function that is an expectation over noisy cost samples, and only the latter are observed for any given parameter. Our algorithm employs a gradient…

Optimization and Control · Mathematics 2023-07-03 Akash Mondal , Prashanth L. A. , Shalabh Bhatnagar

Direction augmentation (DA) and spatial smoothing (SS), followed by a subspace method such as ESPRIT or MUSIC, are two simple and successful approaches that enable localization of more uncorrelated sources than sensors with a proper sparse…

Signal Processing · Electrical Eng. & Systems 2023-02-23 Zai Yang , Kaijie Wang

With a finite amount of measurement data acquired in variational quantum algorithms, the statistical benefits of several optimized numerical estimation schemes, including the scaled parameter-shift (SPS) rule and finite-difference (FD)…

Quantum Physics · Physics 2024-08-07 Yong Siah Teo

We introduce a flexible framework for making inferences about general linear forms of a large matrix based on noisy observations of a subset of its entries. In particular, under mild regularity conditions, we develop a universal procedure…

Statistics Theory · Mathematics 2020-06-12 Dong Xia , Ming Yuan

Matrix and tensor completion aim to recover a low-rank matrix / tensor from limited observations and have been commonly used in applications such as recommender systems and multi-relational data mining. A state-of-the-art matrix completion…

Numerical Analysis · Computer Science 2018-08-28 Quanming Yao , James T. Kwok

We consider the problem of resolving overlapping pulses from noisy multi-snapshot measurements, which has been a problem central to various applications including medical imaging and array signal processing. ESPRIT algorithm has been used…

Signal Processing · Electrical Eng. & Systems 2023-09-01 Meghna Kalra , Kiryung Lee

In this paper, the sparse sensor placement problem for least-squares estimation is considered, and the previous novel approach of the sparse sensor selection algorithm is extended. The maximization of the determinant of the matrix which…

Signal Processing · Electrical Eng. & Systems 2021-05-18 Yuji Saito , Taku Nonomura , Keigo Yamada , Kumi Nakai , Takayuki Nagata , Keisuke Asai , Yasuo Sasaki , Daisuke Tsubakino

Low-rank matrix estimation under heavy-tailed noise is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs, especially since robust loss…

Statistics Theory · Mathematics 2023-05-12 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

In this work, we consider the optimization formulation for symmetric tensor decomposition recently introduced in the Subspace Power Method (SPM) of Kileel and Pereira. Unlike popular alternative functionals for tensor decomposition, the SPM…

Optimization and Control · Mathematics 2021-11-01 Joe Kileel , Timo Klock , João M. Pereira

Regression with a spherical response is challenging due to the absence of linear structure, making standard regression models inadequate. Existing methods, mainly parametric, lack the flexibility to capture the complex relationship induced…

Methodology · Statistics 2025-04-01 Houren Hong , Janice L. Scealy , Andrew T. A. Wood , Yanrong Yang

Standard system identification methods often provide inconsistent estimates with closed-loop data. With the prediction error method (PEM), this issue is solved by using a noise model that is flexible enough to capture the noise spectrum.…

Systems and Control · Computer Science 2018-09-07 Miguel Galrinho , Cristian R. Rojas , Hakan Hjalmarsson

Minimizing the Mean Squared Error (MSE) is a key objective in machine learning and is commonly used for imputing missing values. While this approach provides accurate point estimates, it introduces systematic biases in downstream analyses.…

Machine Learning · Statistics 2026-05-06 Stef van Buuren

In this paper, an approach of estimating signal parameters via rotational invariance technique (ESPRIT) is proposed for two-dimensional (2-D) localization of incoherently distributed (ID) sources in large-scale/massive multiple-input…

Information Theory · Computer Science 2015-06-23 Anzhong Hu , Tiejun Lv , Hui Gao , Zhang Zhang , Shaoshi Yang

It was recently shown [7, 9] that "properly built" linear and polyhedral estimates nearly attain minimax accuracy bounds in the problem of recovery of unknown signal from noisy observations of linear images of the signal when the signal set…

Optimization and Control · Mathematics 2023-12-25 Yannis Bekri , Anatoli Juditsky , Arkadi Nemirovski