English
Related papers

Related papers: A convergence and asymptotic analysis of the gener…

200 papers

While Cram\'er-Rao lower bound is an important metric in sensing functions in integrated sensing and communications (ISAC) designs, its optimization usually involves a computationally expensive solution such as semidefinite relaxation. In…

Information Theory · Computer Science 2025-02-06 Tianyu Fang , Nhan Thanh Nguyen , Markku Juntti

In independent component analysis it is assumed that the components of the observed random vector are linear combinations of latent independent random variables, and the aim is then to find an estimate for a transformation matrix back to…

Statistics Theory · Mathematics 2015-09-11 Jari Miettinen , Sara Taskinen , Klaus Nordhausen , Hannu Oja

Nonlinear independent component analysis (nICA) aims at recovering statistically independent latent components that are mixed by unknown nonlinear functions. Central to nICA is the identifiability of the latent components, which had been…

Machine Learning · Computer Science 2022-06-15 Qi Lyu , Xiao Fu

Compressive learning forms the exciting intersection between compressed sensing and statistical learning where one exploits forms of sparsity and structure to reduce the memory and/or computational complexity of the learning task. In this…

Machine Learning · Statistics 2021-10-18 Michael P. Sheehan , Mike E. Davies

In some estimation problems, not all the parameters can be identified, which results in singularity of the Fisher Information Matrix (FIM). The Cram\'er-Rao Bound (CRB), which is the inverse of the FIM, is then not defined. To regularize…

Information Theory · Computer Science 2018-07-24 Elisabeth de Carvalho , Dirk Slock

In this paper, we derive the asymptotic Cram\'er-Rao lower bound for the continuous-time output error model structure and provide an analysis of the statistical efficiency of the Simplified Refined Instrumental Variable method for…

Systems and Control · Electrical Eng. & Systems 2020-07-20 Siqi Pan , James S. Welsh , Rodrigo A. González , Cristian R. Rojas

Independent component analysis (ICA) has been shown to be useful in many applications. However, most ICA methods are sensitive to data contamination and outliers. In this article we introduce a general minimum U-divergence framework for…

Methodology · Statistics 2012-10-23 Peng-Wen Chen , Hung Hung , Osamu Komori , Su-Yun Huang , Shinto Eguchi

We perform a non-asymptotic analysis of the contrastive divergence (CD) algorithm, a training method for unnormalized models. While prior work has established that (for exponential family distributions) the CD iterates asymptotically…

Machine Learning · Statistics 2025-10-16 Pierre Glaser , Kevin Han Huang , Arthur Gretton

Independent component analysis (ICA) is a fundamental data processing technique to decompose the captured signals into as independent as possible components. Computing the contrast function, which serves as a measure of independence of…

Quantum Physics · Physics 2023-11-22 Xiao-Fan Xu , Cheng Xue , Zhao-Yun Chen , Yu-Chun Wu , Guo-Ping Guo

We consider a mixed analog-to-digital converter (ADC) based architecture for direction of arrival (DOA) estimation using a uniform linear array (ULA). We derive the Cram{\'e}r-Rao bound (CRB) of the DOA under the optimal time-varying…

Signal Processing · Electrical Eng. & Systems 2023-05-16 Xinnan Zhang , Yuanbo Cheng , Xiaolei Shang , Jun liu

The Bayesian Cram\'er-Rao bound (CRB) provides a lower bound on the mean square error of any Bayesian estimator under mild regularity conditions. It can be used to benchmark the performance of statistical estimators, and provides a…

Machine Learning · Statistics 2024-09-09 Evan Scope Crafts , Xianyang Zhang , Bo Zhao

To achieve the joint active and passive beamforming gains in the reconfigurable intelligent surface assisted millimeter wave system, the reflected cascade channel needs to be accurately estimated. Many strategies have been proposed in the…

Information Theory · Computer Science 2021-09-22 Yiming Liu , Erwu Liu , Rui Wang , Zhu Han , Binyu Lu

Neural networks are increasingly used to estimate parameters in quantitative MRI, in particular in magnetic resonance fingerprinting. Their advantages over the gold standard non-linear least square fitting are their superior speed and their…

Many sparse linear discriminant analysis (LDA) methods have been proposed to overcome the major problems of the classic LDA in high-dimensional settings. However, the asymptotic optimality results are limited to the case that there are only…

Statistics Theory · Mathematics 2015-08-06 Ruiyan Luo , Xin Qi

Many results in the quantum metrology literature use the Cram\'er-Rao bound and the Fisher information to compare different quantum estimation strategies. However, there are several assumptions that go into the construction of these tools,…

Quantum Physics · Physics 2018-01-31 Jesús Rubio , Paul Knott , Jacob Dunningham

Independent Component Analysis (ICA) is a dimensionality reduction technique that can boost efficiency of machine learning models that deal with probability density functions, e.g. Bayesian neural networks. Algorithms that implement…

Machine Learning · Computer Science 2017-07-10 Mahdi Nazemi , Shahin Nazarian , Massoud Pedram

A computer program is introduced, which allows to determine statistically optimal approxi-mation using the "Asymptotic Parabola" fit, or, in other words, the spline consisting of polynomials of order 1,2,1, or two lines ("asymptotes")…

Solar and Stellar Astrophysics · Physics 2016-01-13 Kateryna D. Andrych , Ivan L Andronov , Lidia L. Chinarova , Vladyslava I. Marsakova

We revisit the problem of computing submatrices of the Cram\'er-Rao bound (CRB), which lower bounds the variance of any unbiased estimator of a vector parameter $\vth$. We explore iterative methods that avoid direct inversion of the Fisher…

Information Theory · Computer Science 2015-06-04 Paul Tune

In this note, we show a sublinear nonergodic convergence rate for the algorithm developed in [Bai, et al. Generalized symmetric ADMM for separable convex optimization. Comput. Optim. Appl. 70, 129-170 (2018)], as well as its linear…

Numerical Analysis · Mathematics 2019-06-20 Jianchao Bai , Xiaokai Chang , Jicheng Li , Fengmin Xu

In [1], we proved the asymptotic achievability of the Cram\'{e}r-Rao bound in the compressive sensing setting in the linear sparsity regime. In the proof, we used an erroneous closed-form expression of $\alpha \sigma^2$ for the genie-aided…

Information Theory · Computer Science 2015-09-16 Behtash Babadi , Nicholas Kalouptsidis , Vahid Tarokh