English
Related papers

Related papers: SNR Estimation in Linear Systems with Gaussian Mat…

200 papers

The formalism for computing the signal-to-noise ratio (SNR) for laser radar is reviewed and applied to the tasks of target detection, direction-finding, and phase change estimation with squeezed light. The SNR for heterodyne detection of…

Quantum Physics · Physics 2009-08-12 Mark A. Rubin , Sumanth Kaushik

We show that the gradient estimates used in training Deep Gaussian Processes (DGPs) with importance-weighted variational inference are susceptible to signal-to-noise ratio (SNR) issues. Specifically, we show both theoretically and via an…

Machine Learning · Statistics 2021-07-22 Tim G. J. Rudner , Oscar Key , Yarin Gal , Tom Rainforth

Adding noises to artificial neural network(ANN) has been shown to be able to improve robustness in previous work. In this work, we propose a new technique to compute the pathwise stochastic gradient estimate with respect to the standard…

Machine Learning · Computer Science 2021-02-10 Li Xiao , Zeliang Zhang , Yijie Peng

Throughput optimization of optical communication systems is a key challenge for current optical networks. The use of gain-flattening filters (GFFs) simplifies the problem at the cost of insertion loss, higher power consumption and…

Machine Learning · Computer Science 2021-10-01 Metodi Plamenov Yankov , Pawel Marcin Kaminski , Henrik Enggaard Hansen , Francesco Da Ros

In recent years, there is a growing need for processing methods aimed at extracting useful information from large datasets. In many cases the challenge is to discover a low-dimensional structure in the data, often concealed by the existence…

Statistics Theory · Mathematics 2019-06-05 Yariv Aizenbud , Boris Landa , Yoel Shkolnisky

This paper proposes a new algorithm for linear system identification from noisy measurements. The proposed algorithm balances a data fidelity term with a norm induced by the set of single pole filters. We pose a convex optimization problem…

Optimization and Control · Mathematics 2012-04-04 Parikshit Shah , Badri Narayan Bhaskar , Gongguo Tang , Benjamin Recht

In this work we propose an approximate Minimum Mean-Square Error (MMSE) filter for linear dynamic systems with Gaussian Mixture noise. The proposed estimator tracks each component of the Gaussian Mixture (GM) posterior with an individual…

Systems and Control · Computer Science 2015-06-26 Leila Pishdad , Fabrice Labeau

We study the input-entropy-constrained Gaussian channel capacity problem in the asymptotic high signal-to-noise ratio (SNR) regime. We show that the capacity-achieving distribution as SNR goes to infinity is given by a discrete Gaussian…

Information Theory · Computer Science 2026-01-16 Adway Girish , Shlomo Shamai , Emre Telatar

High signal to noise ratio (SNR) consistency of model selection criteria in linear regression models has attracted a lot of attention recently. However, most of the existing literature on high SNR consistency deals with model order…

Machine Learning · Statistics 2017-03-13 Sreejith Kallummil , Sheetal Kalyani

Networks are widely used in many fields for their powerful ability to provide vivid representations of relationships between variables. However, many of them may be corrupted by experimental noise or inappropriate network inference methods…

Molecular Networks · Quantitative Biology 2021-09-21 Jiating Yu , Jiacheng Leng , Ling-Yun Wu

We study estimation and clustering in Gaussian mixture models under variance misspecification. Observations are generated with true variance $\sigma^2$, while the component means are estimated using a likelihood with variance $\tau^2$,…

Signal Processing · Electrical Eng. & Systems 2026-05-05 Vladimir Serov , Amnon Balanov , Tamir Bendory

In this paper, a novel method based on the entropy estimation of the observation space eigenvalues is proposed to estimate the number of the sources in Gaussian and Non-Gaussian noise. In this method, the eigenvalues of correlation matrix…

Applications · Statistics 2024-09-02 Hamid Asadi , Babak Seyfe

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

Recent research demonstrate that prediction of time series by recurrent neural networks (RNNs) based on the noisy input generates a smooth anticipated trajectory. We examine the internal dynamics of RNNs and establish a set of conditions…

Machine Learning · Computer Science 2020-10-07 Boris Rubinstein

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

The paper studies identification of linear systems with multiplicative noise from multiple-trajectory data. An algorithm based on the least-squares method and multiple-trajectory data is proposed for joint estimation of the nominal system…

Systems and Control · Electrical Eng. & Systems 2022-06-07 Yu Xing , Benjamin Gravell , Xingkang He , Karl Henrik Johansson , Tyler Summers

We study the matrix denoising problem of estimating the singular vectors of a rank-$1$ signal corrupted by noise with both column and row correlations. Existing works are either unable to pinpoint the exact asymptotic estimation error or,…

Statistics Theory · Mathematics 2024-10-29 Yihan Zhang , Marco Mondelli

Signal to Noise Ratio (SNR) is an important index for wireless communications. In CDMA systems, spreading sequences are utilized. This series of papers show the method to derive spreading sequences as the solutions of non-linear…

Information Theory · Computer Science 2016-12-30 Hirofumi Tsuda , Ken Umeno

Analysis and synthesis of safety-critical autonomous systems are carried out using models which are often dynamic. Two central features of these dynamic systems are parameters and unmodeled dynamics. This paper addresses the use of a…

Systems and Control · Electrical Eng. & Systems 2022-03-17 Arnab Sarker , Peter Fisher , Joseph E. Gaudio , Anuradha M. Annaswamy

Residual variance and the signal-to-noise ratio are important quantities in many statistical models and model fitting procedures. They play an important role in regression diagnostics, in determining the performance limits in estimation and…

Methodology · Statistics 2012-09-04 Lee H. Dicker