English
Related papers

Related papers: Information Measures, Inequalities and Performance…

200 papers

Using mathematical models to assist in the interpretation of experiments is becoming increasingly important in research across applied mathematics, and in particular in biology and ecology. In this context, accurate parameter estimation is…

Statistics Theory · Mathematics 2025-04-29 Jie Qi , Ruth E. Baker

In many scenarios, the communication system suffers from both Gaussian white noise and non-Gaussian impulsive noise. In order to design optimal signal detection method, it is necessary to estimate the parameters of mixed Gaussian-impulsive…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Tianfu Qi , Jun Wang , Xiaonan Chen , Wei Huang

Gaussian Process (GP) models have also become extremely useful for optimization under uncertainty algorithms, especially where the objective functions are costly to compute. Yet, the more classical methods usually adopt strategies that, in…

Optimization and Control · Mathematics 2025-07-22 Nishant Gadde

Quantum chaotic and integrable systems are known to exhibit a characteristic $1/f$ and $1/f^{2}$ noise, respectively, in the power spectrum associated to their spectral fluctuations. A recent work [R. Riser, V. A. Osipov, and E. Kanzieper,…

Quantum Physics · Physics 2019-09-17 A. L. Corps , A. Relaño

In this paper, tight upper and lower bounds are derived on the weighted sum of minimum mean-squared errors for additive Gaussian noise channels. The bounds are obtained by constraining the input distribution to be close to a Gaussian…

Information Theory · Computer Science 2020-01-23 Michael Fauß , Abdelhak M. Zoubir , Alex Dytso , H. Vincent Poor , K. G. Nagananda

The Heisenberg limit provides a fundamental bound on the achievable estimation precision with a limited number of $N$ resources used (e.g., atoms, photons, etc.). Using entangled quantum states makes it possible to scale the precision with…

Quantum Physics · Physics 2023-04-28 Wojciech Górecki

Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model…

Machine Learning · Computer Science 2024-02-14 Xingjian Li , Pengkun Yang , Yangcheng Gu , Xueying Zhan , Tianyang Wang , Min Xu , Chengzhong Xu

Stochastic averaging allows for the reduction of the dimension and complexity of stochastic dynamical systems with multiple time scales, replacing fast variables with statistically equivalent stochastic processes in order to analyze…

Probability · Mathematics 2015-02-25 William F. Thompson , Rachel A. Kuske , Adam H. Monahan

Stochastic averaging problems with Gaussian forcing have been studied thoroughly for many years, but far less attention has been paid to problems where the stochastic forcing has infinite variance, such as an {\alpha}-stable noise forcing.…

Dynamical Systems · Mathematics 2017-05-24 William F. Thompson , Rachel A. Kuske , Adam. H. Monahan

Non-Gaussian noise and the uncertainty of noise distribution are the common factors that reduce accuracy in dynamic state estimation of power systems (PS). In addition, the optimal value of the free coefficients in the unscented Kalman…

Signal Processing · Electrical Eng. & Systems 2025-04-11 Duc Viet Nguyen , Haiquan Zhao , Jinhui Hu , Le Ngoc Giang

Effective resource allocation in sensor networks, IoT systems, and distributed computing is essential for applications such as environmental monitoring, surveillance, and smart infrastructure. Sensors or agents must optimize their resource…

Machine Learning · Computer Science 2024-09-26 Yu-Zhen Janice Chen , Daniel S. Menasché , Don Towsley

Relative Fisher information, also known as score matching, is a recently introduced learning method for parameter estimation. Fundamental relations between relative entropy and score matching have been established in the literature for…

Information Theory · Computer Science 2025-04-29 Yirong Shen , Lu Gan , Cong Ling

Speech audio quality is subject to degradation caused by an acoustic environment and isotropic ambient and point noises. The environment can lead to decreased speech intelligibility and loss of focus and attention by the listener. Basic…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-05 Paula Sánchez López , Paul Callens , Milos Cernak

Classical probabilistic models of (noisy) quantum systems are not only relevant for understanding the non-classical features of quantum mechanics, but they are also useful for determining the possible advantage of using quantum resources…

Quantum Physics · Physics 2020-03-16 Iman Marvian

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

We consider the problem of modulating the value of a parameter onto a band-limited signal to be transmitted over a continuous-time, additive white Gaussian noise (AWGN) channel, and estimating this parameter at the receiver. The performance…

Information Theory · Computer Science 2016-06-22 Nir Weinberger , Neri Merhav

In this paper, we consider single- and multi-user Gaussian channels with feedback under expected power constraints and with non-vanishing error probabilities. In the first of two contributions, we study asymptotic expansions for the…

Information Theory · Computer Science 2016-09-22 Lan V. Truong , Silas L. Fong , Vincent Y. F. Tan

This paper considers the problem of estimation of the Fisher information for location from a random sample of size $n$. First, an estimator proposed by Bhattacharya is revisited and improved convergence rates are derived. Second, a new…

Information Theory · Computer Science 2020-05-08 Wei Cao , Alex Dytso , Michael Fauß , H. Vincent Poor , Gang Feng

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

A lack of software reproducibility has become increasingly apparent in the last several years, calling into question the validity of scientific findings affected by published tools. Reproducibility issues may have numerous sources of error,…

Neurons and Cognition · Quantitative Biology 2020-04-23 Gregory Kiar , Pablo de Oliveira Castro , Pierre Rioux , Eric Petit , Shawn T. Brown , Alan C. Evans , Tristan Glatard