English
Related papers

Related papers: Realizable Rate Distortion Function and Bayesian F…

200 papers

Density functional theory (DFT), one of the most widely utilized methods available to computational chemistry, fails to describe systems with statically correlated electrons. To address this shortcoming, in previous work we transformed DFT…

Chemical Physics · Physics 2023-01-02 Daniel Gibney , Jan-Niklas Boyn , David A. Mazziotti

In the rate-distortion function and the Maximum Entropy (ME) method, Minimum Mutual In-formation (MMI) distributions and ME distributions are expressed by Bayes-like formulas, in-cluding Negative Exponential Functions (NEFs) and partition…

Information Theory · Computer Science 2021-10-18 Chenguang Lu

Rate distortion theory was developed for optimizing lossy compression of data, but it also has a lot of applications in statistics. In this paper we will see how rate distortion theory can be used to analyze a complicated data set involving…

Applications · Statistics 2023-03-22 Peter Harremoës

We study large deviations of a ratio observable in discrete-time reset processes. The ratio takes the form of a current divided by the number of reset steps and as such it is not extensive in time. A large deviation rate function can be…

Statistical Mechanics · Physics 2020-04-21 Francesco Coghi , Rosemary J. Harris

Berger's paper `The Source Coding Game', IEEE Trans. Inform. Theory, 1971, considers the problem of finding the rate-distortion function for an adversarial source comprised of multiple known IID sources. The adversary, called the…

Information Theory · Computer Science 2007-07-13 Hari Palaiyanur , Cheng Chang , Anant Sahai

Calculating perturbation response properties of materials from first principles provides a vital link between theory and experiment, but is bottlenecked by the high computational cost. Here a general framework is proposed to perform density…

Computational Physics · Physics 2024-03-01 He Li , Zechen Tang , Jingheng Fu , Wen-Han Dong , Nianlong Zou , Xiaoxun Gong , Wenhui Duan , Yong Xu

The solution of the continuous time filtering problem can be represented as a ratio of two expectations of certain functionals of the signal process that are parametrized by the observation path. We introduce a new time discretisation of…

Probability · Mathematics 2014-08-26 Dan Crisan , Salvador Ortiz-Latorre

The hierarchical and recursive expressive capability of rooted trees is applicable to represent statistical models in various areas, such as data compression, image processing, and machine learning. On the other hand, such hierarchical…

Machine Learning · Computer Science 2022-01-25 Yuta Nakahara , Shota Saito , Akira Kamatsuka , Toshiyasu Matsushima

Rate distortion theory is concerned with optimally encoding a given signal class $\mathcal{S}$ using a budget of $R$ bits, as $R\to\infty$. We say that $\mathcal{S}$ can be compressed at rate $s$ if we can achieve an error of…

Functional Analysis · Mathematics 2020-08-04 Philipp Grohs , Andreas Klotz , Felix Voigtlaender

The relation between the jump length probability distribution function and the spectral line profile in resonance atomic radiation trapping is considered for Partial Frequency Redistribution (PFR) between absorbed and reemitted radiation.…

We consider the rate-distortion function for lossy source compression, as well as the channel capacity for error correction, through the lens of distributional robustness. We assume that the distribution of the source or of the additive…

Information Theory · Computer Science 2024-05-14 Vikrant Malik , Taylan Kargin , Victoria Kostina , Babak Hassibi

Fairness in machine learning has attracted increasing attention in recent years. The fairness methods improving algorithmic fairness for in-distribution data may not perform well under distribution shifts. In this paper, we first…

Machine Learning · Computer Science 2023-10-24 Zhimeng Jiang , Xiaotian Han , Hongye Jin , Guanchu Wang , Rui Chen , Na Zou , Xia Hu

Since artificial intelligence has seen tremendous recent successes in many areas, it has sparked great interest in its potential for trustworthy and interpretable risk prediction. However, most models lack causal reasoning and struggle with…

Machine Learning · Computer Science 2024-01-23 Zhixuan Chu , Mengxuan Hu , Qing Cui , Longfei Li , Sheng Li

Shannon proved that if we can transmit bits reliably at rates larger than the rate distortion function $R(D)$, then we can transmit this source to within a distortion $D$. We answer the converse question ``If we can transmit a source to…

Information Theory · Computer Science 2007-07-13 Mukul Agarwal , Anant Sahai , Sanjoy Mitter

In this paper, distributed (or multiterminal) source coding with one distortion criterion and correlated messages is considered. This problem can be also called ``Berger-Yeung problem with correlated messages''. It corresponds to the source…

Information Theory · Computer Science 2009-08-18 Suhan Choi

This text investigates relations between two well-known family of algorithms, matrix factorisations and recursive linear filters, by describing a probabilistic model in which approximate inference corresponds to a matrix factorisation…

Machine Learning · Statistics 2015-09-08 Ömer Deniz Akyıldız

A class of distortions termed functional Bregman divergences is defined, which includes squared error and relative entropy. A functional Bregman divergence acts on functions or distributions, and generalizes the standard Bregman divergence…

Information Theory · Computer Science 2007-07-13 B. A. Frigyik , S. Srivastava , M. R. Gupta

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

While standard computational protocols for density functional theory (DFT) have universal applicability, differences exist in code implementations. Specific applications require manual parameter optimization, whereas high-throughput…

Materials Science · Physics 2025-08-12 Chenxi Lu , Musen Li , Jeffrey R. Reimers

Predictive recursion is an accurate and computationally efficient algorithm for nonparametric estimation of mixing densities in mixture models. In semiparametric mixture models, however, the algorithm fails to account for any uncertainty in…

Methodology · Statistics 2015-03-19 Ryan Martin , Surya T. Tokdar