English
Related papers

Related papers: Nonanticipative Rate Distortion Function and Relat…

200 papers

This paper introduces a new conceptual framework that recasts surface roughness effects as a "ray deflection function" (RDF) which can be statistically represented through a modified Zernike-Fourier hybrid approach that directly connects…

Optics · Physics 2025-08-12 Netzer Moriya

We show how rate-distortion theory provides a mechanism for automated theory building by naturally distinguishing between regularity and randomness. We start from the simple principle that model variables should, as much as possible, render…

Data Analysis, Statistics and Probability · Physics 2016-09-08 Susanne Still , James P. Crutchfield

We study a large deviation functional of density fluctuation by analyzing stochastic non-linear diffusion equations driven by the difference between the densities fixed at the boundaries. By using a fundamental equality that yields the…

Statistical Mechanics · Physics 2009-11-13 Shin-ichi Sasa

Fundamental rate-distortion-perception (RDP) trade-offs arise in applications requiring maintained perceptual quality of reconstructed data, such as neural image compression. When compressed data is transmitted over public communication…

Information Theory · Computer Science 2026-04-23 Gustaf Åhlgren , Onur Günlü

We prove achievability of the recently characterized quadratic Gaussian rate-distortion function (RDF) subject to the constraint that the distortion is uncorrelated to the source. This result is based on shaped dithered lattice quantization…

Information Theory · Computer Science 2008-07-24 Milan S. Derpich , Jan Ostergaard , Daniel E. Quevedo

Turing machine and decision tree have developed independently for a long time. With the recent development of differentiable models, there is an intersection between them. Neural turing machine(NTM) opens door for the memory network. It use…

Machine Learning · Computer Science 2020-10-29 Yingshi Chen

The bidirectional reflectance distribution function (BRDF) is an essential tool to capture the complex interaction of light and matter. Recently, several works have employed neural methods for BRDF modeling, following various strategies,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Florian Hofherr , Bjoern Haefner , Daniel Cremers

Recent efforts in neural compression have focused on the rate-distortion-perception (RDP) tradeoff, where the perception constraint ensures the source and reconstruction distributions are close in terms of a statistical divergence.…

Information Theory · Computer Science 2025-05-21 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

Renewal theory is finding increasing applications in non-equilibrium statistical physics. One example relates the probability density and survival probability of a Brownian particle or an active run-and-tumble particle with stochastic…

Statistical Mechanics · Physics 2025-03-04 Paul C Bressloff

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard…

Optimization and Control · Mathematics 2024-03-26 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

The solution of the continuous time filtering problem can be represented as a ratio of two expectations of certain functionals of the signal process that are parametrized by the observation path. We introduce a new time discretisation of…

Probability · Mathematics 2014-08-26 Dan Crisan , Salvador Ortiz-Latorre

The nascent field of Rate-Distortion-Perception (RDP) theory is seeing a surge of research interest due to the application of machine learning techniques in the area of lossy compression. The information RDP function characterizes the…

Information Theory · Computer Science 2023-05-01 Chunhui Chen , Xueyan Niu , Wenhao Ye , Shitong Wu , Bo Bai , Weichao Chen , Sian-Jheng Lin

Rate-distortion (R-D) function, a key quantity in information theory, characterizes the fundamental limit of how much a data source can be compressed subject to a fidelity criterion, by any compression algorithm. As researchers push for…

Information Theory · Computer Science 2022-03-14 Yibo Yang , Stephan Mandt

Linear-response time-dependent Density Functional Theory (LR-TDDFT) is a widely used method for accurately predicting the excited-state properties of physical systems. Previous works have attempted to accelerate LR-TDDFT using heterogeneous…

Hardware Architecture · Computer Science 2025-04-07 Qingcai Jiang , Buxin Tu , Xiaoyu Hao , Junshi Chen , Hong An

Reaction-Diffusion (RD) systems provide a computational framework that governs many pattern formation processes in nature. Current RD system design practices boil down to trial-and-error parameter search. We propose a differentiable…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Alexander Mordvintsev , Ettore Randazzo , Eyvind Niklasson

Rate distortion theory treats the problem of encoding a source with minimum codebook size while at the same time allowing for a certain amount of errors in the reconstruction measured by a fidelity criterion and distortion level. Similar to…

Information Theory · Computer Science 2025-11-13 Jonathan E. W. Huffmann , Holger Boche

In room acoustic environments, the Relative Transfer Functions (RTFs) are controlled by few underlying modes of variability. Accordingly, they are confined to a low-dimensional manifold. In this letter, we investigate a RTF inverse…

Sound · Computer Science 2017-10-26 Ziteng Wang , Emmanuel Vincent , Yonghong Yan

Odd diffusion breaks time-reversal symmetry in overdamped systems through transverse probability currents while preserving equilibrium steady states. In this work, we develop a dynamical density functional theory (DDFT) for dense…

Soft Condensed Matter · Physics 2026-02-02 Iman Abdoli , René Wittmann , Hartmut Löwen

Classical worst-case optimization theory neither explains the success of optimization in machine learning, nor does it help with step size selection. In this paper we demonstrate the viability and advantages of replacing the classical…

Optimization and Control · Mathematics 2024-10-16 Felix Benning , Leif Döring

This paper is concerned with quantum data compression of asymptotically many independent and identically distributed copies of ensembles of mixed quantum states. The encoder has access to a side information system. The figure of merit is…

Quantum Physics · Physics 2024-06-21 Zahra Baghali Khanian , Kohdai Kuroiwa , Debbie Leung