English
Related papers

Related papers: Computation of Rate-Distortion-Perception Function…

200 papers

Many images and videos are primarily processed by computer vision algorithms, involving only occasional human inspection. When this content requires compression before processing, e.g., in distributed applications, coding methods must…

Image and Video Processing · Electrical Eng. & Systems 2025-08-27 Samuel Fernández-Menduiña , Eduardo Pavez , Antonio Ortega

The fundamental limit of natural signal compression has traditionally been characterized by classical rate-distortion (RD) theory through the tradeoff between coding rate and reconstruction distortion, while the rate-distortion-perception…

Information Theory · Computer Science 2026-04-17 Zijian Liang , Kai Niu , Changshuo Wang , Jin Xu , Ping Zhang

Consider the problem of estimating a latent signal from a lossy compressed version of the data when the compressor is agnostic to the relation between the signal and the data. This situation arises in a host of modern applications when data…

Information Theory · Computer Science 2021-01-12 Alon Kipnis , Stefano Rini , Andrea J. Goldsmith

End-to-end image transmission has recently become a crucial trend in intelligent wireless communications, driven by the increasing demand for high bandwidth efficiency. However, existing methods primarily optimize the trade-off between…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Kailin Tan , Jincheng Dai , Zhenyu Liu , Sixian Wang , Xiaoqi Qin , Wenjun Xu , Kai Niu , Ping Zhang

Whenever inspected by humans, reconstructed signals should not be distinguished from real ones. Typically, such a high perceptual quality comes at the price of high reconstruction error, and vice versa. We study this distortion-perception…

Information Theory · Computer Science 2024-02-06 Dror Freirich , Nir Weinberger , Ron Meir

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

In this paper we introduce a definition for nonanticipative Rate Distortion Function (RDF) on abstract alphabets, and we invoke weak convergence of probability measures to show various of its properties, such as, existence of the optimal…

Information Theory · Computer Science 2013-01-29 Photios A. Stavrou , Charalambos D. Charalambous , Christos K. Kourtellaris

In this paper, we consider a distributed remote source coding problem, where a sequence of observations of source vectors is available at the encoder. The problem is to specify the optimal rate for encoding the observations subject to a…

Information Theory · Computer Science 2014-06-05 Adel Zahedi , Jan Ostergaard , Soren Holdt Jensen , Patrick Naylor , Soren Bech

We recently introduced an efficient methodology to perform density-corrected Hartree-Fock density functional theory (DC(HF)-DFT) calculations and an extension to it we called "corrected" HF DFT (C(HF)-DFT). In this work, we take a further…

Chemical Physics · Physics 2023-11-10 Daniel Graf , Alex J. W. Thom

Algorithms based on multiple decoding attempts of Reed-Solomon (RS) codes have recently attracted new attention. Choosing decoding candidates based on rate-distortion (R-D) theory, as proposed previously by the authors, currently provides…

Information Theory · Computer Science 2016-11-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

Rate distortion theory treats the problem of encoding a source with minimum codebook size while at the same time allowing for a certain amount of errors in the reconstruction measured by a fidelity criterion and distortion level. Similar to…

Information Theory · Computer Science 2025-11-13 Jonathan E. W. Huffmann , Holger Boche

The additive rate-distortion function (ARDF) was developed in order to universally bound the rate loss in the Wyner-Ziv problem, and has since then been instrumental in e.g., bounding the rate loss in successive refinements, universal…

Information Theory · Computer Science 2011-05-26 Jan Ostergaard , Ram Zamir

In lossy compression, the classical tradeoff between compression rate and reconstruction distortion has traditionally guided algorithm design. However, Blau and Michaeli [5] introduced a generalized framework, known as the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Nam Nguyen

We deal with zero-delay source coding of a vector Gaussian autoregressive (AR) source subject to an average mean squared error (MSE) fidelity criterion. Toward this end, we consider the nonanticipative rate distortion function (NRDF) which…

Information Theory · Computer Science 2017-08-22 Photios A. Stavrou , Jan Ostergaard , Charalambos D. Charalambous , Milan Derpich

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

We formalise the widespread idea of interpreting neural network decisions as an explicit optimisation problem in a rate-distortion framework. A set of input features is deemed relevant for a classification decision if the expected…

Machine Learning · Computer Science 2019-05-28 Jan Macdonald , Stephan Wäldchen , Sascha Hauch , Gitta Kutyniok

In order to improve the ability of cognitive radar (CR) to adapt to the environment, the required ambiguity function (AF) can be synthesized by designing the waveform. The key to this problem is how to minimize the interference power.…

Signal Processing · Electrical Eng. & Systems 2022-09-09 Haoyu Yi , Xinyu Zhang , Weidong Jiang , Kai Huo

A recursive least squares algorithm with variable rate forgetting (VRF) is derived by minimizing a quadratic cost function.Under persistent excitation and boundedness of the forgetting factor, the minimizer given by VRF is shown to converge…

Optimization and Control · Mathematics 2020-03-06 Adam L. Bruce , Ankit Goel , Dennis S. Bernstein

We derive a simple general parametric representation of the rate-distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the…

Information Theory · Computer Science 2010-04-30 Neri Merhav

In rate-distortion (RD) problems one seeks reduced representations of a source that meet a target distortion constraint. Such optimal representations undergo topological transitions at some critical rate values, when their cardinality or…

Information Theory · Computer Science 2023-10-09 Shlomi Agmon , Etam Benger , Or Ordentlich , Naftali Tishby