English
Related papers

Related papers: One step RSB scheme for the rate distortion functi…

200 papers

Dynamics under which a system of Ising spins relaxes to a stationary state with Bolzmann-Gibbs measure and which do not fulfil the condition of detailed balance are irreversible and asymmetric. We revisit the problem of the determination of…

Statistical Mechanics · Physics 2015-06-15 Claude Godreche

Existing diffusion-based methods for inverse problems sample from the posterior using score functions and accept the generated random samples as solutions. In applications that posterior mean is preferred, we have to generate multiple…

Machine Learning · Computer Science 2024-10-10 Zhipeng Xue , Penghao Cai , Xiaojun Yuan , Xiqi Gao

In this paper, we present a convergence rate analysis for the inexact Krasnosel'skii-Mann iteration built from nonexpansive operators. Our results include two main parts: we first establish global pointwise and ergodic iteration-complexity…

Optimization and Control · Mathematics 2015-09-17 Jingwei Liang , Jalal Fadili , Gabriel Peyré

This paper investigates the rate-distortion function, under a squared error distortion $D$, for an $n$-dimensional random vector uniformly distributed on an $(n-1)$-sphere of radius $R$. First, an expression for the rate-distortion function…

Information Theory · Computer Science 2024-01-10 Alex Dytso , Martina Cardone

One-bit compressive sensing (CS) is an advanced version of sparse recovery in which the sparse signal of interest can be recovered from extremely quantized measurements. Namely, only the sign of each measurement is available to us. In many…

Information Theory · Computer Science 2019-10-22 Hossein Beheshti , Sajad Daei , Farzan Haddadi

Reachability analysis provides formal guarantees for performance and safety properties of nonlinear control systems. Here, one aims to compute the backward reachable set (BRS) or tube (BRT) -- the set of states from which the system can be…

Optimization and Control · Mathematics 2017-07-18 Mo Chen , Sylvia L. Herbert , Mahesh S. Vashishtha , Somil Bansal , Claire J. Tomlin

In several areas of optics and photonics like wave propagation, digital holography, holographic microscopy, diffraction imaging, biomedical imaging and diffractive optics, the behavior of the electromagnetic waves has to be calculated with…

Optics · Physics 2018-02-14 Soheil Mehrabkhani , Thomas Schneider

This paper revisits the rate-distortion theory from the perspective of optimal weak transport, as recently introduced by Gozlan et al. While the conditions for optimality and the existence of solutions are well-understood in the case of…

Information Theory · Computer Science 2025-01-27 Jiayang Zou , Luyao Fan , Jiayang Gao , Jia Wang

Compressed sensing allows for the recovery of sparse signals from few measurements, whose number is proportional to the sparsity of the unknown signal, up to logarithmic factors. The classical theory typically considers either random linear…

Functional Analysis · Mathematics 2025-04-02 Giovanni S. Alberti , Alessandro Felisi , Matteo Santacesaria , S. Ivan Trapasso

We provide a scheme for exploring the reconstruction limit of compressed sensing by minimizing the general cost function under the random measurement constraints for generic correlated signal sources. Our scheme is based on the statistical…

Information Theory · Computer Science 2011-07-04 Koujin Takeda , Yoshiyuki Kabashima

A shortcoming of existing reachability approaches for nonlinear systems is the poor scalability with the number of continuous state variables. To mitigate this problem we present a simulation-based approach where we first sample a number of…

Systems and Control · Computer Science 2017-09-21 Murat Arcak , John Maidens

In this short note, we present supporting evidence for the replica symmetric approach to the random bond q-state Potts models. The evidence is statistically strong enough to reject the applicability of the Parisi replica symmetry breaking…

Statistical Mechanics · Physics 2009-10-31 Marc-Andre Lewis

Sequential rate-distortion (SRD) theory provides a framework for studying the fundamental trade-off between data-rate and data-quality in real-time communication systems. In this paper, we consider the SRD problem for multi-dimensional…

Optimization and Control · Mathematics 2018-01-16 Takashi Tanaka , Kwang-Ki K. Kim , Pablo A. Parrilo , Sanjoy K. Mitter

We construct a general framework for deriving error bounds for conic feasibility problems. In particular, our approach allows one to work with cones that fail to be amenable or even to have computable projections, two previously challenging…

Optimization and Control · Mathematics 2022-10-17 Scott B. Lindstrom , Bruno F. Lourenço , Ting Kei Pong

Some interesting recent advances in the theoretical understanding of neural networks have been informed by results from the physics of disordered many-body systems. Motivated by these findings, this work uses the replica technique to study…

Disordered Systems and Neural Networks · Physics 2018-08-17 Gavin Hartnett , Edward Parker , Edward Geist

We provide the first examples of two-step replica symmetry breaking (2-RSB) models for the spherical mixed p-spin glass at zero temperature. Precisely, we show that for a certain class of mixtures, the Parisi measure at zero temperature is…

Probability · Mathematics 2018-10-17 Antonio Auffinger , Qiang Zeng

The one-bit compressed sensing framework aims to reconstruct a sparse signal by only using the sign information of its linear measurements. To compensate for the loss of scale information, past studies in the area have proposed recovering…

Information Theory · Computer Science 2016-09-21 Yingying Xu , Yoshiyuki Kabashima

The Renyi entropy is a generalisation of the Shannon entropy that is sensitive to the fine details of a probability distribution. We present results for the Renyi entropy of the totally asymmetric exclusion process (TASEP). We calculate…

Statistical Mechanics · Physics 2017-11-10 Anthony J. Wood , Richard A. Blythe , Martin R. Evans

This paper addresses the inverse problem of identifying the linear velocity coefficient in a linear system governed by two Benjamin-Bona-Mahony-type equations, which model the displacement of water waves propagating along the surface of a…

Analysis of PDEs · Mathematics 2025-09-29 Deissy Marcela Pizo , Juan Carlos Muñoz Grajales

In this paper, we employ the thoughts and methodologies of Shannon's information theory to solve the problem of the optimal radar parameter estimation. Based on a general radar system model, the \textit{a posteriori} probability density…

Information Theory · Computer Science 2025-09-30 Dazhuan Xu , Han Zhang , Nan Wang