English
Related papers

Related papers: Rate-Distortion Bounds for Heterogeneous Random Fi…

200 papers

As a simplified model of randomly pinned vortex lattices or charge-density waves, we study the random-field XY model on square ($d=2$) and simple cubic ($d=3$) lattices. We argue, and confirm in simulations, that the spacing between…

Condensed Matter · Physics 2015-04-07 Michel J. P. Gingras , David A. Huse

A sparse random block matrix model suggested by the Hessian matrix used in the study of elastic vibrational modes of amorphous solids is presented and analyzed. By evaluating some moments, benchmarked against numerics, differences in the…

Disordered Systems and Neural Networks · Physics 2018-03-21 Giovanni M. Cicuta , Johannes Krausser , Rico Milkus , Alessio Zaccone

In this work we introduce a symmetry classification for electronic density waves which break translational symmetry due to commensurate wave vector modulations. The symmetry classification builds on the concept of extended point groups:…

Strongly Correlated Electrons · Physics 2016-03-08 J. W. F. Venderbos

The stochastic density functional theory (DFT) [Phys. Rev. Lett. 111, 106402 (2013)] is a valuable linear scaling approach to Kohn-Sham DFT that does not rely on the sparsity of the density matrix. Linear (and often sub-linear) scaling is…

Chemical Physics · Physics 2019-02-20 Ming Chen , Roi Baer , Daniel Neuhauser , Eran Rabani

Modern compression algorithms exploit complex structures that are present in signals to describe them very efficiently. On the other hand, the field of compressed sensing is built upon the observation that "structured" signals can be…

Information Theory · Computer Science 2016-01-08 Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor

The fast growth of computational power and scales of modern super-computing systems have raised great challenges for the management of exascale scientific data. To maintain the usability of scientific data, error-bound lossy compression is…

Machine Learning · Computer Science 2023-11-08 Jinyang Liu , Sheng Di , Sian Jin , Kai Zhao , Xin Liang , Zizhong Chen , Franck Cappello

A framework is developed using techniques from rate distortion theory in statistical testing. The idea is first to do optimal compression according to a certain distortion function and then use information divergence from the compressed…

Information Theory · Computer Science 2009-04-01 Peter Harremoes

We consider a rate-distortion version of the quantum state redistribution task, where the error of the decoded state is judged via an additive distortion measure; it thus constitutes a quantum generalisation of the classical Wyner-Ziv…

Quantum Physics · Physics 2025-04-11 Zahra Baghali Khanian , Andreas Winter

The rate-distortion dimension (RDD) of an analog stationary process is studied as a measure of complexity that captures the amount of information contained in the process. It is shown that the RDD of a process, defined as two times the…

Information Theory · Computer Science 2016-11-18 Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor

The goal of this paper is to develop methodology for the systematic analysis of asymptotic statistical properties of data driven DRO formulations based on their corresponding non-DRO counterparts. We illustrate our approach in various…

Optimization and Control · Mathematics 2023-03-28 Jose Blanchet , Alexander Shapiro

We study the close interplay between error and compression in the non-parametric multiclass classification setting in terms of prototype learning rules. We focus in particular on a recently proposed compression-based learning rule termed…

Machine Learning · Computer Science 2022-12-27 Omer Kerem , Roi Weiss

We perform a model-independent reconstruction of the cosmic distances using the Multi-Task Gaussian Process (MTGP) framework as well as knot-based spline techniques with DESI-DR2 BAO and DES-SN5YR datasets. We calibrate the comoving sound…

Cosmology and Nongalactic Astrophysics · Physics 2025-12-02 Purba Mukherjee , Anjan A Sen

Raptor code ensembles with linear random outer codes in a fixed-rate setting are considered. An expression for the average distance spectrum is derived and this expression is used to obtain the asymptotic exponent of the weight…

Information Theory · Computer Science 2015-11-03 Francisco Lázaro , Enrico Paolini , Gianluigi Liva , Gerhard Bauch

We establish the fundamental limits of lossless analog compression by considering the recovery of arbitrary m-dimensional real random vectors x from the noiseless linear measurements y=Ax with n x m measurement matrix A. Our theory is…

Functional Analysis · Mathematics 2024-10-03 Giovanni Alberti , Helmut Bölcskei , Camillo De Lellis , Günther Koliander , Erwin Riegler

In this paper we provide new compact integral expressions and associated simple asymptotic approximations for converse and achievability bounds in the finite blocklength regime. The chosen converse and random coding union bounds were taken…

Information Theory · Computer Science 2016-10-25 Tomaso Erseghe

We derive a lower bound on the differential entropy of a log-concave random variable $X$ in terms of the $p$-th absolute moment of $X$. The new bound leads to a reverse entropy power inequality with an explicit constant, and to new bounds…

Information Theory · Computer Science 2018-04-04 Arnaud Marsiglietti , Victoria Kostina

We consider a novel variant of $d$-semifaithful lossy coding in which the distortion measure is revealed only to the encoder and only at run-time, as well as an extension of it in which the distortion constraint $d$ is also revealed at…

Information Theory · Computer Science 2022-10-05 Adeel Mahmood , Aaron B. Wagner

We study the dynamics of hardcore spin models on the square and triangular lattice, constructed by analogy to hard spheres, where the translational degrees of freedom of the spheres are replaced by orientational degrees of freedom of spins…

Statistical Mechanics · Physics 2023-06-02 Benedikt Placke , Grace M. Sommers , S. L. Sondhi , Roderich Moessner

Random Reshuffling (RR), which is a variant of Stochastic Gradient Descent (SGD) employing sampling without replacement, is an immensely popular method for training supervised machine learning models via empirical risk minimization. Due to…

Machine Learning · Computer Science 2022-05-11 Grigory Malinovsky , Peter Richtárik

The framework of Integral Quadratic Constraints of Lessard et al. (2014) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to semi-definite programming (SDP). Followup work by Nishihara et…

Machine Learning · Statistics 2018-03-06 Guilherme França , José Bento
‹ Prev 1 8 9 10 Next ›