English
Related papers

Related papers: Statistical physics of random binning

200 papers

Brain-inspired learning models attempt to mimic the cortical architecture and computations performed in the neurons and synapses constituting the human brain to achieve its efficiency in cognitive tasks. In this work, we present…

Neural and Evolutionary Computing · Computer Science 2017-03-21 Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Reed-Muller (RM) codes achieve the capacity of general binary-input memoryless symmetric channels and are conjectured to have a comparable performance to that of random codes in terms of scaling laws. However, such results are established…

Information Theory · Computer Science 2023-08-02 Mohammad Vahid Jamali , Xiyang Liu , Ashok Vardhan Makkuva , Hessam Mahdavifar , Sewoong Oh , Pramod Viswanath

Reed-Muller (RM) codes are known for their good maximum likelihood (ML) performance in the short block-length regime. Despite being one of the oldest classes of channel codes, finding a low complexity soft-input decoding scheme is still an…

Information Theory · Computer Science 2021-07-19 Marvin Geiselhart , Ahmed Elkelesh , Moustafa Ebada , Sebastian Cammerer , Stephan ten Brink

We provide a comprehensive performance comparison of soft-output and hard-output demodulators in the context of non-iterative multiple-input multiple-output bit-interleaved coded modulation (MIMO-BICM). Coded bit error rate (BER), widely…

Information Theory · Computer Science 2010-12-07 Peter Fertl , Joakim Jalden , Gerald Matz

Random binning features, introduced in the seminal paper of Rahimi and Recht (2007), are an efficient method for approximating a kernel matrix using locality sensitive hashing. Random binning features provide a very simple and efficient way…

Machine Learning · Statistics 2020-03-24 Michael Kapralov , Navid Nouri , Ilya Razenshteyn , Ameya Velingker , Amir Zandieh

Despite the extreme error-correction performance, the amount of computation of sequential decoding of the polarization-adjusted convolutional (PAC) codes is random. In sequential decoding of convolutional codes, the computational cutoff…

Information Theory · Computer Science 2022-11-30 Mohsen Moradi

We revisit the idea of using deep neural networks for one-shot decoding of random and structured codes, such as polar codes. Although it is possible to achieve maximum a posteriori (MAP) bit error rate (BER) performance for both code…

Information Theory · Computer Science 2017-01-27 Tobias Gruber , Sebastian Cammerer , Jakob Hoydis , Stephan ten Brink

A key problem in deep learning and computational neuroscience is relating the geometrical properties of neural representations to task performance. Here, we consider this problem for continuous decoding tasks where neural variability may…

Disordered Systems and Neural Networks · Physics 2025-07-01 Abdulkadir Canatar , SueYeon Chung

This paper focuses on semi-supervised crowd counting, where only a small portion of the training data are labeled. We formulate the pixel-wise density value to regress as a probability distribution, instead of a single deterministic value.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Hui Lin , Zhiheng Ma , Rongrong Ji , Yaowei Wang , Zhou Su , Xiaopeng Hong , Deyu Meng

The problem of classical data compression when the decoder has quantum side information at his disposal is considered. This is a quantum generalization of the classical Slepian-Wolf theorem. The optimal compression rate is found to be…

Quantum Physics · Physics 2017-08-01 I. Devetak , A. Winter

We study the performance of binary spatially-coupled low-density parity-check codes (SC-LDPC) when used with bit-interleaved coded-modulation (BICM) schemes. This paper considers the cases when transmission takes place over additive white…

Information Theory · Computer Science 2013-03-05 Arvind Yedla , Mostafa El-Khamy , Jungwon Lee , Inyup Kang

A statistical model of discrete finite length random processes with negative power law spectral densities is presented. The definition of terms is followed by a description of the spectral density trend. An algorithmic construction of…

Instrumentation and Methods for Astrophysics · Physics 2023-02-13 Robert Kimberk , Keara Carter , Todd Hunter

We address photon-number-assisted, polarization- based, binary communication systems equipped with photon counting receivers. In these channels information is encoded in the value of polarization phase-shift but the carrier has and…

We present a Random-Phase-Approximation formalism for the collective spectrum of two hyperfine species of dilute 40K atoms, magnetically trapped at zero temperature and subjected to a repulsive s-wave interaction between atoms with…

Condensed Matter · Physics 2009-10-31 P. Capuzzi , E. S. Hernandez

The encoder and decoder for lossy data compression of binary memoryless sources are developed on the basis of a specific-type nonmonotonic perceptron. Statistical mechanical analysis indicates that the potential ability of the…

Information Theory · Computer Science 2009-11-11 Tadaaki Hosaka , Yoshiyuki Kabashima

The thermodynamic and retrieval properties of the Blume-Emery-Griffiths neural network with synchronous updating and variable dilution are studied using replica mean-field theory. Several forms of dilution are allowed by pruning the…

Disordered Systems and Neural Networks · Physics 2007-05-23 D. Bollé , J. Busquets Blanco

Warm dense matter (WMD) describes an intermediate phase, between condensed matter and classical plasmas, found in natural and man-made systems. In a laboratory setting, WDM needs to be created dynamically. It is typically laser or…

Plasma Physics · Physics 2022-03-14 Alexander J. White , Lee A. Collins , Katarina Nichols , S. X. Hu

We analyze the depinning transition of a driven interface in the 3d random-field Ising model (RFIM) with quenched disorder by means of Monte Carlo simulations. The interface initially built into the system is perpendicular to the…

Statistical Mechanics · Physics 2009-10-31 L. Roters , A. Hucht , S. Lubeck , U. Nowak , K. D. Usadel

The statistical model assuming chemical equilibriumand local strangeness conservation describes most of the observed features of strange particle production from SIS up to RHIC. Deviations are found as the maximum in the measured K+/pi+…

High Energy Physics - Phenomenology · Physics 2014-11-20 H. Oeschler , J. Cleymans , K. Redlich , S. Wheaton

This work proves new results on the ability of binary Reed-Muller codes to decode from random errors and erasures. We obtain these results by proving improved bounds on the weight distribution of Reed-Muller codes of high degrees.…

Information Theory · Computer Science 2018-12-03 Ori Sberlo , Amir Shpilka