English
Related papers

Related papers: Phase Diagram and Approximate Message Passing for …

200 papers

We consider a recently proposed convex formulation, known as the PhaseMax method, for solving the phase retrieval problem. Using the replica method from statistical mechanics, we analyze the performance of PhaseMax in the high-dimensional…

Information Theory · Computer Science 2017-08-14 Oussama Dhifallah , Yue M. Lu

The large scale behavior of systems having a large number of interacting degrees of freedom is suitably described using renormalization group, from non-Gaussian distributions. Renormalization group techniques used in physics are then…

High Energy Physics - Theory · Physics 2022-03-04 Vincent Lahoche , Dine Ousmane Samary , Mohamed Tamaazousti

In this paper, we extend the bilinear generalized approximate message passing (BiG-AMP) approach, originally proposed for high-dimensional generalized bilinear regression, to the multi-layer case for the handling of cascaded problem such as…

Information Theory · Computer Science 2021-09-08 Qiuyun Zou , Haochuan Zhang , Hongwen Yang

We propose an iterative proposal to estimate critical points for statistical models based on configurations by combing machine-learning tools. Firstly, phase scenarios and preliminary boundaries of phases are obtained by…

Disordered Systems and Neural Networks · Physics 2019-10-23 X. L. Zhao , L. B. Fu

Approximate Message Passing (AMP) has been shown to be a superior method for inference problems, such as the recovery of signals from sets of noisy, lower-dimensionality measurements, both in terms of reconstruction accuracy and in…

Information Theory · Computer Science 2015-06-10 Andre Manoel , Florent Krzakala , Eric W. Tramel , Lenka Zdeborová

In this work, we propose a mean-squared error-based risk that enables the comparison and optimization of estimators of squared calibration errors in practical settings. Improving the calibration of classifiers is crucial for enhancing the…

Machine Learning · Computer Science 2025-02-24 Sebastian G. Gruber , Francis Bach

This paper studies a large random matrix system (LRMS) model involving an arbitrary signal distribution and forward error control (FEC) coding. We establish an area property based on the approximate message passing (AMP) algorithm. Under…

Information Theory · Computer Science 2021-06-07 Lei Liu , Chulong Liang , Junjie Ma , Li Ping

Approximate message passing (AMP) methods have gained recent traction in sparse signal recovery. Additional information about the signal, or \emph{side information} (SI), is commonly available and can aid in efficient signal recovery. This…

Information Theory · Computer Science 2019-05-06 Anna Ma , You , Zhou , Cynthia Rush , Dror Baron , Deanna Needell

Symmetry is a powerful tool for understanding phases of matter in equilibrium. Quantum circuits with measurements have recently emerged as a platform for novel states of matter intrinsically out of equilibrium. Can symmetry be used as an…

Quantum Physics · Physics 2025-06-18 Zhi Li , Zhu-Xi Luo

Computational sensing strategies often suffer from calibration errors in the physical implementation of their ideal sensing models. Such uncertainties are typically addressed by using multiple, accurately chosen training signals to recover…

Information Theory · Computer Science 2022-05-26 Valerio Cambareri , Laurent Jacques

Recovering a sparse signal from an undersampled set of random linear measurements is the main problem of interest in compressed sensing. In this paper, we consider the case where both the signal and the measurements are complex. We study…

Information Theory · Computer Science 2015-03-19 Arian Maleki , Laura Anitori , Zai Yang , Richard Baraniuk

The Random Language Model, proposed as a simple model of human languages, is defined by the averaged model of a probabilistic context-free grammar. This grammar expresses the process of sentence generation as a tree graph with nodes having…

Disordered Systems and Neural Networks · Physics 2022-07-07 Kai Nakaishi , Koji Hukushima

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Multi-task learning has attracted much attention due to growing multi-purpose research with multiple related data sources. Moreover, transduction with matrix completion is a useful method in multi-label learning. In this paper, we propose a…

Machine Learning · Statistics 2023-02-21 Hengfang Wang , Yasi Zhang , Xiaojun Mao , Zhonglei Wang

A large set of signals can sometimes be described sparsely using a dictionary, that is, every element can be represented as a linear combination of few elements from the dictionary. Algorithms for various signal processing applications,…

Machine Learning · Statistics 2013-02-06 Daniel Vainsencher , Shie Mannor , Alfred M. Bruckstein

A common goal in many research areas is to reconstruct an unknown signal x from noisy linear measurements. Approximate message passing (AMP) is a class of low-complexity algorithms for efficiently solving such high-dimensional regression…

Information Theory · Computer Science 2019-05-07 Hangjin Liu , Cynthia Rush , Dror Baron

We analyze the dynamics of a random sequential message passing algorithm for approximate inference with large Gaussian latent variable models in a student-teacher scenario. To model nontrivial dependencies between the latent variables, we…

Machine Learning · Computer Science 2022-07-13 Burak Çakmak , Yue M. Lu , Manfred Opper

In this paper we propose a new efficient message passing algorithm for decoding LDPC transmitted over a channel with strong phase noise. The algorithm performs approximate bayesian inference on a factor graph representation of the channel…

Information Theory · Computer Science 2012-04-13 Shachar Shayovitz , Dan Raphaeli

The ability to understand and solve high-dimensional inference problems is essential for modern data science. This article examines high-dimensional inference problems through the lens of information theory and focuses on the standard…

Information Theory · Computer Science 2019-07-05 Galen Reeves , Henry Pfister

The max-product algorithm, a local message-passing scheme that attempts to compute the most probable assignment (MAP) of a given probability distribution, has been successfully employed as a method of approximate inference for applications…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda