English
Related papers

Related papers: Phase Diagram and Approximate Message Passing for …

200 papers

We study the phase transition phenomenon inherent in the shuffled (permuted) regression problem, which has found numerous applications in databases, privacy, data analysis, etc. In this study, we aim to precisely identify the locations of…

Machine Learning · Statistics 2023-11-01 Hang Zhang , Ping Li

Generalized Vector Approximate Message Passing (GVAMP) is an efficient iterative algorithm for approximately minimum-mean-squared-error estimation of a random vector $\mathbf{x}\sim p_{\mathbf{x}}(\mathbf{x})$ from generalized linear…

Information Theory · Computer Science 2018-06-27 Christopher A. Metzler , Philip Schniter , Richard G. Baraniuk

Approximate message passing (AMP) emerges as an effective iterative paradigm for solving high-dimensional statistical problems. However, prior AMP theory -- which focused mostly on high-dimensional asymptotics -- fell short of predicting…

Statistics Theory · Mathematics 2023-03-20 Gen Li , Yuting Wei

In this paper, the `Approximate Message Passing' (AMP) algorithm, initially developed for compressed sensing of signals under i.i.d. Gaussian measurement matrices, has been extended to a multi-terminal setting (MAMP algorithm). It has been…

Information Theory · Computer Science 2014-01-14 Saeid Haghighatshoar

Probabilistic inference problems arise naturally in distributed systems such as sensor networks and teams of mobile robots. Inference algorithms that use message passing are a natural fit for distributed systems, but they must be robust to…

Artificial Intelligence · Computer Science 2012-07-19 Mark Paskin , Carlos E. Guestrin

Fitting a polynomial to observed data is an ubiquitous task in many signal processing and machine learning tasks, such as interpolation and prediction. In that context, input and output pairs are available and the goal is to find the…

Signal Processing · Electrical Eng. & Systems 2022-10-25 Alberto Natali , Geert Leus

Blind gain and phase calibration (BGPC) is a bilinear inverse problem involving the determination of unknown gains and phases of the sensing system, and the unknown signal, jointly. BGPC arises in numerous applications, e.g., blind albedo…

Information Theory · Computer Science 2017-12-04 Yanjun Li , Kiryung Lee , Yoram Bresler

In this letter, we apply the artificial neural network in a supervised manner to map out the quantum phase diagram of disordered topological superconductor in class DIII. Given the disorder that keeps the discrete symmetries of the ensemble…

Disordered Systems and Neural Networks · Physics 2018-05-16 Nobuyuki Yoshioka , Yutaka Akagi , Hosho Katsura

Approximate Message Passing (AMP) algorithms enable precise characterization of certain classes of random objects in the high-dimensional limit, and have found widespread applications in fields such as signal processing, statistics, and…

Statistics Theory · Mathematics 2025-07-01 Longlin Wang , Yanke Song , Kuanhao Jiang , Pragya Sur

Is perfect error correction always worth the trouble? A framework is presented for the analysis of error detection and correction in multi-level systems of communication that takes into account degrees of freedom attended and ignored by…

Information Theory · Computer Science 2020-01-15 Tom Sgouros

In a physical system, changing parameters such as temperature can induce a phase transition: an abrupt change from one state of matter to another. Analogous phenomena have recently been observed in large language models. Typically, the task…

Machine Learning · Computer Science 2024-05-28 Julian Arnold , Flemming Holtorf , Frank Schäfer , Niels Lörch

Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Gongbo Liang , Yu Zhang , Xiaoqin Wang , Nathan Jacobs

Compressed sensing posits that, within limits, one can undersample a sparse signal and yet reconstruct it accurately. Knowing the precise limits to such undersampling is important both for theory and practice. We present a formula that…

Information Theory · Computer Science 2013-01-09 David Donoho , Iain Johnstone , Andrea Montanari

Large language models (LLMs) demonstrate remarkable breadth of knowledge, yet their ability to reason about computational processes remains poorly understood. Closing this gap matters for practitioners who rely on LLMs to guide algorithm…

Computation and Language · Computer Science 2026-04-07 Sohan Venkatesh , Ashish Mahendran Kurapath , Tejas Melkote

When recovering a sparse signal from noisy compressive linear measurements, the distribution of the signal's non-zero coefficients can have a profound effect on recovery mean-squared error (MSE). If this distribution was apriori known, then…

Information Theory · Computer Science 2015-06-05 Jeremy P. Vila , Philip Schniter

A probabilistic model is said to be calibrated if its predicted probabilities match the corresponding empirical frequencies. Calibration is important for uncertainty quantification and decision making in safety-critical applications. While…

Machine Learning · Computer Science 2020-07-01 Anusri Pampari , Stefano Ermon

This paper is concerned with the problem of reconstructing an unknown rank-one matrix with prior structural information from noisy observations. While computing the Bayes-optimal estimator seems intractable in general due to its nonconvex…

Statistics Theory · Mathematics 2023-02-08 Gen Li , Wei Fan , Yuting Wei

Massive multiple-input multiple-output (MIMO) promises significantly higher performance relative to conventional multiuser systems. However, the promised gains of massive MIMO systems rely heavily on the accuracy of the absolute front-end…

Information Theory · Computer Science 2020-02-26 Guoda Tian , Harsh Tataria , Fredrik Tufvesson

This paper is divided into two parts. The first part is devoted to the study of a class of Approximate Message Passing (AMP) algorithms which are widely used in the fields of statistical physics, machine learning, or communication theory.…

Probability · Mathematics 2024-06-13 Walid Hachem

Phase estimation protocols provide a fundamental benchmark for the field of quantum metrology. The latter represents one of the most relevant applications of quantum theory, potentially enabling the capability of measuring unknown physical…