English
Related papers

Related papers: Two Lectures on Iterative Coding and Statistical M…

200 papers

These notes are based on lectures given at the Les Houches Summer School in 2011, which was centered on the general topic "Theoretical Physics to face the challenge of LHC". In these lectures I reviewed a number of topics in the field of…

High Energy Physics - Theory · Physics 2012-04-25 Luis E. Ibanez

This is a writeup of lectures on "statistics" that have evolved from the initial version for the 2009 Hadron Collider Physics Summer School at CERN to versions for other venues and, most recently, for the African School of Fundamental…

Data Analysis, Statistics and Probability · Physics 2024-06-27 Robert D. Cousins

This thesis studies two problems in modern statistics. First, we study selective inference, or inference for hypothesis that are chosen after looking at the data. The motiving application is inference for regression coefficients selected by…

Machine Learning · Statistics 2015-07-02 Jason D. Lee

I will show that there is a deep relation between error-correction codes and certain mathematical models of spin glasses. In particular minimum error probability decoding is equivalent to finding the ground state of the corresponding spin…

Statistical Mechanics · Physics 2007-05-23 Nicolas Sourlas

Sparse coding is a basic task in many fields including signal processing, neuroscience and machine learning where the goal is to learn a basis that enables a sparse representation of a given set of data, if one exists. Its standard…

Machine Learning · Computer Science 2015-03-04 Sanjeev Arora , Rong Ge , Tengyu Ma , Ankur Moitra

These lecture notes from the 2019 Les Houches Summer School on 'Quantum Information Machines' are intended to provide an introduction to classical and quantum error correction with bits and qubits, and with continuous variable systems…

Quantum Physics · Physics 2023-06-14 Steven M. Girvin

In conventional sparse representations based dictionary learning algorithms, initial dictionaries are generally assumed to be proper representatives of the system at hand. However, this may not be the case, especially in some systems…

Computer Vision and Pattern Recognition · Computer Science 2017-01-17 Yigit Oktar , Mehmet Turkan

The article explores an encoding and structural information processing approach using sparse bit vectors and fixed-length linear vectors. The following are presented: a discrete method of speculative stochastic dimensionality reduction of…

Machine Learning · Computer Science 2025-08-05 Dmitriy Kashitsyn , Dmitriy Shabanov

These notes are based on the lectures that one of us (HT) gave at the Summer School on the "Theory of Large Deviations and Applications", held in July 2024 at Les Houches in France. They present the basic definitions and mathematical…

Statistical Mechanics · Physics 2025-10-29 Ivan N. Burenev , Daniël W. H. Cloete , Vansh Kharbanda , Hugo Touchette

We address the problem of decoding sparse quantum error correction codes. For Pauli channels, this task can be accomplished by a version of the belief propagation algorithm used for decoding sparse classical codes. Quantum codes pose two…

Quantum Physics · Physics 2008-09-16 David Poulin , Yeojin Chung

Here I will present an introduction to the results that have been recently obtained in constraint optimization of random problems using statistical mechanics techniques. After presenting the general results, in order to simplify the…

Statistical Mechanics · Physics 2009-11-11 Giorgo Parisi

This document presents the material of two lectures on statistical physics and neural representations, delivered by one of us (R.M.) at the Fundamental Problems in Statistical Physics XIV summer school in July 2017. In a first part, we…

Data Analysis, Statistics and Probability · Physics 2018-06-13 Simona Cocco , Rémi Monasson , Lorenzo Posani , Sophie Rosay , Jérôme Tubiana

These notes are a written version of lectures given in the 2024 Les Houches Summer School on {\it Large deviations and applications}. They are are based on a series of works published over the last 25 years on steady properties of…

Mathematical Physics · Physics 2025-10-29 Bernard Derrida

We comment on some conceptual and and technical problems related to computational mechanics, point out some errors in several papers, and straighten out some wrong priority claims. We present explicitly the correct algorithm for…

Data Analysis, Statistics and Probability · Physics 2018-04-09 Peter Grassberger

Over the past decades, a great body of theoretical and mathematical work has been devoted to random-matrix descriptions of open quantum systems. In these notes, based on lectures delivered at the Les Houches Summer School "Stochastic…

Disordered Systems and Neural Networks · Physics 2017-01-09 Henning Schomerus

This report summarizes some of the material that was presented by the author during the 2015 Les Houches Summerschool on "Random Matrices and Stochastic Processes". In these Lectures, various applications of Random Matrix Theory in modern…

Statistical Mechanics · Physics 2016-05-05 Aris L. Moustakas

The state-of-the-art error correcting codes are based on large random constructions (random graphs, random permutations, ...) and are decoded by linear-time iterative algorithms. Because of these features, they are remarkable examples of…

Disordered Systems and Neural Networks · Physics 2016-08-31 Silvio Franz , Michele Leone , Andrea Montanari , Federico Ricci-Tersenghi

Moore introduced a method for graduate mathematics instruction that consisted primarily of individual student work on challenging proofs (Jones, 1977). Cohen (1982) described an adaptation with less explicit competition suitable for…

Other Statistics · Statistics 2020-07-21 Nicholas Jon Horton

Graph sparsification is a well-established technique for accelerating graph-based learning algorithms, which uses edge sampling to approximate dense graphs with sparse ones. Because the sparsification error is random and unknown, users must…

Machine Learning · Computer Science 2025-03-12 Siyao Wang , Miles E. Lopes

Belief propagation applied to iterative decoding and sparse recovery through approximate message passing (AMP) are two research areas that have seen monumental progress in recent decades. Inspired by these advances, this article introduces…

Information Theory · Computer Science 2023-01-06 Jamison R. Ebert , Jean-Francois Chamberland , Krishna R. Narayanan