English
Related papers

Related papers: Statistical physics of inference: Thresholds and a…

200 papers

If we have a system of binary variables and we measure the pairwise correlations among these variables, then the least structured or maximum entropy model for their joint distribution is an Ising model with pairwise interactions among the…

Disordered Systems and Neural Networks · Physics 2014-09-12 Michele Castellana , William Bialek

State estimation or filtering serves as a fundamental task to enable intelligent decision-making in applications such as autonomous vehicles, robotics, healthcare monitoring, smart grids, intelligent transportation, and predictive…

Machine Learning · Computer Science 2025-06-16 Aamir Hussain Chughtai

The central object of this PhD thesis is known under different names in the fields of computer science and statistical mechanics. In computer science, it is called the Maximum Cut problem, one of the famous twenty-one Karp's original…

Machine Learning · Computer Science 2022-08-31 Mikhail Krechetov

The problem of inferring pair-wise and higher-order interactions in complex systems involving large numbers of interacting variables, from observational data, is fundamental to many fields. Known to the statistical physics community as the…

Methodology · Statistics 2021-01-01 Sjoerd Viktor Beentjes , Ava Khamseh

Network clustering reveals the organization of a network or corresponding complex system with elements represented as vertices and interactions as edges in a (directed, weighted) graph. Although the notion of clustering can be somewhat…

Machine Learning · Statistics 2017-11-15 Yongjin Park , Joel S. Bader

In social networks, information and influence diffuse among users as cascades. While the importance of studying cascades has been recognized in various applications, it is difficult to observe the complete structure of cascades in practice.…

Social and Information Networks · Computer Science 2012-10-15 Bo Zong , Yinghui Wu , Ambuj K. Singh , Xifeng Yan

A statistical inference method is developed and tested for pairwise interacting systems whose degrees of freedom are continuous angular variables, such as planar spins in magnetic systems or wave phases in optics and acoustics. We…

Statistical Mechanics · Physics 2015-06-15 P. Tyagi , A. Pagnani , F. Antenucci , M. Ibáñez Berganza , L. Leuzzi

The inverse statistical problem of finding direct interactions in complex networks is difficult. In the natural sciences, well-controlled perturbation experiments are widely used to probe the structure of complex networks. However, our…

Disordered Systems and Neural Networks · Physics 2019-10-24 Jialong Jiang , David A. Sivak , Matt Thomson

We consider basic conceptual questions concerning the relationship between statistical estimation and causal inference. Firstly, we show how to translate causal inference problems into an abstract statistical formalism without requiring any…

Statistics Theory · Mathematics 2020-07-22 Oliver J. Maclaren , Ruanui Nicholson

We map the problem of finding the prime factors of an integer to the statistical physics problem of finding the ground state of a long-range Ising-like model. As in the strongly disordered Newman-Stein (NS) spin-glass model, the bond…

Statistical Mechanics · Physics 2011-02-08 P. Henelius , S. Girvin

Several recent experiments in biology study systems composed of several interacting elements, for example neuron networks. Normally, measurements describe only the collective behavior of the system, even if in most cases we would like to…

Disordered Systems and Neural Networks · Physics 2010-10-12 Vitor Sessak

As a problem in data science the inverse Ising (or Potts) problem is to infer the parameters of a Gibbs-Boltzmann distributions of an Ising (or Potts) model from samples drawn from that distribution. The algorithmic and computational…

Other Statistics · Statistics 2020-02-14 Hong-Li Zeng , Erik Aurell

This textbook provides a systematic treatment of statistical machine learning for astronomical research through the lens of Bayesian inference, developing a unified framework that reveals connections between modern data analysis techniques…

Instrumentation and Methods for Astrophysics · Physics 2025-06-17 Yuan-Sen Ting

An algorithmically hard phase was described in a range of inference problems: even if the signal can be reconstructed with a small error from an information theoretic point of view, known algorithms fail unless the noise-to-signal ratio is…

Disordered Systems and Neural Networks · Physics 2019-02-04 Fabrizio Antenucci , Silvio Franz , Pierfrancesco Urbani , Lenka Zdeborová

Causality and causal inference have emerged as core research areas at the interface of modern statistics and domains including biomedical sciences, social sciences, computer science, and beyond. The field's inherently interdisciplinary…

Methodology · Statistics 2025-08-26 Carlos Cinelli , Avi Feller , Guido Imbens , Edward Kennedy , Sara Magliacane , Jose Zubizarreta

The image of physics is connected with simple "mechanical" deterministic events: that an apple always falls down, that force equals mass times acceleleration. Indeed, applications of such concept to social or historical problems go back two…

Popular Physics · Physics 2011-09-13 Dietrich Stauffer

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in general graphical models,…

Machine Learning · Statistics 2010-11-16 Jason K. Johnson , Praneeth Netrapalli , Michael Chertkov

Statistics is sometimes described as the science of reasoning under uncertainty. Statistical models provide one view of this uncertainty, but what is frequently neglected is the 'invisible' portion of uncertainty: that assumed not to exist…

Methodology · Statistics 2026-03-18 Oliver L. Pescott , Robin J. Boyd , Gary D. Powney , Gavin B. Stewart

Recovering dynamical equations from observed noisy data is the central challenge of system identification. We develop a statistical mechanics approach to analyze sparse equation discovery algorithms, which typically balance data fit and…

Statistical Mechanics · Physics 2025-09-16 Andrei A. Klishin , Joseph Bakarji , J. Nathan Kutz , Krithika Manohar

Statistical inference as a formal scientific method to covert experience to knowledge has proven to be elusively difficult. While frequentist and Bayesian methodologies have been accepted in the contemporary era as two dominant schools of…

Statistics Theory · Mathematics 2023-01-16 Chuanhai Liu , Ryan Martin