English
Related papers

Related papers: Notes on computational-to-statistical gaps: predic…

200 papers

We study the fundamental tradeoffs between statistical accuracy and computational tractability in the analysis of high dimensional heterogeneous data. As examples, we study sparse Gaussian mixture model, mixture of sparse linear…

Statistics Theory · Mathematics 2018-08-22 Jianqing Fan , Han Liu , Zhaoran Wang , Zhuoran Yang

The problem of statistical inference for open chaotic systems measured with error is complicated by the interaction of the uncertainty introduced by chaos, and the various sources of random or external variation. Here a method of…

Applications · Statistics 2024-03-11 Michael LuValle

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, however, is paramount to…

Machine Learning · Computer Science 2020-02-14 Luiz F. O. Chamon , Santiago Paternain , Miguel Calvo-Fullana , Alejandro Ribeiro

This book covers a wide range of problems involving the applications of stochastic processes, stochastic calculus, large deviation theory, group representation theory and quantum statistics to diverse fields in dynamical systems,…

Mathematical Physics · Physics 2021-08-13 Harish Parthasarathy

Many conventional statistical procedures are extremely sensitive to seemingly minor deviations from modeling assumptions. This problem is exacerbated in modern high-dimensional settings, where the problem dimension can grow with and…

Machine Learning · Statistics 2017-02-27 Simon S. Du , Sivaraman Balakrishnan , Aarti Singh

A new field of research is rapidly expanding at the crossroad between statistical physics, information theory and combinatorial optimization. In particular, the use of cutting edge statistical physics concepts and methods allow one to solve…

Neurons and Cognition · Quantitative Biology 2008-03-28 Marc Mezard , Thierry Mora

The past century has seen a steady increase in the need of estimating and predicting complex systems and making (possibly critical) decisions with limited information. Although computers have made possible the numerical evaluation of…

Statistics Theory · Mathematics 2017-01-13 Houman Owhadi , Clint Scovel

Stochastic inverse problems considered in this article consist of estimating the probability distributions of intrinsically random inputs of computer models. These estimations are based on observable outputs affected by model noise, and…

Statistics Theory · Mathematics 2025-03-17 Nicolas Bousquet , Mélanie Blazère , Thomas Cerbelaud

Given a network, the critical node detection problem finds a subset of nodes whose removal disrupts the network connectivity. Since many real-world systems are naturally modeled as graphs, assessing the vulnerability of the network is…

Discrete Mathematics · Computer Science 2025-12-02 Tuguldur Bayarsaikhan , Altannar Chinchuluun , Ashwin Arulselvan , Panos Pardalos

In statistical mechanics, measuring the number of available states and their probabilities, and thus the system's entropy, enables the prediction of the macroscopic properties of a physical system at equilibrium. This predictive capacity…

Statistical Mechanics · Physics 2023-12-14 Mathias Casiulis , Stefano Martiniani

Stochastic processes offer a flexible mathematical formalism to model and reason about systems. Most analysis tools, however, start from the premises that models are fully specified, so that any parameters controlling the system's dynamics…

Systems and Control · Computer Science 2017-01-11 Luca Bortolussi , Guido Sanguinetti

We study the problem of predicting rare critical transition events for a class of slow-fast nonlinear dynamical systems. The state of the system of interest is described by a slow process, whereas a faster process drives its evolution and…

Computational Physics · Physics 2020-12-14 Soon Hoe Lim , Ludovico Theo Giorgini , Woosok Moon , J. S. Wettlaufer

Modern technologies are generating ever-increasing amounts of data. Making use of these data requires methods that are both statistically sound and computationally efficient. Typically, the statistical and computational aspects are treated…

Methodology · Statistics 2022-09-15 Mahsa Taheri , Néhémy Lim , Johannes Lederer

These notes survey and explore an emerging method, which we call the low-degree method, for predicting and understanding statistical-versus-computational tradeoffs in high-dimensional inference problems. In short, the method posits that a…

Statistics Theory · Mathematics 2019-07-29 Dmitriy Kunisky , Alexander S. Wein , Afonso S. Bandeira

A theoretical approach for characterising the influence of asymmetry of noise distribution on the escape rate of a multi-stable system is presented. This was carried out via the estimation of an action, which is defined as an exponential…

Mesoscale and Nanoscale Physics · Physics 2014-02-26 I. A. Khovanov , N. A. Khovanova

We propose a new interpretation of objective deterministic chances in statistical physics based on physical computational complexity. This notion applies to a single physical system (be it an experimental set--up in the lab, or a subsystem…

Quantum Physics · Physics 2013-03-20 Amit Hagar , Giuseppe Sergioli

This document consists of lecture notes for a graduate course, which focuses on the relations between Information Theory and Statistical Physics. The course is aimed at EE graduate students in the area of Communications and Information…

Information Theory · Computer Science 2010-06-09 Neri Merhav

This talk describes how techniques developed by Computer Scientists have helped our understanding of certain problems in statistical physics which involve randomness and ``frustration''. Examples will be given from two problems that have…

Disordered Systems and Neural Networks · Physics 2007-05-23 A. P. Young

Alignment algorithms usually rely on simplified models of gaps for computational efficiency. Based on an isomorphism between alignments and physical helix-coil models, we show in statistical mechanics that alignments with realistic laws for…

Genomics · Quantitative Biology 2015-06-26 E. Yeramian , E. Debonneuil

An empty spot refers to an empty hard-to-fill space which can be found in the records of the social interaction, and is the clue to the persons in the underlying social network who do not appear in the records. This contribution addresses a…

Artificial Intelligence · Computer Science 2010-09-28 Yoshiharu Maeno , Yukio Ohsawa