English
Related papers

Related papers: Notes on computational-to-statistical gaps: predic…

200 papers

We propose a method for filling arbitrarily wide gaps in deterministic time series. Crucial to the method is the ability to apply Takens' theorem in order to reconstruct the dynamics underlying the time series. We introduce a functional to…

Chaotic Dynamics · Physics 2007-06-13 Francesco Paparella

Many questions of fundamental interest in todays science can be formulated as inference problems: Some partial, or noisy, observations are performed over a set of variables and the goal is to recover, or infer, the values of the variables…

Statistical Mechanics · Physics 2018-01-24 Lenka Zdeborová , Florent Krzakala

This essay, derived from a lecture at "The Physics Modeling of Thought" workshop in Berlin in winter 2023, explores the mutually beneficial relationship between theoretical neuroscience and statistical physics through the lens of efficient…

Neurons and Cognition · Quantitative Biology 2024-08-06 Jonathan Kadmon

A central question in computer science and statistics is whether efficient algorithms can achieve the information-theoretic limits of statistical problems. Many computational-statistical tradeoffs have been shown under average-case…

Computational Complexity · Computer Science 2025-07-18 Guy Blanc , Caleb Koch , Carmen Strassle , Li-Yang Tan

Big data are data on a massive scale in terms of volume, intensity, and complexity that exceed the capacity of standard software tools. They present opportunities as well as challenges to statisticians. The role of computational…

Computation · Statistics 2018-06-13 Chun Wang , Ming-Hui Chen , Elizabeth Schifano , Jing Wu , Jun Yan

We discuss several ways of illustrating fundamental concepts in statistical and thermal physics by considering various models and algorithms. We emphasize the importance of replacing students' incomplete mental images by models that are…

Physics Education · Physics 2009-11-13 Jan Tobochnik , Harvey Gould

Stochastic systems with memory naturally appear in life science, economy, and finance. We take the modelling point of view of stochastic functional delay equations and we study these structures when the driving noises admit jumps. Our…

Probability · Mathematics 2016-06-01 D. R. Baños , F. Cordoni , G. Di Nunno , L. Di Persio , E. E. Røse

We consider the problem of calibrating an imperfect computer model using experimental data. To compensate the misspecification of the computer model and make more accurate predictions, a discrepancy function is often included and modeled…

Methodology · Statistics 2018-05-04 Mengyang Gu , Long Wang

Astronomers often deal with data where the covariates and the dependent variable are measured with heteroscedastic non-Gaussian error. For instance, while TESS and Kepler datasets provide a wealth of information, addressing the challenges…

Instrumentation and Methods for Astrophysics · Physics 2024-12-17 Naomi Giertych , Jonathan P Williams , Sujit Ghosh

Computational mechanics is a method for discovering, describing and quantifying patterns, using tools from statistical physics. It constructs optimal, minimal models of stochastic processes and their underlying causal structures. These…

Machine Learning · Computer Science 2007-05-23 Cosma Rohilla Shalizi , James P. Crutchfield

Several authors, including the American Statistician (ASA), have noted the challenges facing statisticians when attacking large, complex, unstructured problems, as opposed to well-defined textbook problems. Clearly, the standard paradigm of…

Other Statistics · Statistics 2015-11-20 Roger W. Hoerl , Ronald D. Snee

We present data-dependent learning bounds for the general scenario of non-stationary non-mixing stochastic processes. Our learning guarantees are expressed in terms of a data-dependent measure of sequential complexity and a discrepancy…

Machine Learning · Computer Science 2018-03-16 Vitaly Kuznetsov , Mehryar Mohri

Predictive inference is a fundamental task in statistics, traditionally addressed using parametric assumptions about the data distribution and detailed analyses of how models learn from data. In recent years, conformal prediction has…

Methodology · Statistics 2026-03-26 Matteo Sesia , Stefano Favaro

The present communication addresses a set of observations, obeying both deterministic as well as statistical formal requirements, and serving to operate within the framework of the dynamical systems theory, with a certain emphasis placed on…

Physics and Society · Physics 2017-06-30 Adam Gadomski , Marcel Ausloos , Tahlia Casey

A graph theoretic perspective is taken for a range of phenomena in continuum physics in order to develop representations for analysis of large scale, high-fidelity solutions to these problems. Of interest are phenomena described by partial…

Computational Physics · Physics 2019-05-22 R. Banerjee , K. Sagiyama , G. H. Teichert , K. Garikipati

Statistical physics has proven to be a very fruitful framework to describe phenomena outside the realm of traditional physics. The last years have witnessed the attempt by physicists to study collective phenomena emerging from the…

Physics and Society · Physics 2009-05-11 Claudio Castellano , Santo Fortunato , Vittorio Loreto

Statistical inference is the science of drawing conclusions about some system from data. In modern signal processing and machine learning, inference is done in very high dimension: very many unknown characteristics about the system have to…

Disordered Systems and Neural Networks · Physics 2020-10-29 Jean Barbier

In many high-dimensional problems,polynomial-time algorithms fall short of achieving the statistical limits attainable without computational constraints. A powerful approach to probe the limits of polynomial-time algorithms is to study the…

Statistics Theory · Mathematics 2025-07-11 Bertrand Even , Christophe Giraud , Nicolas Verzelen

Statistical prediction plays an important role in many decision processes such as university budgeting (depending on the number of students who will enroll), capital budgeting (depending on the remaining lifetime of a fleet of systems), the…

Methodology · Statistics 2021-10-14 Qinglong Tian , Daniel J. Nordman , William Q. Meeker

Computation plays a key role in predicting and analyzing natural phenomena. There are two fundamental barriers to our ability to computationally understand the long-term behavior of a dynamical system that describes a natural process. The…

Computational Complexity · Computer Science 2017-02-15 Mark Braverman , Alexander Grigo , Cristobal Rojas