English
Related papers

Related papers: Notes on computational-to-statistical gaps: predic…

200 papers

In a physical system, changing parameters such as temperature can induce a phase transition: an abrupt change from one state of matter to another. Analogous phenomena have recently been observed in large language models. Typically, the task…

Machine Learning · Computer Science 2024-05-28 Julian Arnold , Flemming Holtorf , Frank Schäfer , Niels Lörch

As deep neural networks are highly expressive, it is important to find solutions with small generalization gap (the difference between the performance on the training data and unseen data). Focusing on the stochastic nature of training, we…

Machine Learning · Computer Science 2023-10-31 Rie Johnson , Tong Zhang

In this article, we employ a collection of stochastic differential equations with drift and diffusion coefficients approximated by neural networks to predict the trend of chaotic time series which has big jump properties. Our contributions…

Machine Learning · Computer Science 2022-11-04 Luxuan Yang , Ting Gao , Yubin Lu , Jinqiao Duan , Tao Liu

We analyze how numerical experiments regarding elections were conducted within the computational social choice literature (focusing on papers published in the IJCAI, AAAI, and AAMAS conferences). We analyze the sizes of the studied…

Quantiles are very important statistics information used to describe the distribution of datasets. Given the quantiles of a dataset, we can easily know the distribution of the dataset, which is a fundamental problem in data analysis.…

Databases · Computer Science 2015-08-25 Zixuan Zhuang

Missing covariates in regression or classification problems can prohibit the direct use of advanced tools for further analysis. Recent research has realized an increasing trend towards the usage of modern Machine Learning algorithms for…

Machine Learning · Statistics 2022-03-23 Burim Ramosaj , Justus Tulowietzki , Markus Pauly

While conformal predictors reap the benefits of rigorous statistical guarantees on their error frequency, the size of their corresponding prediction sets is critical to their practical utility. Unfortunately, there is currently a lack of…

Machine Learning · Statistics 2024-03-12 Guneet S. Dhillon , George Deligiannidis , Tom Rainforth

Probabilistic Answer Set Programming under the credal semantics (PASP) extends Answer Set Programming with probabilistic facts that represent uncertain information. The probabilistic facts are discrete with Bernoulli distributions. However,…

Artificial Intelligence · Computer Science 2025-02-19 Damiano Azzolini , Fabrizio Riguzzi

The theory of large deviations is concerned with the exponential decay of probabilities of large fluctuations in random systems. These probabilities are important in many fields of study, including statistics, finance, and engineering, as…

Statistical Mechanics · Physics 2009-08-20 Hugo Touchette

In nonlinear dynamical systems, tipping refers to a critical transition from one steady state to another, typically catastrophic, steady state, often resulting from a saddle-node bifurcation. Recently, the machine-learning framework of…

Chaotic Dynamics · Physics 2026-04-09 Smita Deb , Zheng-Meng Zhai , Mulugeta Haile , Ying-Cheng Lai

In modern data analysis, one is frequently faced with statistical inference problems involving massive datasets. Processing such large datasets is usually viewed as a substantial computational challenge. However, if data are a…

Statistics Theory · Mathematics 2015-06-12 Venkat Chandrasekaran , Michael I. Jordan

We study quantum statistical inference tasks of hypothesis testing and their canonical variations, in order to review relations between their corresponding figures of merit---measures of statistical distance---and demonstrate the crucial…

Quantum Physics · Physics 2020-09-25 Marcin Jarzyna , Jan Kolodynski

What do we teach and what should we teach? An honest answer to this question is painful, very painful--what we teach lags decades behind what we practice. How can we reduce this `gap' to prepare a data science workforce of trained…

Other Statistics · Statistics 2017-08-15 Subhadeep Mukhopadhyay

New methods for time-to-event prediction are proposed by extending the Cox proportional hazards model with neural networks. Building on methodology from nested case-control studies, we propose a loss function that scales well to large data…

Machine Learning · Statistics 2019-09-16 Håvard Kvamme , Ørnulf Borgan , Ida Scheel

This is the transcript of a talk given at the 1992 Complex Systems Summer School. The theory of large fluctuations of stochastically perturbed continuous-time dynamical systems is reviewed, and the large fluctuations of two stochastic…

chao-dyn · Physics 2008-02-03 Robert S. Maier

A hallmark of the computational campaign in nuclear and particle physics is the lattice-gauge-theory program. It continues to enable theoretical predictions for a range of phenomena in nature from the underlying Standard Model. The…

High Energy Physics - Lattice · Physics 2025-09-23 Zohreh Davoudi

Geostatistics is a branch of statistics concerned with stochastic processes over continuous domains, with Gaussian processes (GPs) providing a flexible and principled modelling framework. However, the high computational cost of simulating…

Computation · Statistics 2026-03-20 Flávio B. Gonçalves , Marcos O. Prates , Gareth O. Roberts

We investigate the existence of a fundamental computation-information gap for the problem of clustering a mixture of isotropic Gaussian in the high-dimensional regime, where the ambient dimension $p$ is larger than the number $n$ of points.…

Statistics Theory · Mathematics 2024-02-29 Bertrand Even , Christophe Giraud , Nicolas Verzelen

The method of statistical differentials, which approximates the mean and variance of transformations of random variables is used in many areas of mathematics. This paper will discuss the conditions under which such an approximation will be…

Probability · Mathematics 2007-05-23 Rohitha Goonatilake

The main goal of these notes is to give an introduction to the mathematics of quantum noise and some of its applications in non-equilibrium statistical mechanics. We start with some reminders from the theory of classical stochastic…

Mathematical Physics · Physics 2024-07-08 Soon Hoe Lim