English
Related papers

Related papers: Layerwise computability and image randomness

200 papers

Nies and Scholz introduced the notion of a state to describe an infinite sequence of qubits and defined quantum-Martin-Lof randomness for states, analogously to the well known concept of Martin-L\"of randomness for elements of Cantor space…

Information Theory · Computer Science 2020-05-04 Tejas Bhojraj

We study randomness beyond $\Pi^1_1$-randomness and its Martin-L\"of type variant, introduced in \cite{MR2340241} and further studied in \cite{Continuous-higher-randomness}. The class given by the infinite time Turing machines (\ITTM s),…

Logic · Mathematics 2026-05-19 Merlin Carl , Philipp Schlicht

Let f be a computable function from finite sequences of 0's and 1's to real numbers. We prove that strong f-randomness implies strong f-randomness relative to a PA-degree. We also prove: if X is strongly f-random and Turing reducible to Y…

The algorithmic theory of randomness is well developed when the underlying space is the set of finite or infinite sequences and the underlying probability distribution is the uniform distribution or a computable distribution. These…

Computational Complexity · Computer Science 2016-08-31 Peter Gacs

Modeling the distribution of natural images is challenging, partly because of strong statistical dependencies which can extend over hundreds of pixels. Recurrent neural networks have been successful in capturing long-range dependencies in a…

Machine Learning · Statistics 2015-09-21 Lucas Theis , Matthias Bethge

A theory is presented (and supported by numerical simulations) for phase-coherent reflection of light by a disordered medium which either absorbs or amplifies radiation. The distribution of reflection eigenvalues is shown to be the Laguerre…

Condensed Matter · Physics 2007-05-23 C. W. J. Beenakker , J. C. J. Paasschens , P. W. Brouwer

Since their appearance in the 1950s, computational models capable of performing probabilistic choices have received wide attention and are nowadays pervasive in almost every areas of computer science. Their development was also inextricably…

Logic in Computer Science · Computer Science 2024-09-19 Melissa Antonelli , Ugo Dal Lago , Paolo Pistone

This article is a brief personal account of the past, present, and future of algorithmic randomness, emphasizing its role in inductive inference and artificial intelligence. It is written for a general audience interested in science and…

Information Theory · Computer Science 2012-02-10 Marcus Hutter

The aim of this paper is to present an elementary computable theory of random variables, based on the approach to probability via valuations. The theory is based on a type of lower-measurable sets, which are controlled limits of open sets,…

Logic in Computer Science · Computer Science 2021-01-05 Pieter Collins

The notion of an individual random sequence goes back to von Mises. We describe the evolution of this notion, especially the use of martingales (suggested by Ville), and the development of algorithmic information theory in 1960s and 1970s…

History and Overview · Mathematics 2025-08-27 Laurent Bienvenu , Alexander Shen

Schnorr showed that a real is Martin-Loef random if and only if all of its initial segments are incompressible with respect to prefix-free complexity. Fortnow and independently Nies, Stephan and Terwijn noticed that this statement remains…

Computational Complexity · Computer Science 2017-03-03 George Barmpalias , Andrew Lewis-Pye , Angsheng Li

Randomness in the sense of Martin-L\"of can be defined in terms of lower semicomputable supermartingales. We show that such a supermartingale cannot be replaced by a pair of supermartingales that bet only on the even bits (the first one)…

Information Theory · Computer Science 2008-11-28 Andrej Muchnik

In classical probability theory, the convergence of empirical frequencies to theoretical probabilities: as captured by the Law of Large Numbers (LLN): is treated as axiomatic and emergent from statistical assumptions such as independence…

Data Analysis, Statistics and Probability · Physics 2025-06-19 Allen Lobo

Modeling the distribution of natural images is a landmark problem in unsupervised learning. This task requires an image model that is at once expressive, tractable and scalable. We present a deep neural network that sequentially predicts…

Computer Vision and Pattern Recognition · Computer Science 2016-08-22 Aaron van den Oord , Nal Kalchbrenner , Koray Kavukcuoglu

The notion of probability plays an important role in almost all areas of science and technology. In modern mathematics, however, probability theory means nothing other than measure theory, and the operational characterization of the notion…

Probability · Mathematics 2021-12-17 Kohtaro Tadaki

Random projections are random linear maps, sampled from appropriate distributions, that approx- imately preserve certain geometrical invariants so that the approximation improves as the dimension of the space grows. The well-known…

Optimization and Control · Mathematics 2017-06-12 Ky Vu , Pierre-Louis Poirion , Leo Liberti

This short course offers a new perspective on randomized algorithms for matrix computations. It explores the distinct ways in which probability can be used to design algorithms for numerical linear algebra. Each design template is…

Numerical Analysis · Mathematics 2025-09-23 Anastasia Kireeva , Joel A. Tropp

Diffusion probabilistic models excel at sampling new images from learned distributions. Originally motivated by drift-diffusion concepts from physics, they apply image perturbations such as noise and blur in a forward process that results…

Image and Video Processing · Electrical Eng. & Systems 2024-06-07 Pascal Peter

So far, following the works of A.M. Turing, the algorithms were considered as the mathematical abstraction from which we could write programs for computers whose principle was based on the theoretical concept of Turing machine. We start…

Computational Complexity · Computer Science 2013-04-23 Marc Bui , Michel Lamure , Ivan Lavallee

We study generalizations of Demuth's Theorem, which states that the image of a Martin-L\"of random real under a tt-reduction is either computable or Turing equivalent to a Martin-L\"of random real. We show that Demuth's Theorem holds for…

Logic · Mathematics 2011-10-27 Laurent Bienvenu , Christopher Porter