English
Related papers

Related papers: Kolmogorov Last Discovery? (Kolmogorov and Algorit…

200 papers

We have proposed novel measures based on the Kolmogorov complexity for use in complex system behavior studies and time series analysis. We have considered background of the Kolmogorov complexity and also we have discussed meaning of the…

Chaotic Dynamics · Physics 2013-10-07 Dragutin T. Mihailovic , Gordan Mimic , Emilija Nikolic-Djoric , Ilija Arsenic

There are (at least) three approaches to quantifying information. The first, algorithmic information or Kolmogorov complexity, takes events as strings and, given a universal Turing machine, quantifies the information content of a string as…

Information Theory · Computer Science 2011-11-29 David Balduzzi

This work, Part II, together with its companion Part I develops a new framework for stochastic functional Kolmogorov equations, which are nonlinear stochastic differential equations depending on the current as well as the past states.…

Probability · Mathematics 2021-05-12 Dang H. Nguyen , Nhu N. Nguyen , George Yin

The halting problem is undecidable --- but can it be solved for "most" inputs? This natural question was considered in a number of papers, in different settings. We revisit their results and show that most of them can be easily proven in a…

Logic · Mathematics 2017-01-11 Laurent Bienvenu , Damien Desfontaines , Alexander Shen

Drawing on various notions from theoretical computer science, we present a novel numerical approach, motivated by the notion of algorithmic probability, to the problem of approximating the Kolmogorov-Chaitin complexity of short strings. The…

Information Theory · Computer Science 2015-03-13 Fernando Soler-Toscano , Hector Zenil , Jean-Paul Delahaye , Nicolas Gauvrit

This is a chapter for the forthcoming New Handbook of Mathematical Psychology, to be published by Cambridge University Press. A systematic theory of random variables and joint distributions under varying conditions is presented. This is a…

Probability · Mathematics 2013-12-10 Ehtibar Dzhafarov , Janne Kujala

Among the impressive contributions of Andrej N. Kolmogorov's to mathematics in the 20th century, his 1954 invariant tori theorem is still little understood from a historical point of view [Dumas 2014]. Vladimir I. Arnold, who entered Moscow…

History and Overview · Mathematics 2022-12-13 Fascitiello Isabella

After reviewing unnormalized and normalized information distances based on incomputable notions of Kolmogorov complexity, we discuss how Kolmogorov complexity can be approximated by data compression algorithms. We argue that optimal…

Computational Complexity · Computer Science 2007-05-23 Alexei Kaltchenko

For a finite word $w$ we define and study the Kolmogorov structure function $h_w$ for nondeterministic automatic complexity. We prove upper bounds on $h_w$ that appear to be quite sharp, based on numerical evidence.

Formal Languages and Automata Theory · Computer Science 2020-01-31 Bjørn Kjos-Hanssen

In this paper, we present a theoretical effort to connect the theory of program size to psychology by implementing a concrete language of thought with Turing-computable Kolmogorov complexity (LT^2C^2) satisfying the following requirements:…

Neurons and Cognition · Quantitative Biology 2013-03-06 Sergio Romano , Mariano Sigman , Santiago Figueira

We consider the problem of inferring the probability distribution associated with a language, given data consisting of an infinite sequence of elements of the languge. We do this under two assumptions on the algorithms concerned: (i) like a…

Machine Learning · Computer Science 2014-07-16 Paul M. B. Vitanyi , Nick Chater

In a series of lectures given in 2003 soon after receiving the Fields Medal for his results in the Algebraic Geometry Vladimir Voevodsky (1966-2017) identifies two strategic goals for mathematics, which he plans to pursue in his further…

General Mathematics · Mathematics 2020-12-03 Andrei Rodin

It is well known that normality can be described as incompressibility via finite automata. Still the statement and the proof of this result as given by Becher and Heiber (2013) in terms of "lossless finite-state compressors" do not follow…

Information Theory · Computer Science 2020-08-25 Alexander Kozachinskiy , Alexander Shen

This is a survey on algorithmic questions about combinatorial and geometric properties of convex polytopes. We give a list of 35 problems; for each the current state of knowledege on its theoretical complexity status is reported. The…

Combinatorics · Mathematics 2007-05-23 Volker Kaibel , Marc E. Pfetsch

In this paper, we present some results on information, complexity and entropy as defined below and we discuss their relations with the Kolmogorov-Sinai entropy which is the most important invariant of a dynamical system. These results have…

Dynamical Systems · Mathematics 2019-08-17 Vieri Benci , Claudio Bonanno , Stefano Galatolo , Giulia Menconi , Federico Ponchio

We initiate the theory of communication complexity of individual inputs held by the agents, rather than worst-case or average-case. We consider total, partial, and partially correct protocols, one-way versus two-way, with and without help…

Computational Complexity · Computer Science 2007-05-23 Harry Buhrman , Hartmut Klauck , Nikolai Vereshchagin , Paul Vitanyi

For each partition of a data set into a given number of parts there is a partition such that every part is as much as possible a good model (an "algorithmic sufficient statistic") for the data in that part. Since this can be done for every…

Machine Learning · Computer Science 2022-10-17 Andrew R. Cohen , Paul M. B. Vitányi

A usual way to model a recommendation system is as a matrix completion problem. There are several matrix completion methods, typically using optimization approaches or collaborative filtering. Most approaches assume that the matrix is…

Information Retrieval · Computer Science 2017-07-20 Guilherme Ramos , Joao Saude , Carlos Caleiro , Soummya Kar

Although procedural generation is popular among game developers, academic research on the topic has primarily focused on new applications, with some research into empirical analysis. In this paper we relate theoretical work in information…

Artificial Intelligence · Computer Science 2023-05-04 Younès Rabii , Michael Cook

We propose a measure based upon the fundamental theoretical concept in algorithmic information theory that provides a natural approach to the problem of evaluating $n$-dimensional complexity by using an $n$-dimensional deterministic Turing…

Computational Complexity · Computer Science 2015-08-27 Hector Zenil , Fernando Soler-Toscano , Jean-Paul Delahaye , Nicolas Gauvrit