English
Related papers

Related papers: Algorithmic analogies to kamae-Weiss theorem on no…

200 papers

The work of Kolmogorov, Arnold and Moser appeared just before the renormalization group approach to statistical mechanics was proposed by Wilson: it can be classified as a multiscale approach which also appeared in works on the convergence…

Dynamical Systems · Mathematics 2020-07-21 Giovanni Gallavotti

We introduce the notion of a reproducible algorithm in the context of learning. A reproducible learning algorithm is resilient to variations in its samples -- with high probability, it returns the exact same output when run on two samples…

Machine Learning · Computer Science 2023-04-17 Russell Impagliazzo , Rex Lei , Toniann Pitassi , Jessica Sorrell

Kolmogorov suggested to measure quality of a statistical hypothesis $P$ for a data $x$ by two parameters: Kolmogorov complexity $C(P)$ of the hypothesis and the probability $P(x)$ of $x$ with respect to $P$. P. G\'acs, J. Tromp, P.M.B.…

Information Theory · Computer Science 2015-12-15 Alexey Milovanov

Kleene algebra (KA) is an important tool for reasoning about general program equivalences, with a decidable and complete equational theory. However, KA cannot always prove equivalences between specific programs. For this purpose, one adds…

Programming Languages · Computer Science 2026-01-21 Liam Chung , Tobias Kappé

Algorithms have been fundamental to recent global technological advances and, in particular, they have been the cornerstone of technical advances in one field rapidly being applied to another. We argue that algorithms possess fundamentally…

Machine Learning · Computer Science 2021-08-09 Petar Veličković , Charles Blundell

In this work we use Equal Oppportunity (EO) doctrines from political philosophy to make explicit the normative judgements embedded in different conceptions of algorithmic fairness. We contrast formal EO approaches that narrowly focus on…

Computers and Society · Computer Science 2022-07-12 Falaah Arif Khan , Eleni Manis , Julia Stoyanovich

While Kolmogorov's probability axioms are widely recognized, it is less well known that in an often-overlooked 1930 note, Kolmogorov proposed an axiomatic framework for a unifying concept of the mean -- referred to as regular means. This…

Statistics Theory · Mathematics 2026-01-15 Miguel de Carvalho

In [Solving second order ordinary differential equations by extending the Prelle-Singer method, J. Phys. A: Math.Gen., 34, 3015-3024 (2001)] we defined a function (we called S) associated to a rational second order ordinary differential…

Mathematical Physics · Physics 2010-07-29 L. G. S. Duarte , L. A. C. P. da Mota

This paper is a comment on the paper "Quantum Mechanics and Algorithmic Randomness" was written by Ulvi Yurtsever \cite{Yurtsever} and the briefly explanation of the algorithmic randomness of quantum measurements results. There are…

Quantum Physics · Physics 2017-04-07 Mohammad Shahbazi

The coding theorem for Kolmogorov complexity states that any string sampled from a computable distribution has a description length close to its information content. A coding theorem for resource-bounded Kolmogorov complexity is the key to…

Computational Complexity · Computer Science 2024-09-20 Shuichi Hirahara , Zhenjian Lu , Mikito Nanashima

Much of machine learning research focuses on predictive accuracy: given a task, create a machine learning model (or algorithm) that maximizes accuracy. In many settings, however, the final prediction or decision of a system is under the…

Computers and Society · Computer Science 2022-06-02 Kate Donahue , Alexandra Chouldechova , Krishnaram Kenthapadi

We present a simple randomized procedure for the prediction of a binary sequence. The algorithm uses ideas from recent developments of the theory of the prediction of individual sequences. We show that if the sequence is a realization of a…

Statistics Theory · Mathematics 2008-06-19 L. Györfi , G. Lugosi , G. Morvai

The van Lambalgen theorem is a surprising result in algorithmic information theory concerning the symmetry of relative randomness. It establishes that for any pair of infinite sequences $A$ and $B$, $B$ is Martin-L\"of random and $A$ is…

Computational Complexity · Computer Science 2019-11-07 Diptarka Chakraborty , Satyadev Nandakumar , Himanshu Shukla

We define a class of computable functions over real numbers using functional schemes similar to the class of primitive and partial recursive functions defined by G\"odel and Kleene. We show that this class of functions can also be…

Logic in Computer Science · Computer Science 2020-10-05 Keng Meng Ng , Nazanin R. Tavana , Yue Yang

We show that, in spite of a rather common opinion, quantum mechanics can be represented as an approximation of classical statistical mechanics. The approximation under consideration is based on the ordinary Taylor expansion of physical…

Statistical Mechanics · Physics 2009-11-11 Andrei Khrennikov

The best algorithm for a computational problem generally depends on the "relevant inputs," a concept that depends on the application domain and often defies formal articulation. While there is a large literature on empirical approaches to…

Machine Learning · Computer Science 2016-09-06 Rishi Gupta , Tim Roughgarden

Previously referred to as `miraculous' in the scientific literature because of its powerful properties and its wide application as optimal solution to the problem of induction/inference, (approximations to) Algorithmic Probability (AP) and…

Information Theory · Computer Science 2018-04-16 Hector Zenil , Liliana Badillo , Santiago Hernández-Orozco , Francisco Hernández-Quiroz

We apply recent ideas about complexity and randomness to the philosophy of laws and chances. We develop two ways to use algorithmic randomness to characterize probabilistic laws of nature. The first, a generative chance* law, employs a…

History and Philosophy of Physics · Physics 2025-09-03 Jeffrey A. Barrett , Eddy Keming Chen

Classic machine learning algorithms have been reviewed and studied mathematically on its performance and properties in detail. This paper intends to review the empirical functioning of widely used classical supervised learning algorithms…

Machine Learning · Computer Science 2023-09-06 Senthilkumar Gopal

In this paper, we study the strong convergence of an algorithm to solve the variational inequality problem which extends(Thong et al, Numerical Algorithms. 78, 1045-1060 (2018)). We have reduced and refined some of their algorithm's…

Numerical Analysis · Mathematics 2021-05-11 Mostafa Ghadampour , Donal O'Regan , Ebrahim Soori , Ravi. p. Agarwal