English
Related papers

Related papers: Effective complexity of stationary process realiza…

200 papers

This paper proposes a new notion of typical sequences on a wide class of abstract alphabets (so-called standard Borel spaces), which is based on approximations of memoryless sources by empirical distributions uniformly over a class of…

Information Theory · Computer Science 2016-11-17 Maxim Raginsky

A method for the construction of approximate analytical expressions for the stationary marginal densities of general stochastic search processes is proposed. By the marginal densities, regions of the search space that with high probability…

Artificial Intelligence · Computer Science 2008-01-30 Arturo Berrones

In \cite{Ca2016} and \cite{Ca2018}, we introduced a notion of effective reducibility between set-theoretical $\Pi_{2}$-statements; in \cite{Ca2025}, this was extended to statements of arbitrary (potentially even infinite) quantifier…

Logic · Mathematics 2026-05-08 Merlin Carl

The main goal of this paper is to put some known results in a common perspective and to simplify their proofs. We start with a simple proof of a result from (Vereshchagin, 2002) saying that $\limsup_n\KS(x|n)$ (here $\KS(x|n)$ is…

Computational Complexity · Computer Science 2008-02-21 Laurent Bienvenu , Andrej Muchnik , Alexander Shen , Nikolay Vereshchagin

In this paper, we introduce complexity-aware planning for finite-horizon deterministic finite automata with rewards as outputs, based on Kolmogorov complexity. Kolmogorov complexity is considered since it can detect computational…

Systems and Control · Electrical Eng. & Systems 2021-09-23 Elis Stefansson , Karl H. Johansson

We consider the problem of sequential prediction and provide tools to study the minimax value of the associated game. Classical statistical learning theory provides several useful complexity measures to study learning with i.i.d. data. Our…

Machine Learning · Computer Science 2014-08-13 Alexander Rakhlin , Karthik Sridharan , Ambuj Tewari

These lecture notes provide an introduction to combinatorics on words and its interactions with dynamics, algebra, and arithmetic. The central theme is the notion of low factor complexity for infinite words. We investigate the following…

Combinatorics · Mathematics 2026-03-10 Mélodie Andrieu

This work considers the problem of binary classification: given training data $x_1, \dots, x_n$ from a certain population, together with associated labels $y_1,\dots, y_n \in \left\{0,1 \right\}$, determine the best label for an element $x$…

Statistics Theory · Mathematics 2016-07-04 Nicolas Garcia Trillos , Ryan Murray

We study the framework of abductive logic programming extended with integrity constraints. For this framework, we introduce a new measure of the simplicity of an explanation based on its degree of \emph{arbitrariness}: the more arbitrary…

Logic in Computer Science · Computer Science 2020-02-19 Luciano Caroprese , Irina Trubitsyna , Miroslaw Truszczynski , Ester Zumpano

In this paper we examine the concept of complexity as it applies to generative art and design. Complexity has many different, discipline specific definitions, such as complexity in physical systems (entropy), algorithmic measures of…

Neural and Evolutionary Computing · Computer Science 2021-02-05 Jon McCormack , Camilo Cruz Gambardella , Andy Lomas

We discuss various formalisms to describe string-to-string transformations. Many are based on automata and can be seen as operational descriptions, allowing direct implementations when the input scanner is deterministic. Alternatively, one…

Formal Languages and Automata Theory · Computer Science 2019-08-06 Paul Gastin

A predominant topic in the theory of evolutionary algorithms and, more generally, theory of randomized black-box optimization techniques is running time analysis. Running time analysis aims at understanding the performance of a given…

Neural and Evolutionary Computing · Computer Science 2018-06-13 Carola Doerr

All current investigations to analyze the derivational complexity of term rewrite systems are based on a single termination method, possibly preceded by transformations. However, the exclusive use of direct criteria is problematic due to…

Logic in Computer Science · Computer Science 2015-07-01 Harald Zankl , Martin Korp

Given an arbitrary long but finite sequence of observations from a finite set, we construct a simple process that approximates the sequence, in the sense that with high probability the empirical frequency, as well as the empirical one-step…

Statistics Theory · Mathematics 2007-06-13 Dinah Rosenberg , Eilon Solan , Nicolas Vieille

The field of computability and complexity was, where computer science sprung from. Turing, Church, and Kleene all developed formalisms that demonstrated what they held "intuitively computable". The times change however and today's…

Programming Languages · Computer Science 2014-02-13 Aaron Karper

Recurrence rate, determinism, average line length, and entropy of line lengths are measures of complexity in recurrence quantification analysis, that help to understand the structure, predictability and complexity of dynamical systems. In…

Dynamical Systems · Mathematics 2023-10-19 Miroslava Poláková , Vladimír Špitalský

A new class of functions is presented. The structure of the algorithm, particularly the selection criteria (branching), is used to define the fundamental property of the new class. The most interesting property of the new functions is that…

Computational Complexity · Computer Science 2020-02-25 Rade Vuckovac

We consider challenging dynamic programming models where the associated Bellman equation, and the value and policy iteration algorithms commonly exhibit complex and even pathological behavior. Our analysis is based on the new notion of…

Optimization and Control · Mathematics 2016-09-13 Dimitri P. Bertsekas

We study formal languages which are capable of fully expressing quantitative probabilistic reasoning and do-calculus reasoning for causal effects, from a computational complexity perspective. We focus on satisfiability problems whose…

Artificial Intelligence · Computer Science 2023-05-17 Benito van der Zander , Markus Bläser , Maciej Liśkiewicz

We explain how recent developments in the fields of realisability models for linear logic -- or geometry of interaction -- and implicit computational complexity can lead to a new approach of implicit computational complexity. This…

Logic in Computer Science · Computer Science 2015-07-03 Thomas Seiller