中文
相关论文

相关论文: The information-theoretic complexity of differenti…

200 篇论文

Whether a system is to be considered complex or not depends on how one searches for correlations. We propose a general scheme for calculation of entropies in lattice systems that has high flexibility in how correlations are successively…

统计力学 · 物理学 2015-06-18 Torbjørn Helvik , Kristian Lindgren

We extend the framework for complexity of operators in analysis devised by Kawamura and Cook (2012) to allow for the treatment of a wider class of representations. The main novelty is to endow represented spaces of interest with an…

计算复杂性 · 计算机科学 2019-06-13 Eike Neumann , Florian Steinberg

We propose an entropy function for simplicial complices. Its value gives the expected cost of the optimal encoding of sequences of vertices of the complex, when any two vertices belonging to the same simplex are indistinguishable. We show…

信息论 · 计算机科学 2016-03-24 Stefan Dantchev , Ioannis Ivrissimtzis

Approximating complex probability densities is a core problem in modern statistics. In this paper, we introduce the concept of Variational Inference (VI), a popular method in machine learning that uses optimization techniques to estimate…

机器学习 · 计算机科学 2021-11-23 Ankush Ganguly , Samuel W. F. Earp

We discuss certain basic features of the equation-free (EF) approach to modeling and computation for complex/multiscale systems. We focus on links between the equation-free approach and tools from systems and control theory (design of…

元胞自动机与格子气 · 物理学 2007-05-23 C. I. Siettos , R. Rico-Martinez , I. G. kevrekidis

We consider approximation or recovery of functions based on a finite number of function evaluations. This is a well-studied problem in optimal recovery, machine learning, and numerical analysis in general, but many fundamental insights were…

数值分析 · 数学 2026-04-07 David Krieg , Mario Ullrich

The correct computation of orbits of discrete dynamical systems on the interval is considered. Therefore, an arbitrary-precision floating-point approach based on automatic error analysis is chosen and a general algorithm is presented. The…

数值分析 · 计算机科学 2015-03-13 Christoph Spandl

The transmission of a vertex $v$ of a graph $G$ is the sum of distances from $v$ to all the other vertices in $G$. The Wiener complexity of $G$ is the number of different transmissions of its vertices. Similarly, the eccentric complexity of…

组合数学 · 数学 2020-11-17 Kexiang Xu , Aleksandar Ilić , Vesna Iršič , Sandi Klavžar , Huimin Li

There are many methods developed to approximate a cloud of vectors embedded in high-dimensional space by simpler objects: starting from principal points and linear manifolds to self-organizing maps, neural gas, elastic maps, various types…

机器学习 · 统计学 2016-09-01 E. M. Mirkes , A. Zinovyev , A. N. Gorban

How to measure the complexity of a finite set of vectors embedded in a multidimensional space? This is a non-trivial question which can be approached in many different ways. Here we suggest a set of data complexity measures using universal…

机器学习 · 计算机科学 2013-01-03 Andrei Zinovyev , Evgeny Mirkes

We propose a measure based upon the fundamental theoretical concept in algorithmic information theory that provides a natural approach to the problem of evaluating $n$-dimensional complexity by using an $n$-dimensional deterministic Turing…

计算复杂性 · 计算机科学 2015-08-27 Hector Zenil , Fernando Soler-Toscano , Jean-Paul Delahaye , Nicolas Gauvrit

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

机器学习 · 计算机科学 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

Collective behavior, both in real biological systems as well as in theoretical models, often displays a rich combination of different kinds of order. A clear-cut and unique definition of "phase" based on the standard concept of order…

Formal explainability guarantees the rigor of computed explanations, and so it is paramount in domains where rigor is critical, including those deemed high-risk. Unfortunately, since its inception formal explainability has been hampered by…

人工智能 · 计算机科学 2024-12-04 Xuanxiang Huang , Joao Marques-Silva

This work describes the principled design of a theoretical framework leading to fast and accurate algorithmic information measures on finite multisets of finite strings by means of compression. One distinctive feature of our approach is to…

信息论 · 计算机科学 2025-02-25 François Cayre

Complexity is a multi-faceted phenomenon, involving a variety of features including disorder, nonlinearity, and self-organisation. We use a recently developed rigorous framework for complexity to understand measures of complexity. We…

适应与自组织系统 · 物理学 2020-09-22 Karoline Wiesner , James Ladyman

We introduce a robust belief-based measure of complexity. The idea is that task A is deemed more complex than task B if the probability of solving A correctly is smaller than the probability of solving B correctly regardless of the reward.…

理论经济学 · 经济学 2025-01-17 Egor Bronnikov , Elias Tsakas

Classifications organize entities into categories that identify similarities within a category and discern dissimilarities among categories, and they powerfully classify information in support of analysis. We propose a new classification…

最优化与控制 · 数学 2022-09-05 Casey Garner , Allen Holder

Although there is growing interest in measuring integrated information in computational and cognitive systems, current methods for doing so in practice are computationally unfeasible. Existing and novel integration measures are investigated…

神经元与认知 · 定量生物学 2017-02-08 Max Tegmark

We propose a fitness measure quantifying multi-scale complexity for cellular automaton states, using compressibility as a proxy for complexity. The use of compressibility is grounded in the concept of Kolmogorov complexity, which defines…

神经与进化计算 · 计算机科学 2024-08-14 Tadashi Adachi , Solvi Arnold , Takafumi Mochizuki , Kimitoshi Yamazaki