English
Related papers

Related papers: Software Cognitive Information Measure based on Re…

200 papers

Recommender Systems (RS) shape the filtering and curation of online content, yet we have limited understanding of how predictable their recommendation outputs are. We propose data-driven metrics that quantify the predictability of…

Information Retrieval · Computer Science 2026-04-01 Andrés Abeliuk , Alfonso Valderrama , Simón Campos , Marcelo Mendoza

Distributed computation in artificial life and complex systems is often described in terms of component operations on information: information storage, transfer and modification. Information modification remains poorly described however,…

Information Theory · Computer Science 2013-10-10 Joseph T. Lizier , Benjamin Flecker , Paul L. Williams

Data complexity is an important concept in the natural sciences and related areas, but lacks a rigorous and computable definition. In this paper, we focus on a particular sense of complexity that is high if the data is structured in a way…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Louis Mahon

Software code complexity is a well-studied property to determine software component health. However, the existing code complexity metrics do not directly take into account the fault-proneness aspect of the code. We propose a metric called…

Software Engineering · Computer Science 2021-04-27 Ali Parsai , Serge Demeyer

Sophistication and logical depth are two measures that express how complicated the structure in a string is. Sophistication is defined as the minimal complexity of a computable function that defines a two-part description for the string…

Information Theory · Computer Science 2017-01-30 Luís Antunes , Bruno Bauwens , Andre Souto , Andreia Teixeira

This article surveys quantum computational complexity, with a focus on three fundamental notions: polynomial-time quantum computations, the efficient verification of quantum proofs, and quantum interactive proof systems. Properties of…

Quantum Physics · Physics 2008-04-23 John Watrous

Semantic compositionality (SC) refers to the phenomenon that the meaning of a complex linguistic unit can be composed of the meanings of its constituents. Most related works focus on using complicated compositionality functions to model SC…

Computation and Language · Computer Science 2019-07-11 Fanchao Qi , Junjie Huang , Chenghao Yang , Zhiyuan Liu , Xiao Chen , Qun Liu , Maosong Sun

A fundamental characteristic common to both human vision and natural language is their compositional nature. Yet, despite the performance gains contributed by large vision and language pretraining, we find that: across 7 architectures…

Computation and Language · Computer Science 2023-05-17 Zixian Ma , Jerry Hong , Mustafa Omer Gul , Mona Gandhi , Irena Gao , Ranjay Krishna

Several complexity metrics are described which are related to logic structure, data structure and size of spreadsheet models. They primarily concentrate on the dispersion of cell references and cell paths. Most metrics are newly defined,…

Software Engineering · Computer Science 2008-02-28 Andrej Bregar

Machine learning continues to grow in popularity in academia, in industry, and is increasingly used in other fields. However, most of the common metrics used to evaluate even simple binary classification models have shortcomings that are…

Machine Learning · Computer Science 2024-12-25 David H. Brown , Davide Chicco

The concept of Shannon entropy of random variables was generalized to measurable functions in general, and to simple functions with finite values in particular. It is shown that the information measure of a function is related to the time…

Information Theory · Computer Science 2017-01-25 Guo Zhao

This chapter serves as an introduction to systems engineering focused on the broad issues surrounding realizing complex integrated systems. What is a system? We pose a number of possible definitions and perspectives, but leave open the…

Systems and Control · Electrical Eng. & Systems 2025-08-18 John W. Sheppard

The effort invested in a software project is probably one of the most important and most analyzed variables in recent years in the process of project management. The limitation of algorithmic effort prediction models is their inability to…

Software Engineering · Computer Science 2013-10-22 Sumeet Kaur Sehra , Yadwinder Singh Brar , Navdeep Kaur

In order to find out the limiting speed of solving a specific problem using computer, this essay provides a method based on information entropy. The relationship between the minimum computational complexity and information entropy change is…

Computational Complexity · Computer Science 2012-03-09 Xue Wu

In this paper we examine the concept of complexity as it applies to generative art and design. Complexity has many different, discipline specific definitions, such as complexity in physical systems (entropy), algorithmic measures of…

Neural and Evolutionary Computing · Computer Science 2021-02-05 Jon McCormack , Camilo Cruz Gambardella , Andy Lomas

Various research initiatives try to utilize the operational principles of organisms and brains to develop alternative, biologically inspired computing paradigms and artificial cognitive systems. This paper reviews key features of the…

Adaptation and Self-Organizing Systems · Physics 2012-01-25 Andreas Schierwagen

Scientific software-defined as computer programs, scripts, or code used in scientific research, data analysis, modeling, or simulation-has become central to modern research. However, there is limited research on the readability and…

Software Engineering · Computer Science 2025-01-20 Alyssia Chen , Carol Wong , Bonita Sharif , Anthony Peruma

Entropy governs molecular self-assembly, phase transitions, and material stability, yet remains challenging to quantify and directly control in molecular systems. Here, we demonstrate that the computable information density (CID), a data…

Statistical Mechanics · Physics 2026-02-27 Ashley Z. Guo , Kaelyn Chang , Nicholas J. Corrente

Intrinsic computation refers to how dynamical systems store, structure, and transform historical and spatial information. By graphing a measure of structural complexity against a measure of randomness, complexity-entropy diagrams display…

Chaotic Dynamics · Physics 2009-11-13 David P. Feldman , Carl S. McTague , James P. Crutchfield

Informed learning is an emerging field in machine learning that aims to compensate for insufficient data with prior knowledge. Shape knowledge covers many types of prior knowledge concerning the relationship of a function's output with…

Optimization and Control · Mathematics 2024-09-26 Miltiadis Poursanidis , Patrick Link , Jochen Schmid , Uwe Teicher