English
Related papers

Related papers: Evolutionary Circuit Design: Information Theory Pe…

200 papers

While working on a software specification, designers usually need to evaluate different architectural alternatives to be sure that quality criteria are met. Even when these quality aspects could be expressed in terms of multiple software…

Software Engineering · Computer Science 2024-01-10 Aurora Ramírez , José Raúl Romero , Sebastián Ventura

The combination of the infrastructure provided by the Internet of Things (IoT) with numerous processing nodes present at the Edge Computing (EC) ecosystem opens up new pathways to support intelligent applications. Such applications can be…

Machine Learning · Computer Science 2021-07-23 Kostas Kolomvatsos , Christos Anagnostopoulos

It is well known that semantic and structural features of the generated images emerge at different times during the reverse dynamics of diffusion, a phenomenon that has been connected to physical phase transitions in magnets and other…

Machine Learning · Statistics 2025-06-13 Florian Handke , Félix Koulischer , Gabriel Raya , Luca Ambrogioni

Given the stochastic nature of gene expression, genetically identical cells exposed to the same environmental inputs will produce different outputs. This heterogeneity has been hypothesized to have consequences for how cells are able to…

Molecular Networks · Quantitative Biology 2020-08-19 Manuel Razo-Mejia , Sarah Marzen , Griffin Chure , Rachel Taubman , Muir Morrison , Rob Phillips

Probing signal injection is a well-established technique to extract additional information from a weakly (or non) observable dynamical system. Using averaging theory, a framework to analyse such schemes for general nonlinear systems has…

Systems and Control · Computer Science 2019-11-20 Bowen Yi , Romeo Ortega , Houria Siguerdidjane , Juan E. Machado , Weidong Zhang

In this work, a strategy to estimate the information transfer between the elements of a complex system, from the time series associated to the evolution of this elements, is presented. By using the nearest neighbors of each state, the local…

Information Theory · Computer Science 2018-12-05 P. Garcia , R. Mujica

The use of evolutionary methods in design and art is increasing in diversity and popularity. Approaches to using these methods for creative production typically focus either on optimisation or exploration. In this paper we introduce an…

Neural and Evolutionary Computing · Computer Science 2021-02-12 Camilo Cruz Gambardella , Jon McCormack

We propose an information-theoretic framework for analyzing control systems based on the close relationship of controllers to communication channels. A communication channel takes an input state and transforms it into an output state. A…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Hugo Touchette , Seth Lloyd

The concept of entropy rate for a dynamical process on a graph is introduced. We study diffusion processes where the node degrees are used as a local information by the random walkers. We describe analitically and numerically how the degree…

Statistical Mechanics · Physics 2009-11-13 Jesus Gomez-Gardenes , Vito Latora

Model evolution is widely considered as a subject under research. Despite its role in research, common purpose concepts, approaches, solutions, and methodologies are missing. Limiting the scope to model libraries makes model evolution and…

Software Engineering · Computer Science 2014-08-26 Alexander Roth , Andreas Ganser , Horst Lichter , Bernhard Rumpe

We propose a novel evolutionary algorithm on bit vectors which derives from the principles of information theory. The information-theoretic evolutionary algorithm (it-EA) iteratively updates a search distribution with two parameters, the…

Neural and Evolutionary Computing · Computer Science 2023-04-13 Arnaud Berny

In order to respond to environmental signals, cells often use small molecular circuits to transmit information about their surroundings. Recently, motivated by concrete examples in signaling and gene regulation, a body of work has focused…

Molecular Networks · Quantitative Biology 2020-01-08 P. Szymańska-Rożek , D. Villamaina , J. Miȩkisz , A. M. Walczak

Many biological regulatory systems process signals out of steady state and respond with a physiological delay. A simple model of regulation which respects these features shows how the ability of a delayed output to transmit information is…

Molecular Networks · Quantitative Biology 2013-08-13 Francesca Mancini , Chris H. Wiggins , Matteo Marsili , Aleksandra M. Walczak

This work presents an optimization method for the synthesis of finite state machines. The focus is on the reduction in the on-chip area and the cost of the circuit. A list of finite state machines from MCNC91 benchmark circuits have been…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Noor Ullah , Khawaja M. Yahya , Irfan Ahmed

The Fisher-Rao metric from Information Geometry is related to phase transition phenomena in classical statistical mechanics. Several studies propose to extend the use of Information Geometry to study more general phase transitions in…

Statistical Mechanics · Physics 2016-05-04 Omri Har Shemesh , Rick Quax , Alfons G. Hoekstra , Peter M. A. Sloot

This paper is concerned with designing self-driven fitness functions for Embedded Evolutionary Robotics. The proposed approach considers the entropy of the sensori-motor stream generated by the robot controller. This entropy is computed…

Robotics · Computer Science 2010-06-28 Pierre Delarboulas , Marc Schoenauer , Michèle Sebag

A novel Markovian network evolution model is introduced and analysed by means of information theory. It will be proved that the model, called Network Evolution Chain, is a stationary and ergodic stochastic process. Therefore, the Asymptotic…

Information Theory · Computer Science 2022-01-21 Amirmohammad Farzaneh , Justin P. Coon

Transfer learning is a crucial technique for handling a small amount of data that is potentially related to other abundant data. However, most of the existing methods are focused on classification tasks using images and language datasets.…

Artificial Intelligence · Computer Science 2025-06-16 Sung Moon Ko , Sumin Lee , Dae-Woong Jeong , Woohyung Lim , Sehui Han

For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…

Statistical Mechanics · Physics 2013-04-08 A. C. Barato , D Hartich , U. Seifert

Electronic circuits are useful tools for studying potential dynamical behaviors of synthetic genetic networks. The circuit models are complementary to numerical simulations of the networks, especially providing a framework for verification…

Biological Physics · Physics 2017-07-07 Edward H. Hellen , Syamal K. Dana