English
Related papers

Related papers: On a New Type of Information Processing for Effici…

200 papers

Multivariate information decompositions hold promise to yield insight into complex systems, and stand out for their ability to identify synergistic phenomena. However, the adoption of these approaches has been hindered by there being…

Information Theory · Computer Science 2020-12-02 Fernando Rosas , Pedro Mediano , Borzoo Rassouli , Adam Barrett

Most recent advances in machine learning and analytics for process control pose the question of how to naturally integrate new data-driven methods with classical process models and control. We propose a process modeling framework enabling…

Neural and Evolutionary Computing · Computer Science 2025-08-08 Michael R. Wartmann , B. Erik Ydstie

Operations research practitioners frequently want to model complicated functions that are are difficult to encode in their underlying optimisation framework. A common approach is to solve an approximate model, and to use a simulation to…

Optimization and Control · Mathematics 2022-07-06 Michael Forbes , Mitchell Harris , Marijn Jansen , Femke van der Schoot , Thomas Taimre

Why do neurons encode information the way they do? Normative answers to this question model neural activity as the solution to an optimisation problem; for example, the celebrated efficient coding hypothesis frames neural activity as the…

Neurons and Cognition · Quantitative Biology 2026-03-06 William Dorrell , Peter E. Latham , James Whittington

The operation of industrial facilities is a broad field for optimization. Industrial plants are often a) composed of several components, b) linked using network technology, c) physically interconnected and d) complex regarding the effect of…

Systems and Control · Electrical Eng. & Systems 2022-06-30 Gregor Thiele , Theresa Johanni , David Sommer , Jörg Krüger

Networks provide a powerful formalism for modeling complex systems by using a model of pairwise interactions. But much of the structure within these systems involves interactions that take place among more than two nodes at once; for…

Social and Information Networks · Computer Science 2018-12-13 Austin R. Benson , Rediet Abebe , Michael T. Schaub , Ali Jadbabaie , Jon Kleinberg

High-throughput computational materials design promises to greatly accelerate the process of discovering new materials and compounds, and of optimizing their properties. The large databases of structures and properties that result from…

Chemical Physics · Physics 2016-11-22 Sandip De , Felix Musil , Teresa Ingram , Carsten Baldauf , Michele Ceriotti

The present work addresses the issue of using complex networks as artificial intelligence mechanisms. More specifically, we consider the situation in which puzzles, represented as complex networks of varied types, are to be assembled by…

Physics and Society · Physics 2018-11-01 Henrique F. de Arruda , Cesar H. Comin , Luciano da F. Costa

Multivariate information theory provides a general and principled framework for understanding how the components of a complex system are connected. Existing analyses are coarse in nature -- built up from characterizations of discrete…

Information Theory · Computer Science 2025-05-30 Kieran A. Murphy , Yujing Zhang , Dani S. Bassett

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

Data collection and research methodology represents a critical part of the research pipeline. On the one hand, it is important that we collect data in a way that maximises the validity of what we are measuring, which may involve the use of…

Methodology · Statistics 2022-04-20 Matthew J. Vowels

Many practical systems can be described by dynamic networks, for which modern technique can measure their output signals, and accumulate extremely rich data. Nevertheless, the network structures producing these data are often deeply hidden…

Statistical Mechanics · Physics 2016-08-18 Yang Chen , Zhaoyang Zhang , Tianyu Chen , Shihong Wang , Gang Hu

In this paper we develop a theory to describe innovation processes in a network of interacting units. We introduce a stochastic picture that allows for the clarification of the role of fluctuations for the survival of innovations in such a…

Statistical Mechanics · Physics 2007-05-23 Ingrid Hartmann-Sonntag , Andrea Scharnhorst , Werner Ebeling

We explore a definition of complexity based on logic functions, which are widely used as compact descriptions of rules in diverse fields of contemporary science. Detailed numerical analysis shows that (i) logic complexity is effective in…

Data Analysis, Statistics and Probability · Physics 2016-03-11 Marco Gherardi , Pietro Rotondo

Complex networks have become the main paradigm for modelling the dynamics of interacting systems. However, networks are intrinsically limited to describing pairwise interactions, whereas real-world systems are often characterized by…

Increasingly volatile electricity prices make simultaneous scheduling optimization desirable for production processes and their energy systems. Simultaneous scheduling needs to account for both process dynamics and binary on/off-decisions…

Optimization and Control · Mathematics 2022-07-28 Florian Joseph Baader , André Bardow , Manuel Dahmen

In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models.…

Machine Learning · Computer Science 2021-09-07 Junran Wu , Jianhao Li , Yicheng Pan , Ke Xu

Networks are a fundamental tool for understanding and modeling complex systems in physics, biology, neuroscience, engineering, and social science. Many networks are known to exhibit rich, lower-order connectivity patterns that can be…

Social and Information Networks · Computer Science 2018-01-08 Austin R. Benson , David F. Gleich , Jure Leskovec

We describe a novel classifier with a tree structure, designed using information theory concepts. This Information Network is made of information nodes, that compress the input data, and multiplexers, that connect two or more input nodes to…

Machine Learning · Computer Science 2018-03-07 Giulio Franzese , Monica Visintin

Process mining, as a high-level field in data mining, plays a crucial role in enhancing operational efficiency and decision-making across organizations. In this survey paper, we delve into the growing significance and ongoing trends in the…

Artificial Intelligence · Computer Science 2024-07-17 Yiyuan Yang , Zheshun Wu , Yong Chu , Zhenghua Chen , Zenglin Xu , Qingsong Wen