Related papers: Response of Complex Systems to Complex Perturbatio…
One of the most fundamental characteristic of a complex system is its size (or volume), which, in many modelling, is represented by the number of its individual components. Complex systems under investigation nowadays are typically large…
We introduce two numerical conjugacy invariants for dynamical systems -- the complexity and weak complexity indices -- which are well-suited for the study of "completely integrable" Hamiltonian systems. These invariants can be seen as "slow…
G. Edelman, O. Sporns, and G. Tononi have introduced the neural complexity of a family of random variables, defining it as a specific average of mutual information over subfamilies. We show that their choice of weights satisfies two natural…
We study a control system resembling a singularly perturbed system whose variables are decomposed into groups that change their values with rates of different orders of magnitude. We establish that the slow trajectories of this system are…
Time correlated fluctuations interacting with a spatial asymmetry potential are sufficient conditions to give rise to transport of Brownian particles. The transfer of information coming from the nonequilibrium bath, viewed as a source of…
Power systems are globally experiencing an unprecedented growth in size and complexity due to the advent of nonconventional generation and consumption technologies. To navigate computational complexity, power system dynamic models are often…
Sharpness Aware Minimization (SAM) enhances performance across various neural architectures and datasets. As models are continually scaled up to improve performance, a rigorous understanding of SAM's scaling behaviour is paramount. To this…
Receptor-induced apoptosis is a complex signal transduction pathway involving numerous protein/protein interactions and post-transcriptional modifications. The response to death receptor stimulation varies significantly from one cell line…
Learning with neural networks relies on the complexity of the representable functions, but more importantly, the particular assignment of typical parameters to functions of different complexity. Taking the number of activation regions as a…
It is known that, for systems of initial-value problems, algorithms using adaptive information perform much better in the worst case setting than the algorithms using nonadaptive information. In the latter case, lower and upper complexity…
Whether a system is to be considered complex or not depends on how one searches for correlations. We propose a general scheme for calculation of entropies in lattice systems that has high flexibility in how correlations are successively…
Responsive, adaptive and intelligent are widely used but inconsistently defined descriptors of soft matter. A conceptual framework is proposed in which the three classes are information channels of increasing architectural complexity: a…
This paper presents a unified mixed-integer programming framework for training sparse and interpretable neural networks. We develop exact formulations for both fully connected and convolutional architectures by modeling nonlinearities such…
We establish a connection between non-deterministic communication complexity and instance complexity, a measure of information based on algorithmic entropy. Let $\overline{x}$, $\overline{y}$ and $Y_1(\overline{x})$ be respectively the…
In cognitive radio (CR) communication systems, achieving high secondary user (SU) rate in the presence of strong cross-link interference with the primary user (PU) is challenging. In this letter, we exploit the emerging intelligent…
We take an information theoretic perspective on a classical sparse-sampling noisy linear model and present an analytical expression for the mutual information, which plays central role in a variety of communications/processing problems.…
Identifying the underlying dynamics of physical systems can be challenging when only provided with observational data. In this work, we consider systems that can be modelled as first-order ordinary differential equations. By assuming a…
We present a simple derivation of the stochastic equation obeyed by the density function for a system of Langevin processes interacting via a pairwise potential. The resulting equation is considerably different from the phenomenological…
In this paper, we design matched filters for diffusive molecular communication systems taking into account the following impairments: signal-dependent diffusion noise, inter-symbol interference (ISI), and external interfering molecules. The…
Exceptional points featuring enhanced energy response to perturbation hold significant potential in detection and measurement of weak signals. Of particular interest is the existence and property of high-order exceptional points in quantum…