English
Related papers

Related papers: Estimating information in time-varying signals

200 papers

Statistical properties of environments experienced by biological signaling systems in the real world change, which necessitate adaptive responses to achieve high fidelity information transmission. One form of such adaptive response is gain…

Molecular Networks · Quantitative Biology 2012-05-01 Ilya Nemenman

Biological information processing manifests a huge variety in its complexity and capability among different organisms, which presumably stems from the evolutionary optimization under limited computational resources. Starting from the…

Biological Physics · Physics 2025-10-21 Takehiro Tottori , Tetsuya J. Kobayashi

In the presence of multiscale dynamics in a reaction network, direct simulation methods become inefficient as they can only advance the system on the smallest scale. This work presents stochastic averaging techniques to accelerate…

Probability · Mathematics 2016-03-23 Araz Hashemi , Marcel Nunez , Petr Plechac , Dionisios G. Vlachos

Cells sense environmental signals and transmit information intracellularly through changes in the abundance of molecular components. Such molecular abundances can be measured in single cells and exhibit significant heterogeneity in clonal…

Quantitative Methods · Quantitative Biology 2024-09-27 Raymond Fan , Andreas Hilfinger

Determining the strength of non-linear statistical dependencies between two variables is a crucial matter in many research fields. The established measure for quantifying such relations is the mutual information. However, estimating mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 Damián G. Hernández , Inés Samengo

Measuring the statistical dependence between observed signals is a primary tool for scientific discovery. However, biological systems often exhibit complex non-linear interactions that currently cannot be captured without a priori knowledge…

Complex systems such as ecological communities and neuron networks are essential parts of our everyday lives. These systems are composed of units which interact through intricate networks. The ability to predict sudden changes in the…

Adaptation and Self-Organizing Systems · Physics 2021-07-07 Deniz Eroglu , Matteo Tanzi , Sebastian van Strien , Tiago Pereira

We consider a largely untapped potential for the improvement of traffic networks that is rooted in the inherent uncertainty of travel times. Travel times are subject to stochastic uncertainty resulting from various parameters such as…

Computer Science and Game Theory · Computer Science 2025-10-22 Svenja M. Griesbach , Martin Hoefer , Max Klimm , Tim Koglin

Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and robust framework to study such behaviours, with several…

Objective: This work introduces a framework for multivariate time series analysis aimed at detecting and quantifying collective emerging behaviors in the dynamics of physiological networks. Methods: Given a network system mapped by a vector…

Applications · Statistics 2025-02-04 Luca Faes , Gorana Mijatovic , Laura Sparacino , Alberto Porta

Living cells can leverage correlations in environmental fluctuations to predict the future environment and mount a response ahead of time. To this end, cells need to encode the past signal into the output of the intracellular network from…

Biological Physics · Physics 2023-01-11 Age J. Tjalma , Vahe Galstyan , Jeroen Goedhart , Lotte Slim , Nils B. Becker , Pieter Rein ten Wolde

The development of optimal and efficient machine learning-based communication systems is likely to be a key enabler of beyond 5G communication technologies. In this direction, physical layer design has been recently reformulated under a…

Information Theory · Computer Science 2021-11-16 Nunzio A. Letizia , Andrea M. Tonello

Distributed estimation that recruits potentially large groups of humans to collect data about a phenomenon of interest has emerged as a paradigm applicable to a broad range of detection and estimation tasks. However, it also presents a…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Kewei Chen , Donya Ghavidel , Vijay Gupta , Yih-Fang Huang

Cellular signaling is essential in information processing and decision making. Therefore, a variety of experimental approaches have been developed to study signaling on bulk and single-cell level. Single-cell measurements of signaling…

Quantitative Methods · Quantitative Biology 2019-04-18 Carolin Loos , Jan Hasenauer

Data-driven methods for the identification of the governing equations of dynamical systems or the computation of reduced surrogate models play an increasingly important role in many application areas such as physics, chemistry, biology, and…

Dynamical Systems · Mathematics 2024-12-17 Stefan Klus , Hongyu Zhu

Recovering properties of correlation functions is typically challenging. On one hand, experimentally, it requires measurements with a temporal resolution finer than the system's dynamics. On the other hand, analytical or numerical analysis…

Quantum Physics · Physics 2025-07-14 Wojciech Górecki , Simone Felicetti , Lorenzo Maccone , Roberto Di Candia

Mathematical programming formulations of influence diagrams can bridge the gap between representing and solving decision problems. However, they suffer from both modeling and computational limitations. Aiming to address modeling…

Optimization and Control · Mathematics 2025-06-19 Olli Herrala , Tommi Ekholm , Fabricio Oliveira

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

Network estimation and variable selection have been extensively studied in the statistical literature, but only recently have those two challenges been addressed simultaneously. In this paper, we seek to develop a novel method to…

Methodology · Statistics 2024-06-11 Nathan Osborne , Christine B. Peterson , Marina Vannucci

Efficient sampling and remote estimation are critical for a plethora of wireless-empowered applications in the Internet of Things and cyber-physical systems. Motivated by such applications, this work proposes decentralized policies for the…

Systems and Control · Electrical Eng. & Systems 2022-06-09 Xingran Chen , Xinyu Liao , Shirin Saeedi Bidokhti