English
Related papers

Related papers: Interaction-Aware Sensitivity Analysis for Aerodyn…

200 papers

We propose an information-theoretic framework for analyzing control systems based on the close relationship of controllers to communication channels. A communication channel takes an input state and transforms it into an output state. A…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Hugo Touchette , Seth Lloyd

Interactions are patterns between several attributes in data that cannot be inferred from any subset of these attributes. While mutual information is a well-established approach to evaluating the interactions between two attributes, we…

Artificial Intelligence · Computer Science 2007-05-23 Aleks Jakulin , Ivan Bratko

Identifying dynamical systems characterized by nonlinear parameters presents significant challenges in deriving mathematical models that enhance understanding of physics. Traditional methods, such as Sparse Identification of Nonlinear…

Machine Learning · Computer Science 2025-08-12 Siva Viknesh , Younes Tatari , Chase Christenson , Amirhossein Arzani

The network representation is becoming increasingly popular for the description of cardiovascular interactions based on the analysis of multiple simultaneously collected variables. However, the traditional methods to assess network links…

Novel vehicular communication methods are mostly analyzed simulatively or analytically as real world performance tests are highly time-consuming and cost-intense. Moreover, the high number of uncontrollable effects makes it practically…

Networking and Internet Architecture · Computer Science 2019-11-22 Benjamin Sliwa , Christian Wietfeld

Machine learning algorithms are increasingly used for consequential decision making regarding individuals based on their relevant features. Features that are relevant for accurate decisions may however lead to either explicit or implicit…

Machine Learning · Computer Science 2021-06-09 Sajad Khodadadian , Mohamed Nafea , AmirEmad Ghassami , Negar Kiyavash

The performance of data fusion and tracking algorithms often depends on parameters that not only describe the sensor system, but can also be task-specific. While for the sensor system tuning these variables is time-consuming and mostly…

Machine Learning · Computer Science 2024-01-29 André Brandenburger , Folker Hoffmann , Alexander Charlish

In the simplest sequential decision problem for an ergodic stochastic process X, at each time n a decision u_n is made as a function of past observations X_0,...,X_{n-1}, and a loss l(u_n,X_n) is incurred. In this setting, it is known that…

Probability · Mathematics 2015-02-04 Ramon van Handel

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…

Machine Learning · Statistics 2024-10-30 Valero Laparra , J. Emmanuel Johnson , Gustau Camps-Valls , Raul Santos-Rodríguez , Jesus Malo

Transfer entropy in information theory was recently demonstrated [Phys. Rev. E 102, 012404 (2020)] to enable us to elucidate the interaction domain among interacting elements solely from an ensemble of trajectories. There, only pairs of…

Adaptation and Self-Organizing Systems · Physics 2021-01-19 Udoy S. Basak , Sulimon Sattari , Hossain M. Motaleb , Kazuki Horikawa , Tamiki Komatsuzaki

We develop the information-theoretical concepts required to study the statistical dependencies among three variables. Some of such dependencies are pure triple interactions, in the sense that they cannot be explained in terms of a…

Computation and Language · Computer Science 2015-09-02 Damián G. Hernández , Damián H. Zanette , Inés Samengo

Recent work in data-driven control has revived behavioral theory to perform a variety of complex control tasks, by directly plugging libraries of past input-output trajectories into optimal control problems. Despite recent advances, a key…

Systems and Control · Electrical Eng. & Systems 2021-03-25 Luca Furieri , Baiwei Guo , Andrea Martin , Giancarlo Ferrari-Trecate

Most psychophysical experiments discard half the data collected. Specifically, experiments discard reaction time data, and use binary responses (e.g. yes/no) to measure performance. Here, Shannon's information theory is used to define…

Neurons and Cognition · Quantitative Biology 2021-12-14 James V Stone

Several scenarios require the optimization of non-convex black-box functions, that are noisy expensive to evaluate functions with unknown analytical expression, whose gradients are hence not accessible. For example, the hyper-parameter…

Machine Learning · Computer Science 2025-02-12 Eduardo C. Garrido-Merchán

Effective optimization is essential for real-world interactive systems to provide a satisfactory user experience in response to changing user behavior. However, it is often challenging to find an objective to optimize for interactive…

Artificial Intelligence · Computer Science 2020-06-24 Ziming Li , Julia Kiseleva , Alekh Agarwal , Maarten de Rijke , Ryen W. White

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and…

Statistics Theory · Mathematics 2025-12-15 Piotr Bania , Anna Wójcik

Low-dimensional representations of underdamped systems often provide insightful grasps and analytical tractability. Here, we build such representations via information projections, obtaining an optimal model that captures the most…

Statistical Mechanics · Physics 2022-08-10 Giorgio Nicoletti , Amos Maritan , Daniel M. Busiello

Information theoretic measures (entropies, entropy rates, mutual information) are nowadays commonly used in statistical signal processing for real-world data analysis. The present work proposes the use of Auto Mutual Information (Mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 C Granero-Belinchón , S. Roux , P. Abry , N. Garnier

The partial information decomposition (PID) framework is concerned with decomposing the information that a set of random variables has with respect to a target variable into three types of components: redundant, synergistic, and unique.…

Information Theory · Computer Science 2025-02-28 André F. C. Gomes , Mário A. T. Figueiredo