English
Related papers

Related papers: Multiscale Information Decomposition: Exact Comput…

200 papers

The performances of a new data processing technique, namely the Empirical Mode Decomposition, are evaluated on a fully developed turbulent velocity signal perturbed by a numerical forcing which mimics a long-period flapping. First, we…

Fluid Dynamics · Physics 2015-05-20 Nicolas Mazellier , Fabrice Foucher

This paper presents a multiscale approach to efficiently compute approximate optimal transport plans between point sets. It is particularly well-suited for point sets that are in high-dimensions, but are close to being intrinsically…

Machine Learning · Computer Science 2021-04-13 Samuel Gerber , Mauro Maggioni

We study learning problems in which the conditional distribution of the output given the input varies as a function of additional task variables. In varying-coefficient models with Gaussian process priors, a Gaussian process generates the…

Machine Learning · Computer Science 2015-10-15 Matthias Bussas , Christoph Sawade , Tobias Scheffer , Niels Landwehr

Motivated by the need for computationally tractable spatial methods in neuroimaging studies, we develop a distributed and integrated framework for estimation and inference of Gaussian process model parameters with ultra-high-dimensional…

Methodology · Statistics 2024-02-09 Emily C. Hector , Brian J. Reich , Ani Eloyan

Existing spatio-temporal Hawkes process models typically rely on either parametric or semiparametric assumptions, limiting the model's ability to capture complex endogenous and exogenous event dynamics. We propose a fully Bayesian…

Methodology · Statistics 2026-03-31 Wenqing Liu , Xenia Miscouridou , Déborah Sulem

We introduce fully scalable Gaussian processes, an implementation scheme that tackles the problem of treating a high number of training instances together with high dimensional input data. Our key idea is a representation trick over the…

Machine Learning · Statistics 2018-07-16 Aristeidis Panos , Petros Dellaportas , Michalis K. Titsias

The data association problem is concerned with separating data coming from different generating processes, for example when data come from different data sources, contain significant noise, or exhibit multimodality. We present a fully…

Machine Learning · Statistics 2019-05-07 Markus Kaiser , Clemens Otte , Thomas Runkler , Carl Henrik Ek

It is well known that semantic and structural features of the generated images emerge at different times during the reverse dynamics of diffusion, a phenomenon that has been connected to physical phase transitions in magnets and other…

Machine Learning · Statistics 2025-06-13 Florian Handke , Félix Koulischer , Gabriel Raya , Luca Ambrogioni

What are the distinct ways in which a set of predictor variables can provide information about a target variable? When does a variable provide unique information, when do variables share redundant information, and when do variables combine…

Information Theory · Computer Science 2018-05-04 Conor Finn , Joseph T Lizier

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension,…

Machine Learning · Computer Science 2023-09-06 Zhidi Lin , Juan Maroñas , Ying Li , Feng Yin , Sergios Theodoridis

Complex systems with multiple processes evolving on different temporal scales are naturally described by multilayer networks, where each layer represents a different timescale. In this work, we show how the multilayer structure shapes the…

Statistical Mechanics · Physics 2024-10-29 Giorgio Nicoletti , Daniel Maria Busiello

Transposable data represents interactions among two sets of entities, and are typically represented as a matrix containing the known interaction values. Additional side information may consist of feature vectors specific to entities…

Machine Learning · Statistics 2014-04-29 Oluwasanmi Koyejo , Cheng Lee , Joydeep Ghosh

The characterisation of information processing is an important task in complex systems science. Information dynamics is a quantitative methodology for modelling the intrinsic information processing conducted by a process represented as a…

Information Theory · Computer Science 2018-08-01 Richard E. Spinney , Joseph T. Lizier

Most nervous systems encode information about stimuli in the responding activity of large neuronal networks. This activity often manifests itself as dynamically coordinated sequences of action potentials. Since multiple electrode recordings…

Neurons and Cognition · Quantitative Biology 2011-11-09 Kristina Lisa Klinkner , Cosma Rohilla Shalizi , Marcelo F. Camperi

Information transfer is an essential factor in determining the robustness of collective behaviour in biological systems with distributed control. The most direct way to study the information transfer mechanisms is to experimentally detect…

Statistical Mechanics · Physics 2016-12-21 Andrea Cavagna , Daniele Conti , Irene Giardina , Tomas S. Grigera , Stefania Melillo , Massimiliano Viale

Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a…

Machine Learning · Computer Science 2023-10-02 Kevin Roy , Luis Miguel Lopez-Ramos , Baltasar Beferull-Lozano

We study linear models under heavy-tailed priors from a probabilistic viewpoint. Instead of computing a single sparse most probable (MAP) solution as in standard deterministic approaches, the focus in the Bayesian compressed sensing…

Computer Vision and Pattern Recognition · Computer Science 2014-03-05 George Papandreou , Alan Yuille

In this paper, we focus on estimating the causal effect of an intervention over time on a dynamical system. To that end, we formally define causal interventions and their effects over time on discrete-time stochastic processes (DSPs). Then,…

Artificial Intelligence · Computer Science 2025-05-28 Martina Cinquini , Isacco Beretta , Salvatore Ruggieri , Isabel Valera

Causal inference seeks to identify cause-and-effect interactions in coupled systems. A recently proposed method by Liang detects causal relations by quantifying the direction and magnitude of information flow between time series. The…

Data Analysis, Statistics and Probability · Physics 2024-03-20 Dionissios T. Hristopulos

To understand sensory coding, we must ask not only how much information neurons encode, but also what that information is about. This requires decomposing mutual information into contributions from individual stimuli and stimulus features:…

Neurons and Cognition · Quantitative Biology 2025-10-23 Steeve Laquitaine , Simone Azeglio , Carlo Paris , Ulisse Ferrari , Matthew Chalk