English
Related papers

Related papers: Normalizing the causality between time series

200 papers

The study of passive scalar transport in a turbulent velocity field leads naturally to the notion of generalized flows which are families of probability distributions on the space of solutions to the associated ODEs, which no longer satisfy…

Chaotic Dynamics · Physics 2009-10-31 Weinan E , Eric Vanden Eijnden

In this work, we investigate the use of normalizing flows to model conditional distributions. In particular, we use our proposed method to analyze inverse problems with invertible neural networks by maximizing the posterior likelihood. Our…

Machine Learning · Computer Science 2019-11-07 Zhisheng Xiao , Qing Yan , Yali Amit

Complex networks have acquired a great popularity in recent years, since the graph representation of many natural, social and technological systems is often very helpful to characterize and model their phenomenology. Additionally, the…

Physics and Society · Physics 2009-02-06 Filippo Radicchi , Alain Barrat , Santo Fortunato , Jose J. Ramasco

Causal inconsistency arises when the underlying causal graphs captured by generative models like \textit{Normalizing Flows} (NFs) are inconsistent with those specified in causal models like \textit{Struct Causal Models} (SCMs). This…

Machine Learning · Computer Science 2024-12-18 Qingyang Zhou , Kangjie Lu , Meng Xu

With recent advances in natural language processing, rationalization becomes an essential self-explaining diagram to disentangle the black box by selecting a subset of input texts to account for the major variation in prediction. Yet,…

Machine Learning · Computer Science 2023-09-12 Wenbo Zhang , Tong Wu , Yunlong Wang , Yong Cai , Hengrui Cai

Normalizing flows are a class of generative models that enable exact likelihood evaluation. While these models have already found various applications in particle physics, normalizing flows are not flexible enough to model many of the…

High Energy Physics - Phenomenology · Physics 2022-09-07 Rob Verheyen

A challenging problem when studying a dynamical system is to find the interdependencies among its individual components. Several algorithms have been proposed to detect directed dynamical influences between time series. Two of the most used…

Data Analysis, Statistics and Probability · Physics 2015-09-09 Alessandro Montalto , Sebastiano Stramaglia , Luca Faes , Giovanni Tessitore , Roberto Prevete , Daniele Marinazzo

Entropy regularization is known to improve exploration in sequential decision-making problems. We show that this same mechanism can also lead to nearly unbiased and lower-variance estimates of the mean reward in the optimize-and-estimate…

Machine Learning · Computer Science 2022-08-26 Ben Chugg , Peter Henderson , Jacob Goldin , Daniel E. Ho

Causal inference is perhaps one of the most fundamental concepts in science, beginning originally from the works of some of the ancient philosophers, through today, but also weaved strongly in current work from statisticians, machine…

Information Theory · Computer Science 2020-03-31 Sudam Surasinghe , Erik M. Bollt

Heterogeneity in medical data, e.g., from data collected at different sites and with different protocols in a clinical study, is a fundamental hurdle for accurate prediction using machine learning models, as such models often fail to…

Machine Learning · Computer Science 2021-07-13 Rongguang Wang , Pratik Chaudhari , Christos Davatzikos

Normalization is ubiquitous in economics, and a growing literature shows that ``normalizations'' can matter for interpretation, counterfactual analysis, misspecification, and inference. This paper provides a general framework for these…

Econometrics · Economics 2026-04-09 Wayne Gao

Predictive models can fail to generalize from training to deployment environments because of dataset shift, posing a threat to model reliability and the safety of downstream decisions made in practice. Instead of using samples from the…

Machine Learning · Statistics 2018-08-10 Adarsh Subbaswamy , Suchi Saria

Using symmetric boundary conditions at separated times, I show analytically that both the time ordering of (macroscopic) causality and the direction of entropy increase follow from these boundary conditions. In particular, when the…

Statistical Mechanics · Physics 2007-05-23 L. S. Schulman

Transfer entropy is capable of capturing nonlinear source-destination relations between multi-variate time series. It is a measure of association between source data that are transformed into destination data via a set of linear…

Information Theory · Computer Science 2019-05-28 David Sigtermans

Liang information flow is a quantity widely used in classical network theory to quantify causation, and has been applied widely, for example, to finance and climate. The most striking aspect here is to freeze/subtract a certain node of the…

Quantum Physics · Physics 2022-07-20 Bin Yi , Sougato Bose

Survival analysis, or time-to-event modelling, is a classical statistical problem that has garnered a lot of interest for its practical use in epidemiology, demographics or actuarial sciences. Recent advances on the subject from the point…

Machine Learning · Computer Science 2021-07-28 Guillaume Ausset , Tom Ciffreo , Francois Portier , Stephan Clémençon , Timothée Papin

We propose a new measure to estimate the direction of information flux in multivariate time series from complex systems. This measure, based on the slope of the phase spectrum (Phase Slope Index) has invariance properties that are important…

In the field of machine learning there is a growing interest towards more robust and generalizable algorithms. This is for example important to bridge the gap between the environment in which the training data was collected and the…

Machine Learning · Computer Science 2020-10-08 Wim Casteels , Peter Hellinckx

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Estimating individual and average treatment effects from observational data is an important problem in many domains such as healthcare and e-commerce. In this paper, we advocate balance regularization of multi-head neural network…

Machine Learning · Computer Science 2020-11-24 Mehrdad Farajtabar , Andrew Lee , Yuanjian Feng , Vishal Gupta , Peter Dolan , Harish Chandran , Martin Szummer