English
Related papers

Related papers: Causal Foundation Models: Disentangling Physics fr…

200 papers

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

Machine Learning · Computer Science 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

We present a constraint-based algorithm for learning causal structures from observational time-series data, in the presence of latent confounders. We assume a discrete-time, stationary structural vector autoregressive process, with both…

Artificial Intelligence · Computer Science 2023-06-02 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Gal Novik

Temporal causal representation learning is a powerful tool for uncovering complex patterns in observational studies, which are often represented as low-dimensional time series. However, in many real-world applications, data are…

Machine Learning · Computer Science 2025-07-21 Jianhong Chen , Meng Zhao , Mostafa Reisi Gahrooei , Xubo Yue

Disentangling complex causal relationships is important for accurate detection of anomalies. In multivariate time series analysis, dynamic interactions among data variables over time complicate the interpretation of causal relationships.…

Machine Learning · Computer Science 2025-10-14 Wonah Kim , Jeonghyeon Park , Dongsan Jun , Jungkyu Han , Sejin Chun

We study causal discovery from observational data in linear Gaussian systems affected by \emph{mixed latent confounding}, where some unobserved factors act broadly across many variables while others influence only small subsets. This…

Machine Learning · Computer Science 2026-01-01 Amir Asiaee , Samhita Pal , James O'quinn , James P. Long

Continuous-time dynamics models, such as neural ordinary differential equations, have enabled the modeling of underlying dynamics in time-series data and accurate forecasting. However, parameterization of dynamics using a neural network…

Machine Learning · Computer Science 2022-10-14 Fan Wu , Sanghyun Hong , Donsub Rim , Noseong Park , Kookjin Lee

Identifying the causal structure of systems with multiple dynamic elements is critical to several scientific disciplines. The conventional approach is to conduct statistical tests of causality, for example with Granger Causality, between…

Machine Learning · Statistics 2022-03-22 Jacek P. Dmochowski

Image classification models tend to make decisions based on peripheral attributes of data items that have strong correlation with a target variable (i.e., dataset bias). These biased models suffer from the poor generalization capability…

Machine Learning · Computer Science 2021-10-26 Jungsoo Lee , Eungyeup Kim , Juyoung Lee , Jihyeon Lee , Jaegul Choo

In the context of music information retrieval, similarity-based approaches are useful for a variety of tasks that benefit from a query-by-example scenario. Music however, naturally decomposes into a set of semantically meaningful factors of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Sebastian Ribecky , Jakob Abeßer , Hanna Lukashevich

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional…

Machine Learning · Statistics 2020-10-13 Daniel Chicharro , Michel Besserve , Stefano Panzeri

We reveal that transformers trained in an autoregressive manner naturally encode time-delayed causal structures in their learned representations. When predicting future values in multivariate time series, the gradient sensitivities of…

Machine Learning · Computer Science 2026-01-12 Xinyue Wang , Stephen Wang , Biwei Huang

We consider the problem of causal discovery (structure learning) from heterogeneous observational data. Most existing methods assume a homogeneous sampling scheme, which leads to misleading conclusions when violated in many applications. To…

Methodology · Statistics 2022-02-01 Fangting Zhou , Kejun He , Yang Ni

Structural causal models postulate noisy functional relations among a set of interacting variables. The causal structure underlying each such model is naturally represented by a directed graph whose edges indicate for each variable which…

Statistics Theory · Mathematics 2022-03-15 David Strieder , Tobias Freidling , Stefan Haffner , Mathias Drton

We probe the foundations of causal structure inference experimentally. The causal structure concerns which events influence other events. We probe whether causal structure can be determined without intervention in quantum systems.…

Quantum Physics · Physics 2024-11-12 Hongfeng Liu , Xiangjing Liu , Qian Chen , Yixian Qiu , Vlatko Vedral , Xinfang Nie , Oscar Dahlsten , Dawei Lu

The present study explores the interpretability of latent spaces produced by time series foundation models, focusing on their potential for visual analysis tasks. Specifically, we evaluate the MOMENT family of models, a set of…

The goal of Causal Discovery is to find automated search methods for learning causal structures from observational data. In some cases all variables of the interested causal mechanism are measured, and the task is to predict the effects one…

Machine Learning · Statistics 2024-01-11 Shuyan Wang

The presence of unobserved common causes and measurement error poses two major obstacles to causal structure learning, since ignoring either source of complexity can induce spurious causal relations among variables of interest. We study…

Machine Learning · Computer Science 2026-04-10 Yuqin Yang , Mohamed Nafea , Negar Kiyavash , Kun Zhang , AmirEmad Ghassami

Disentangled representations enable models to separate factors of variation that are shared across experimental conditions from those that are condition-specific. This separation is essential in domains such as biomedical data analysis,…

Machine Learning · Computer Science 2025-12-16 Yuli Slavutsky , Ozgur Beker , David Blei , Bianca Dumitrascu

One of the fundamental representation learning tasks is unsupervised sequential disentanglement, where latent codes of inputs are decomposed to a single static factor and a sequence of dynamic factors. To extract this latent information,…

Machine Learning · Computer Science 2025-10-09 Nimrod Berman , Ilan Naiman , Idan Arbiv , Gal Fadlon , Omri Azencot