English
Related papers

Related papers: Representation Disentaglement via Regularization b…

200 papers

In many problems, the measured variables (e.g., image pixels) are just mathematical functions of the latent causal variables (e.g., the underlying concepts or objects). For the purpose of making predictions in changing environments or…

Machine Learning · Computer Science 2024-08-13 Kun Zhang , Shaoan Xie , Ignavier Ng , Yujia Zheng

Owing to the cross-pollination between causal discovery and deep learning, non-statistical data (e.g., images, text, etc.) encounters significant conflicts in terms of properties and methods with traditional causal data. To unify these data…

Machine Learning · Computer Science 2023-08-14 Hang Chen , Xinyu Yang , Qing Yang

There is mounting evidence that existing neural network models, in particular the very popular sequence-to-sequence architecture, struggle to systematically generalize to unseen compositions of seen components. We demonstrate that one of…

Computation and Language · Computer Science 2022-03-23 Hao Zheng , Mirella Lapata

Learning meaningful causal representations from observations has emerged as a crucial task for facilitating machine learning applications and driving scientific discoveries in fields such as climate science, biology, and physics. This…

Machine Learning · Computer Science 2026-02-06 Jiaxu Ren , Yixin Wang , Biwei Huang

Foundation models for structured time series data must contend with a fundamental challenge: observations often conflate the true underlying physical phenomena with systematic distortions introduced by measurement instruments. This…

Machine Learning · Computer Science 2025-07-09 Jeroen Audenaert , Daniel Muthukrishna , Paul F. Gregory , David W. Hogg , V. Ashley Villar

This thesis develops methods for causal inference and causal representation learning (CRL) in high-dimensional, time-varying data. The first contribution introduces the Causal Dynamic Variational Autoencoder (CDVAE), a model for estimating…

Machine Learning · Statistics 2025-12-05 Mouad EL Bouchattaoui

Objective: This paper investigates how generative models, trained on ground-truth images, can be used \changes{as} priors for inverse problems, penalizing reconstructions far from images the generator can produce. The aim is that learned…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Margaret Duff , Ivor J. A. Simpson , Matthias J. Ehrhardt , Neill D. F. Campbell

Damage identification is a core task in structural health monitoring. In practice, however, its reliability is often compromised by confounding non-damage effects, such as variations in excitation and environmental conditions, which can…

Machine Learning · Computer Science 2026-04-22 Xudong Jian , Charikleia Stoura , Simon Scandella , Eleni Chatzi

Learning the unknown causal parameters of a linear structural causal model is a fundamental task in causal analysis. The task, known as the problem of identification, asks to estimate the parameters of the model from a combination of…

Artificial Intelligence · Computer Science 2024-07-18 Julian Dörfler , Benito van der Zander , Markus Bläser , Maciej Liskiewicz

In many areas, we have well-founded insights about causal structure that would be useful to bring into our trained models while still allowing them to learn in a data-driven fashion. To achieve this, we present the new method of interchange…

Machine Learning · Computer Science 2022-07-22 Atticus Geiger , Zhengxuan Wu , Hanson Lu , Josh Rozner , Elisa Kreiss , Thomas Icard , Noah D. Goodman , Christopher Potts

Identifying the underlying time-delayed latent causal processes in sequential data is vital for grasping temporal dynamics and making downstream reasoning. While some recent methods can robustly identify these latent causal variables, they…

Machine Learning · Computer Science 2024-05-31 Guangyi Chen , Yifan Shen , Zhenhao Chen , Xiangchen Song , Yuewen Sun , Weiran Yao , Xiao Liu , Kun Zhang

Intelligent perception and interaction with the world hinges on internal representations that capture its underlying structure (''disentangled'' or ''abstract'' representations). Disentangled representations serve as world models, isolating…

Machine Learning · Computer Science 2025-03-04 Pantelis Vafidis , Aman Bhargava , Antonio Rangel

The key idea behind the unsupervised learning of disentangled representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we…

Machine Learning · Computer Science 2019-06-19 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

We consider a general class of regularization methods which learn a vector of parameters on the basis of linear measurements. It is well known that if the regularizer is a nondecreasing function of the inner product then the learned vector…

Machine Learning · Computer Science 2012-08-21 Andreas Argyriou , Charles Micchelli , Massimiliano Pontil

Constructing disentangled representations is known to be a difficult task, especially in the unsupervised scenario. The dominating paradigm of unsupervised disentanglement is currently to train a generative model that separates different…

Machine Learning · Computer Science 2021-02-12 Valentin Khrulkov , Leyla Mirvakhabova , Ivan Oseledets , Artem Babenko

A decision-maker must consider cofounding bias when attempting to apply machine learning prediction, and, while feature selection is widely recognized as important process in data-analysis, it could cause cofounding bias. A causal Bayesian…

Machine Learning · Statistics 2020-03-02 Akihiro Yabe

The central question in representation learning is what constitutes a good or meaningful representation. In this work we argue that if we consider data with inherent cluster structures, where clusters can be characterized through different…

Machine Learning · Computer Science 2022-12-05 Pascal Mattia Esser , Satyaki Mukherjee , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Noting the importance of factorizing (or disentangling) the latent space, we propose a novel, non-probabilistic disentangling framework for autoencoders, based on the principles of symmetry transformations in group-theory. To the best of…

Machine Learning · Computer Science 2022-04-14 Jaehoon Cha , Jeyan Thiyagalingam

In real-world scenarios, the application of reinforcement learning is significantly challenged by complex non-stationarity. Most existing methods attempt to model changes in the environment explicitly, often requiring impractical prior…

Machine Learning · Computer Science 2024-06-04 Wanpeng Zhang , Yilin Li , Boyu Yang , Zongqing Lu

Causal structure learning (CSL) refers to the task of learning causal relationships from data. Advances in CSL now allow learning of causal graphs in diverse application domains, which has the potential to facilitate data-driven causal…

Machine Learning · Statistics 2024-07-09 Luka Kovačević , Izzy Newsham , Sach Mukherjee , John Whittaker