English
Related papers

Related papers: Learning Independent Causal Mechanisms

200 papers

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mixtures thereof.…

Machine Learning · Statistics 2022-02-10 Luigi Gresele , Julius von Kügelgen , Vincent Stimper , Bernhard Schölkopf , Michel Besserve

In many problems, the measured variables (e.g., image pixels) are just mathematical functions of the latent causal variables (e.g., the underlying concepts or objects). For the purpose of making predictions in changing environments or…

Machine Learning · Computer Science 2024-08-13 Kun Zhang , Shaoan Xie , Ignavier Ng , Yujia Zheng

This paper introduces a new framework for recovering causal graphs from observational data, leveraging the observation that the distribution of an effect, conditioned on its causes, remains invariant to changes in the prior distribution of…

Machine Learning · Computer Science 2026-02-04 Nang Hung Nguyen , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang , Masashi Sugiyama

In settings where Machine Learning (ML) algorithms automate or inform consequential decisions about people, individual decision subjects are often incentivized to strategically modify their observable attributes to receive more favorable…

Machine Learning · Computer Science 2022-06-10 Keegan Harris , Daniel Ngo , Logan Stapleton , Hoda Heidari , Zhiwei Steven Wu

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity and heterogeneous sources of such demonstrations can lead to the…

Machine Learning · Computer Science 2024-09-13 Ivan Ovinnikov , Eugene Bykovets , Joachim M. Buhmann

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Causal structure learning with data from multiple contexts carries both opportunities and challenges. Opportunities arise from considering shared and context-specific causal graphs enabling to generalize and transfer causal knowledge across…

Machine Learning · Computer Science 2024-10-29 Martin Rabel , Wiebke Günther , Jakob Runge , Andreas Gerhardus

Spreading processes play an increasingly important role in modeling for diffusion networks, information propagation, marketing and opinion setting. We address the problem of learning of a spreading model such that the predictions generated…

Social and Information Networks · Computer Science 2021-07-27 Mateusz Wilinski , Andrey Y. Lokhov

We present Causal Generative Neural Networks (CGNNs) to learn functional causal models from observational data. CGNNs leverage conditional independencies and distributional asymmetries to discover bivariate and multivariate causal…

We propose a new method of discovering causal structures, based on the detection of local, spontaneous changes in the underlying data-generating model. We analyze the classes of structures that are equivalent relative to a stream of…

Artificial Intelligence · Computer Science 2013-01-14 Jin Tian , Judea Pearl

Despite impressive performance on language modelling and complex reasoning tasks, Large Language Models (LLMs) fall short on the same tasks in uncommon settings or with distribution shifts, exhibiting a lack of generalisation ability. By…

Computation and Language · Computer Science 2024-09-11 Gaël Gendron , Bao Trung Nguyen , Alex Yuxuan Peng , Michael Witbrock , Gillian Dobbie

Classical supervised learning produces unreliable models when training and target distributions differ, with most existing solutions requiring samples from the target domain. We propose a proactive approach which learns a relationship in…

Machine Learning · Statistics 2019-03-01 Adarsh Subbaswamy , Peter Schulam , Suchi Saria

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample because two or more training examples may…

Artificial Intelligence · Computer Science 2017-06-06 Yuyi Wang , Jan Ramon , Zheng-Chu Guo

Complex data usually results from the interaction of objects produced by different generating mechanisms. Here we introduce a universal, unsupervised and parameter-free model-oriented approach, based upon the seminal concept of algorithmic…

Artificial Intelligence · Computer Science 2018-09-14 Hector Zenil , Narsis A. Kiani , Allan A. Zea , Jesper Tegnér

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

It is tempting to think that machines are less prone to unfairness and prejudice. However, machine learning approaches compute their outputs based on data. While biases can enter at any stage of the development pipeline, models are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Patrick Esser , Robin Rombach , Björn Ommer

The inaccessibility of controlled randomized trials due to inherent constraints in many fields of science has been a fundamental issue in causal inference. In this paper, we focus on distinguishing the cause from effect in the bivariate…

Machine Learning · Statistics 2021-02-23 Jean-Francois Ton , Dino Sejdinovic , Kenji Fukumizu

Despite the recent progress in deep learning and reinforcement learning, transfer and generalization of skills learned on specific tasks is very limited compared to human (or animal) intelligence. The lifelong, incremental building of…

Artificial Intelligence · Computer Science 2022-08-10 Louis Annabi

Diffusion models generate samples through an iterative denoising process, guided by a neural network. While training the denoiser on real-world data is computationally demanding, the sampling procedure itself is more flexible. This…

Machine Learning · Computer Science 2026-02-10 Constant Bourdrez , Alexandre Vérine , Olivier Cappé

Implicit generative models have the capability to learn arbitrary complex data distributions. On the downside, training requires telling apart real data from artificially-generated ones using adversarial discriminators, leading to unstable…

Machine Learning · Computer Science 2024-02-27 José Manuel de Frutos , Pablo M. Olmos , Manuel A. Vázquez , Joaquín Míguez