English
Related papers

Related papers: Learning Linear Causal Representations from Interv…

200 papers

Recent works have suggested that finite Bayesian neural networks may sometimes outperform their infinite cousins because finite networks can flexibly adapt their internal representations. However, our theoretical understanding of how the…

Machine Learning · Computer Science 2022-11-29 Jacob A. Zavatone-Veth , Abdulkadir Canatar , Benjamin S. Ruben , Cengiz Pehlevan

Causal inference from observation data is a core problem in many scientific fields. Here we present a general supervised deep learning framework that infers causal interactions by transforming the input vectors to an image-like…

Machine Learning · Computer Science 2020-11-26 Ye Yuan , Xueying Ding , Ziv Bar-Joseph

Observed associations in a database may be due in whole or part to variations in unrecorded (latent) variables. Identifying such variables and their causal relationships with one another is a principal goal in many scientific and practical…

Machine Learning · Computer Science 2012-12-12 Ricardo Silva , Richard Scheines , Clark Glymour , Peter L. Spirtes

Causal reasoning is often challenging with spatial data, particularly when handling high-dimensional inputs. To address this, we propose a neural network (NN) based framework integrated with an approximate Gaussian process to manage spatial…

Machine Learning · Computer Science 2024-12-06 Ziyang Jiang , Zach Calhoun , Yiling Liu , Lei Duan , David Carlson

This paper considers the problem of estimating the unknown intervention targets in a causal directed acyclic graph from observational and interventional data. The focus is on soft interventions in linear structural equation models (SEMs).…

Methodology · Statistics 2021-11-16 Burak Varici , Karthikeyan Shanmugam , Prasanna Sattigeri , Ali Tajer

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

Machine Learning · Statistics 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables…

Machine Learning · Statistics 2023-12-07 Simon Bing , Jonas Wahl , Urmi Ninad , Jakob Runge

We propose a novel machine learning approach for inferring causal variables of a target variable from observations. Our focus is on directly inferring a set of causal factors without requiring full causal graph reconstruction, which is…

Machine Learning · Computer Science 2025-10-01 Jang-Hyun Kim , Claudia Skok Gibbs , Sangdoo Yun , Hyun Oh Song , Kyunghyun Cho

Predictive models that generalize well under distributional shift are often desirable and sometimes crucial to building robust and reliable machine learning applications. We focus on distributional shift that arises in causal inference from…

Machine Learning · Statistics 2018-02-27 Fredrik D. Johansson , Nathan Kallus , Uri Shalit , David Sontag

Bayesian inference on structured models typically relies on the ability to infer posterior distributions of underlying hidden variables. However, inference in implicit models or complex posterior distributions is hard. A popular tool for…

Machine Learning · Statistics 2016-12-16 Theofanis Karaletsos

In this paper, we study representation learning for multi-task decision-making in non-stationary environments. We consider the framework of sequential linear bandits, where the agent performs a series of tasks drawn from distinct sets…

Machine Learning · Computer Science 2022-04-19 Yuzhen Qin , Tommaso Menara , Samet Oymak , ShiNung Ching , Fabio Pasqualetti

We extend the framework of variational autoencoders to represent transformations explicitly in the latent space. In the family of hierarchical graphical models that emerges, the latent space is populated by higher order objects that are…

Machine Learning · Computer Science 2020-04-24 Giorgio Giannone , Saeed Saremi , Jonathan Masci , Christian Osendorfer

An old problem in multivariate statistics is that linear Gaussian models are often unidentifiable, i.e. some parameters cannot be uniquely estimated. In factor (component) analysis, an orthogonal rotation of the factors is unidentifiable,…

Machine Learning · Statistics 2023-05-04 Aapo Hyvärinen , Ilyes Khemakhem , Ricardo Monti

Recent research has shown growing interest in modeling hypergraphs, which capture polyadic interactions among entities beyond traditional dyadic relations. However, most existing methodologies for hypergraphs face significant limitations,…

Methodology · Statistics 2025-11-04 Shihao Wu , Gongjun Xu , Ji Zhu

Recently, many reinforcement learning techniques were shown to have provable guarantees in the simple case of linear dynamics, especially in problems like linear quadratic regulators. However, in practice, many reinforcement learning…

Machine Learning · Computer Science 2020-06-30 Abraham Frandsen , Rong Ge

We study the generic identifiability of causal effects in linear non-Gaussian acyclic models (LiNGAM) with latent variables. We consider the problem in two main settings: When the causal graph is known a priori, and when it is unknown. In…

Machine Learning · Statistics 2024-06-05 Daniele Tramontano , Yaroslav Kivva , Saber Salehkaleybar , Mathias Drton , Negar Kiyavash

We explore the usage of meta-learning to derive the causal direction between variables by optimizing over a measure of distribution simplicity. We incorporate a stochastic graph representation which includes latent variables and allows for…

Machine Learning · Computer Science 2021-06-11 Justin Wong , Dominik Damjakob

Rapid progress in representation learning has led to a proliferation of embedding models, and to associated challenges of model selection and practical application. It is non-trivial to assess a model's generalizability to new, candidate…

Machine Learning · Computer Science 2022-02-18 Leo Betthauser , Urszula Chajewska , Maurice Diesendruck , Rohith Pesala

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

Most causal discovery algorithms find causal structure among a set of observed variables. Learning the causal structure among latent variables remains an important open problem, particularly when using high-dimensional data. In this paper,…

Machine Learning · Computer Science 2020-09-09 Jonathan D. Young , Bryan Andrews , Gregory F. Cooper , Xinghua Lu