English
Related papers

Related papers: Identifying Weight-Variant Latent Causal Models

200 papers

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

Faithful evaluation of language model capabilities is crucial for deriving actionable insights that can inform model development. However, rigorous causal evaluations in this domain face significant methodological challenges, including…

Machine Learning · Computer Science 2025-06-13 Jikai Jin , Vasilis Syrgkanis , Sham Kakade , Hanlin Zhang

An old problem in multivariate statistics is that linear Gaussian models are often unidentifiable, i.e. some parameters cannot be uniquely estimated. In factor (component) analysis, an orthogonal rotation of the factors is unidentifiable,…

Machine Learning · Statistics 2023-05-04 Aapo Hyvärinen , Ilyes Khemakhem , Ricardo Monti

Linear structural causal models (SCMs) -- in which each observed variable is generated by a subset of the other observed variables as well as a subset of the exogenous sources -- are pervasive in causal inference and casual discovery.…

Machine Learning · Computer Science 2022-11-09 Yuqin Yang , Mohamed Nafea , AmirEmad Ghassami , Negar Kiyavash

Variational Autoencoders (VAEs) are powerful generative models for learning latent representations. Standard VAEs generate dispersed and unstructured latent spaces by utilizing all dimensions, which limits their interpretability, especially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Farshad Sangari Abiz , Reshad Hosseini , Babak N. Araabi

As an important problem in causal inference, we discuss the estimation of treatment effects (TEs). Representing the confounder as a latent variable, we propose Intact-VAE, a new variant of variational autoencoder (VAE), motivated by the…

Machine Learning · Statistics 2022-04-22 Pengzhou Wu , Kenji Fukumizu

Querying causal effects from time-series data is important across various fields, including healthcare, economics, climate science, and epidemiology. However, this task becomes complex in the existence of time-varying latent confounders,…

Machine Learning · Computer Science 2024-11-28 Debo Cheng , Ziqi Xu , Jiuyong Li , Lin Liu , Thuc duy Le , Xudong Guo , Shichao Zhang

A typical problem in causal modeling is the instability of model structure learning, i.e., small changes in finite data can result in completely different optimal models. The present work introduces a novel causal modeling algorithm for…

Causality lays the foundation for the trajectory of our world. Causal inference (CI), which aims to infer intrinsic causal relations among variables of interest, has emerged as a crucial research topic. Nevertheless, the lack of observation…

Machine Learning · Computer Science 2024-06-21 Yaochen Zhu , Yinhan He , Jing Ma , Mengxuan Hu , Sheng Li , Jundong Li

Causal inference is known to be very challenging when only observational data are available. Randomized experiments are often costly and impractical and in instrumental variable regression the number of instruments has to exceed the number…

Methodology · Statistics 2018-06-19 Dominik Rothenhäusler , Peter Bühlmann , Nicolai Meinshausen

We present a unified framework for studying the identifiability of representations learned from simultaneously observed views, such as different data modalities. We allow a partially observed setting in which each view constitutes a…

Unsupervised representation learning seeks to recover latent generative factors, yet standard methods relying on statistical independence often fail to capture causal dependencies. A central challenge is identifiability: as established in…

Machine Learning · Computer Science 2025-12-30 Hans Jarett J. Ong , Brian Godwin S. Lim , Dominic Dayta , Renzo Roel P. Tan , Kazushi Ikeda

If $X,Y,Z$ denote sets of random variables, two different data sources may contain samples from $P_{X,Y}$ and $P_{Y,Z}$, respectively. We argue that causal discovery can help inferring properties of the `unobserved joint distributions'…

Machine Learning · Statistics 2023-05-12 Dominik Janzing , Philipp M. Faller , Leena Chennuru Vankadara

Latent confounders are a fundamental challenge for inferring causal effects from observational data. The instrumental variable (IV) approach is a practical way to address this challenge. Existing IV based estimators need a known IV or other…

Machine Learning · Computer Science 2024-12-09 Debo Cheng , Jiuyong Li , Lin Liu , Ziqi Xu , Weijia Zhang , Jixue Liu , Thuc Duy Le

Learning disentanglement aims at finding a low dimensional representation which consists of multiple explanatory and generative factors of the observational data. The framework of variational autoencoder (VAE) is commonly used to…

Machine Learning · Computer Science 2023-12-20 Mengyue Yang , Furui Liu , Zhitang Chen , Xinwei Shen , Jianye Hao , Jun Wang

We propose an approach for learning the causal structure in stochastic dynamical systems with a $1$-step functional dependency in the presence of latent variables. We propose an information-theoretic approach that allows us to recover the…

Information Theory · Computer Science 2017-01-25 Saber Salehkaleybar , Jalal Etesami , Negar Kiyavash

Learning identifiable representations and models from low-level observations is helpful for an intelligent spacecraft to complete downstream tasks reliably. For temporal observations, to ensure that the data generating process is provably…

Machine Learning · Computer Science 2024-12-05 Congxi Zhang , Yongchun Xie

Causal representation learning (CRL) seeks to uncover meaningful latent variables and their corresponding causal structure from high-dimensional observational data. Although its significance, CRL identifiability remains a crucial property,…

Machine Learning · Computer Science 2026-05-20 Manal Benhamza , Marianne Clausel , Myriam Tami

Learning disentangled causal representations is a challenging problem that has gained significant attention recently due to its implications for extracting meaningful information for downstream tasks. In this work, we define a new notion of…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Yongkai Wu , Feng Chen , Xintao Wu

Learning individual-level causal effects from observational data, such as inferring the most effective medication for a specific patient, is a problem of growing importance for policy makers. The most important aspect of inferring causal…

Machine Learning · Statistics 2017-11-07 Christos Louizos , Uri Shalit , Joris Mooij , David Sontag , Richard Zemel , Max Welling