English
Related papers

Related papers: Robustly Disentangled Causal Mechanisms: Validatin…

200 papers

Learning meaningful representations that disentangle the underlying structure of the data generating process is considered to be of key importance in machine learning. While disentangled representations were found to be useful for diverse…

We introduce a conditional generative model for learning to disentangle the hidden factors of variation within a set of labeled observations, and separate them into complementary codes. One code summarizes the specified factors of variation…

Machine Learning · Computer Science 2016-11-11 Michael Mathieu , Junbo Zhao , Pablo Sprechmann , Aditya Ramesh , Yann LeCun

The key idea behind the unsupervised learning of disentangled representations is that real-world data is generated by a few explanatory factors of variation which can be recovered by unsupervised learning algorithms. In this paper, we…

Machine Learning · Computer Science 2019-06-19 Francesco Locatello , Stefan Bauer , Mario Lucic , Gunnar Rätsch , Sylvain Gelly , Bernhard Schölkopf , Olivier Bachem

Machine learning methods can be unreliable when deployed in domains that differ from the domains on which they were trained. There are a wide range of proposals for mitigating this problem by learning representations that are ``invariant''…

Machine Learning · Statistics 2023-02-09 Zihao Wang , Victor Veitch

Representation learning is an approach that allows to discover and extract the factors of variation from the data. Intuitively, a representation is said to be disentangled if it separates the different factors of variation in a way that is…

Machine Learning · Computer Science 2026-02-25 Antonio Almudévar , Alfonso Ortega

In designing generative models, it is commonly believed that in order to learn useful latent structure, we face a fundamental tension between expressivity and structure. In this paper we challenge this view by proposing a new approach to…

Machine Learning · Statistics 2026-04-03 Alex Markham , Isaac Hirsch , Jeri A. Chang , Liam Solus , Bryon Aragam

While representation learning aims to derive interpretable features for describing visual data, representation disentanglement further results in such features so that particular image attributes can be identified and manipulated. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Yen-Cheng Liu , Yu-Ying Yeh , Tzu-Chien Fu , Sheng-De Wang , Wei-Chen Chiu , Yu-Chiang Frank Wang

Disentangled representation learning has seen a surge in interest over recent times, generally focusing on new models which optimise one of many disparate disentanglement metrics. Symmetry Based Disentangled Representation learning…

Machine Learning · Computer Science 2021-11-12 Matthew Painter , Jonathon Hare , Adam Prugel-Bennett

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

Distributional robustness is a central goal of prediction algorithms due to the prevalent distribution shifts in real-world data. The prediction model aims to minimize the worst-case risk among a class of distributions, a.k.a., an…

Machine Learning · Statistics 2025-05-20 Marin Šola , Peter Bühlmann , Xinwei Shen

Learning representations from multiplex graphs, i.e., multi-layer networks where nodes interact through multiple relation types, is challenging due to the entanglement of shared (common) and layer-specific (private) information, which…

Machine Learning · Computer Science 2026-03-26 Saba Nasiri , Selin Aviyente , Dorina Thanou

Existing methods for multi-modal time series representation learning aim to disentangle the modality-shared and modality-specific latent variables. Although achieving notable performances on downstream tasks, they usually assume an…

Machine Learning · Computer Science 2024-05-28 Ruichu Cai , Zhifang Jiang , Zijian Li , Weilin Chen , Xuexin Chen , Zhifeng Hao , Yifan Shen , Guangyi Chen , Kun Zhang

Image classification models tend to make decisions based on peripheral attributes of data items that have strong correlation with a target variable (i.e., dataset bias). These biased models suffer from the poor generalization capability…

Machine Learning · Computer Science 2021-10-26 Jungsoo Lee , Eungyeup Kim , Juyoung Lee , Jihyeon Lee , Jaegul Choo

How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of…

Machine Learning · Computer Science 2018-12-07 Irina Higgins , David Amos , David Pfau , Sebastien Racaniere , Loic Matthey , Danilo Rezende , Alexander Lerchner

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

Many important problems in the real world don't have unique solutions. It is thus important for machine learning models to be capable of proposing different plausible solutions with meaningful probability measures. In this work we introduce…

Machine Learning · Computer Science 2020-07-28 Di Qiu , Lok Ming Lui

The World Wide Web thrives on intelligent services that rely on accurate time series classification, which has recently witnessed significant progress driven by advances in deep learning. However, existing studies face challenges in domain…

Machine Learning · Computer Science 2026-01-16 Zhipeng Liu , Peibo Duan , Xuan Tang , Haodong Jing , Mingyang Geng , Yongsheng Huang , Jialu Xu , Bin Zhang , Binwu Wang

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Causal discovery aims to learn causal relationships between variables from targeted data, making it a fundamental task in machine learning. However, causal discovery algorithms often rely on unverifiable causal assumptions, which are…

Machine Learning · Computer Science 2025-10-15 Huiyang Yi , Yanyan He , Duxin Chen , Mingyu Kang , He Wang , Wenwu Yu