English
Related papers

Related papers: Fairness by Learning Orthogonal Disentangled Repre…

200 papers

We propose a novel unsupervised generative model that learns to disentangle object identity from other low-level aspects in class-imbalanced data. We first investigate the issues surrounding the assumptions about uniformity made by InfoGAN,…

Machine Learning · Computer Science 2020-11-02 Utkarsh Ojha , Krishna Kumar Singh , Cho-Jui Hsieh , Yong Jae Lee

A fundamental feature of human intelligence is the ability to infer high-level abstractions from low-level sensory data. An essential component of such inference is the ability to discover modularized generative mechanisms. Despite many…

Machine Learning · Computer Science 2023-06-08 Peyman Sheikholharam Mashhadi , Slawomir Nowaczyk

Training fair machine learning models, aiming for their interpretability and solving the problem of domain shift has gained a lot of interest in the last years. There is a vast amount of work addressing these topics, mostly in separation.…

Machine Learning · Computer Science 2021-01-22 Linda H. Boedi , Helmut Grabner

Intelligent agents should be able to learn useful representations by observing changes in their environment. We model such observations as pairs of non-i.i.d. images sharing at least one of the underlying factors of variation. First, we…

Machine Learning · Computer Science 2020-10-21 Francesco Locatello , Ben Poole , Gunnar Rätsch , Bernhard Schölkopf , Olivier Bachem , Michael Tschannen

Disentangled representation learning offers useful properties such as dimension reduction and interpretability, which are essential to modern deep learning approaches. Although deep learning techniques have been widely applied to…

Machine Learning · Computer Science 2022-04-11 Sichen Zhao , Wei Shao , Jeffrey Chan , Flora D. Salim

Disentangling factors of variation has become a very challenging problem on representation learning. Existing algorithms suffer from many limitations, such as unpredictable disentangling factors, poor quality of generated images from…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Taihong Xiao , Jiapeng Hong , Jinwen Ma

Disentangled representation learning aims to capture the underlying explanatory factors of observed data, enabling a principled understanding of the data-generating process. Recent advances in generative modeling have introduced new…

Machine Learning · Computer Science 2026-05-12 Jinjin Chi , Taoping Liu , Mengtao Yin , Ximing Li , Yongcheng Jing , Jialie Shen , Leszek Rutkowski , Dacheng Tao

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

Learning disentangled representations from visual data, where different high-level generative factors are independently encoded, is of importance for many computer vision tasks. Solving this problem, however, typically requires to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Adria Ruiz , Oriol Martinez , Xavier Binefa , Jakob Verbeek

Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Ehsan Adeli , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Li Fei-Fei , Juan Carlos Niebles , Kilian M. Pohl

Developing meaningful and efficient representations that separate the fundamental structure of the data generation mechanism is crucial in representation learning. However, Disentangled Representation Learning has not fully shown its…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jacopo Dapueto , Nicoletta Noceti , Francesca Odone

Recent successes of deep learning-based recognition rely on maintaining the content related to the main-task label. However, how to explicitly dispel the noisy signals for better generalization in a controllable manner remains an open…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Xiaofeng Liu

Pursuing realistic results according to human visual perception is the central concern in the image transformation tasks. Perceptual learning approaches like perceptual loss are empirically powerful for such tasks but they usually rely on…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Kangfu Mei , Yao Lu , Qiaosi Yi , Haoyu Wu , Juncheng Li , Rui Huang

Contrastive learning has recently emerged as a promising approach for learning data representations that discover and disentangle the explanatory factors of the data. Previous analyses of such approaches have largely focused on individual…

Machine Learning · Computer Science 2023-11-09 Stefan Matthes , Zhiwei Han , Hao Shen

Learning representations that can disentangle explanatory attributes underlying the data improves interpretabilty as well as provides control on data generation. Various learning frameworks such as VAEs, GANs and auto-encoders have been…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Ankita Shukla , Sarthak Bhagat , Shagun Uppal , Saket Anand , Pavan Turaga

Decision making is a process that is extremely prone to different biases. In this paper we consider learning fair representations that aim at removing nuisance (sensitive) information from the decision process. For this purpose, we propose…

Machine Learning · Statistics 2018-07-04 Philip Botros , Jakub M. Tomczak

In disentangled representation learning, a model is asked to tease apart a dataset's underlying sources of variation and represent them independently of one another. Since the model is provided with no ground truth information about these…

Machine Learning · Computer Science 2023-10-24 Kyle Hsu , Will Dorrell , James C. R. Whittington , Jiajun Wu , Chelsea Finn

Recent research has made the surprising finding that state-of-the-art deep learning models sometimes fail to generalize to small variations of the input. Adversarial training has been shown to be an effective approach to overcome this…

Machine Learning · Computer Science 2020-03-26 Sven Gowal , Chongli Qin , Po-Sen Huang , Taylan Cemgil , Krishnamurthy Dvijotham , Timothy Mann , Pushmeet Kohli

Although the self-supervised pre-training of transformer models has resulted in the revolutionizing of natural language processing (NLP) applications and the achievement of state-of-the-art results with regard to various benchmarks, this…

Computation and Language · Computer Science 2023-01-26 Xiang Chen , Xin Xie , Zhen Bi , Hongbin Ye , Shumin Deng , Ningyu Zhang , Huajun Chen