English
Related papers

Related papers: Disentangling Identifiable Features from Noisy Dat…

200 papers

Causal disentanglement has great potential for capturing complex situations. However, there is a lack of practical and efficient approaches. It is already known that most unsupervised disentangling methods are unable to produce identifiable…

Machine Learning · Computer Science 2023-11-14 Heejeong Nam

Time series data is prevalent in a wide variety of real-world applications and it calls for trustworthy and explainable models for people to understand and fully trust decisions made by AI solutions. We consider the problem of building…

Machine Learning · Computer Science 2020-11-25 Tsung-Yu Hsieh , Suhang Wang , Yiwei Sun , Vasant Honavar

Causal discovery based on Independent Component Analysis (ICA) has achieved remarkable success through the LiNGAM framework, which exploits non-Gaussianity and independence of noise variables to identify causal order. However, classical…

Information Theory · Computer Science 2026-01-26 Joe Suzuki

Intelligent systems across physics, language and perception often exhibit factorisable structure, yet are typically modelled by monolithic neural architectures that do not explicitly exploit this structure. The separable neural architecture…

Machine Learning · Computer Science 2026-03-17 Reza T. Batley , Apurba Sarker , Rajib Mostakim , Andrew Klichine , Sourav Saha

With the advent of advances in self-supervised learning, paired clean-noisy data are no longer required in deep learning-based image denoising. However, existing blind denoising methods still require the assumption with regard to noise…

Computer Vision and Pattern Recognition · Computer Science 2021-09-10 Kanggeun Lee , Won-Ki Jeong

We study the problem of unsupervised representation learning in slightly misspecified settings, and thus formalize the study of robustness of nonlinear representation learning. We focus on the case where the mixing is close to a local…

Machine Learning · Statistics 2025-03-20 Simon Buchholz , Bernhard Schölkopf

Modern data analysis across diverse disciplines increasingly relies on time series. Many of these datasets exhibit cyclostationarity, where patterns approximately repeat in a regular manner, often across multiple time scales, such as daily,…

Disentanglement aims to recover meaningful latent ground-truth factors from the observed distribution solely, and is formalized through the theory of identifiability. The identifiability of independent latent factors is proven to be…

Machine Learning · Computer Science 2024-03-14 Vitória Barin-Pacela , Kartik Ahuja , Simon Lacoste-Julien , Pascal Vincent

One of the pursued objectives of deep learning is to provide tools that learn abstract representations of reality from the observation of multiple contextual situations. More precisely, one wishes to extract disentangled representations…

Machine Learning · Computer Science 2023-10-24 Pierre Colombo , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

Despite the advances of deep learning in specific tasks using images, the principled assessment of image fidelity and similarity is still a critical ability to develop. As it has been shown that Mean Squared Error (MSE) is insufficient for…

Image and Video Processing · Electrical Eng. & Systems 2019-08-27 Benyamin Ghojogh , Fakhri Karray , Mark Crowley

A novel framework is introduced to formalize identifiability in well-specified but ill-posed linear regression models. The framework is distribution-free and accommodates highly correlated features that may or may not relate to the…

Statistics Theory · Mathematics 2026-03-05 Gianluca Finocchio , Tatyana Krivobokova

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

We develop a new modeling framework for Inter-Subject Analysis (ISA). The goal of ISA is to explore the dependency structure between different subjects with the intra-subject dependency as nuisance. It has important applications in…

Methodology · Statistics 2017-09-22 Cong Ma , Junwei Lu , Han Liu

Discovering causal relationships between different variables from time series data has been a long-standing challenge for many domains such as climate science, finance, and healthcare. Given the complexity of real-world relationships and…

Machine Learning · Computer Science 2022-10-27 Wenbo Gong , Joel Jennings , Cheng Zhang , Nick Pawlowski

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

Explainable AI aims to overcome the black-box nature of complex ML models like neural networks by generating explanations for their predictions. Explanations often take the form of a heatmap identifying input features (e.g. pixels) that are…

Machine Learning · Computer Science 2024-04-16 Pattarawat Chormai , Jan Herrmann , Klaus-Robert Müller , Grégoire Montavon

Independent component analysis (ICA) has become a standard data analysis technique applied to an array of problems in signal processing and machine learning. This tutorial provides an introduction to ICA based on linear algebra formulating…

Machine Learning · Computer Science 2014-04-14 Jonathon Shlens

Independent Component Analysis (ICA) is a computational technique for revealing latent factors that underlie sets of measurements or signals. It has become a standard technique in functional neuroimaging. In functional neuroimaging, so…

Identifying latent variables and causal structures from observational data is essential to many real-world applications involving biological data, medical data, and unstructured data such as images and languages. However, this task can be…

Machine Learning · Computer Science 2023-11-01 Lingjing Kong , Biwei Huang , Feng Xie , Eric Xing , Yuejie Chi , Kun Zhang

The novel DISTributed Artificial neural Network Architecture (DISTANA) is a generative, recurrent graph convolution neural network. It implements a grid or mesh of locally parameterizable laterally connected network modules. DISTANA is…

Machine Learning · Computer Science 2020-09-22 Matthias Karlbauer , Sebastian Otte , Hendrik P. A. Lensch , Thomas Scholten , Volker Wulfmeyer , Martin V. Butz