English
Related papers

Related papers: Independently Controllable Factors

200 papers

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

We introduce three concepts that describe an agent's incentives: response incentives indicate which variables in the environment, such as sensitive demographic information, affect the decision under the optimal policy. Instrumental control…

Artificial Intelligence · Computer Science 2025-06-24 Ryan Carey , Eric Langlois , Chris van Merwijk , Shane Legg , Tom Everitt

Deep latent-variable models learn representations of high-dimensional data in an unsupervised manner. A number of recent efforts have focused on learning representations that disentangle statistically independent axes of variation by…

This paper concerns the probabilistic evaluation of the effects of actions in the presence of unmeasured variables. We show that the identification of causal effect between a singleton variable X and a set of variables Y can be accomplished…

Artificial Intelligence · Computer Science 2013-02-21 David Galles , Judea Pearl

Consider learning an imitation policy on the basis of demonstrated behavior from multiple environments, with an eye towards deployment in an unseen environment. Since the observable features from each setting may be different, directly…

Machine Learning · Statistics 2023-11-06 Ioana Bica , Daniel Jarrett , Mihaela van der Schaar

This paper studies the problem of estimating the contributions of features to the prediction of a specific instance by a machine learning model and the overall contribution of a feature to the model. The causal effect of a feature…

Machine Learning · Computer Science 2022-06-24 Jiuyong Li , Ha Xuan Tran , Thuc Duy Le , Lin Liu , Kui Yu , Jixue Liu

Instrumental variables allow for quantification of cause and effect relationships even in the absence of interventions. To achieve this, a number of causal assumptions must be met, the most important of which is the independence assumption,…

Machine Learning · Statistics 2021-11-05 Nikolai Miklin , Mariami Gachechiladze , George Moreno , Rafael Chaves

Dynamical systems across many disciplines are modeled as interacting particles or agents, with interaction rules that depend on a very small number of variables (e.g. pairwise distances, pairwise differences of phases, etc...), functions of…

Machine Learning · Computer Science 2022-08-05 Jinchao Feng , Mauro Maggioni , Patrick Martin , Ming Zhong

In high dimensional analysis, effects of explanatory variables on responses sometimes rely on certain exposure variables, such as time or environmental factors. In this paper, to characterize the importance of each predictor, we utilize its…

Methodology · Statistics 2018-04-11 Yeqing Zhou , Jingyuan Liu , Zhihui Hao , Liping Zhu

Disentangled representations, where the higher level data generative factors are reflected in disjoint latent dimensions, offer several benefits such as ease of deriving invariant representations, transferability to other tasks,…

Machine Learning · Computer Science 2018-12-31 Abhishek Kumar , Prasanna Sattigeri , Avinash Balakrishnan

We show that there is a general, informative and reliable procedure for discovering causal relations when, for all the investigator knows, both latent variables and selection bias may be at work. Given information about conditional…

Artificial Intelligence · Computer Science 2013-02-21 Peter L. Spirtes , Christopher Meek , Thomas S. Richardson

Independent component analysis provides a principled framework for unsupervised representation learning, with solid theory on the identifiability of the latent code that generated the data, given only observations of mixtures thereof.…

Machine Learning · Statistics 2022-02-10 Luigi Gresele , Julius von Kügelgen , Vincent Stimper , Bernhard Schölkopf , Michel Besserve

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Adaptation and Self-Organizing Systems · Physics 2022-04-15 Wolfram Barfuss , Richard P. Mann

The task of inferring high-level causal variables from low-level observations, commonly referred to as causal representation learning, is fundamentally underconstrained. As such, recent works to address this problem focus on various…

Machine Learning · Statistics 2024-03-26 Simon Bing , Urmi Ninad , Jonas Wahl , Jakob Runge

Inducing causal relationships from observations is a classic problem in machine learning. Most work in causality starts from the premise that the causal variables themselves are observed. However, for AI agents such as robots trying to make…

With the resurgence of interest in neural networks, representation learning has re-emerged as a central focus in artificial intelligence. Representation learning refers to the discovery of useful encodings of data that make domain-relevant…

Machine Learning · Computer Science 2016-12-19 Karl Ridgeway

Adjusting for latent covariates is crucial for estimating causal effects from observational textual data. Most existing methods only account for confounding covariates that affect both treatment and outcome, potentially leading to biased…

Computation and Language · Computer Science 2023-11-27 Yuxiang Zhou , Yulan He

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and…

Machine Learning · Computer Science 2023-03-31 Mirco Mutti , Riccardo De Santi , Emanuele Rossi , Juan Felipe Calderon , Michael Bronstein , Marcello Restelli

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as…

Machine Learning · Computer Science 2024-12-02 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi