English
Related papers

Related papers: A Meta-Transfer Objective for Learning to Disentan…

200 papers

Learning models that offer robust out-of-distribution generalization and fast adaptation is a key challenge in modern machine learning. Modelling causal structure into neural networks holds the promise to accomplish robust zero and few-shot…

Machine Learning · Computer Science 2022-06-10 Nino Scherrer , Anirudh Goyal , Stefan Bauer , Yoshua Bengio , Nan Rosemary Ke

This paper introduces a new framework for recovering causal graphs from observational data, leveraging the observation that the distribution of an effect, conditioned on its causes, remains invariant to changes in the prior distribution of…

Machine Learning · Computer Science 2026-02-04 Nang Hung Nguyen , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang , Masashi Sugiyama

An important goal common to domain adaptation and causal inference is to make accurate predictions when the distributions for the source (or training) domain(s) and target (or test) domain(s) differ. In many cases, these different…

Machine Learning · Computer Science 2022-08-31 Sara Magliacane , Thijs van Ommen , Tom Claassen , Stephan Bongers , Philip Versteeg , Joris M. Mooij

We consider causal models with two observed variables and one latent variables, each variable being discrete, with the goal of characterizing the possible distributions on outcomes that can result from controlling one of the observed…

Information Theory · Computer Science 2021-03-05 Kevin Shu

We present a constraint-based algorithm for learning causal structures from observational time-series data, in the presence of latent confounders. We assume a discrete-time, stationary structural vector autoregressive process, with both…

Artificial Intelligence · Computer Science 2023-06-02 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Gal Novik

Classical supervised learning produces unreliable models when training and target distributions differ, with most existing solutions requiring samples from the target domain. We propose a proactive approach which learns a relationship in…

Machine Learning · Statistics 2019-03-01 Adarsh Subbaswamy , Peter Schulam , Suchi Saria

Discovering and exploiting the causal structure in the environment is a crucial challenge for intelligent agents. Here we explore whether causal reasoning can emerge via meta-reinforcement learning. We train a recurrent network with…

Gradient-based meta-learning has proven to be highly effective at learning model initializations, representations, and update rules that allow fast adaptation from a few samples. The core idea behind these approaches is to use fast…

Machine Learning · Computer Science 2019-10-07 Khurram Javed , Hengshuai Yao , Martha White

We describe a mechanism by which artificial neural networks can learn rapid adaptation - the ability to adapt on the fly, with little data, to new tasks - that we call conditionally shifted neurons. We apply this mechanism in the framework…

Machine Learning · Computer Science 2018-07-05 Tsendsuren Munkhdalai , Xingdi Yuan , Soroush Mehri , Adam Trischler

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

[Context] Multi-agent reinforcement learning (MARL) has achieved notable success in environments where agents must learn coordinated behaviors. However, transferring knowledge across agents remains challenging in non-stationary environments…

Artificial Intelligence · Computer Science 2025-07-21 Kathrin Korte , Christian Medeiros Adriano , Sona Ghahremani , Holger Giese

Meta-learning has proven to be successful for few-shot learning across the regression, classification, and reinforcement learning paradigms. Recent approaches have adopted Bayesian interpretations to improve gradient-based meta-learners by…

Machine Learning · Computer Science 2020-12-01 Amrith Setlur , Saket Dingliwal , Barnabas Poczos

The goal of optimization-based meta-learning is to find a single initialization shared across a distribution of tasks to speed up the process of learning new tasks. Conditional meta-learning seeks task-specific initialization to better…

Machine Learning · Computer Science 2020-10-20 Ruohan Wang , Yiannis Demiris , Carlo Ciliberto

A major problem of machine-learning approaches in structural dynamics is the frequent lack of structural data. Inspired by the recently-emerging field of population-based structural health monitoring (PBSHM), and the use of transfer…

Machine Learning · Computer Science 2023-02-17 G. Tsialiamanis , N. Dervilis , D. J. Wagg , K. Worden

In-context learning for tabular data sets strong predictive standards in observational settings; it however primarily relies on correlational structure, which becomes unreliable under distribution shift or intervention. While established…

Machine Learning · Computer Science 2026-05-22 Sascha Xu , Sarah Mameche , Jilles Vreeken

Machine learning methods adapt the parameters of a model, constrained to lie in a given model class, by using a fixed learning procedure based on data or active observations. Adaptation is done on a per-task basis, and retraining is needed…

Machine Learning · Computer Science 2021-10-22 Osvaldo Simeone , Sangwoo Park , Joonhyuk Kang

It is commonplace to encounter heterogeneous or nonstationary data, of which the underlying generating process changes across domains or over time. Such a distribution shift feature presents both challenges and opportunities for causal…

Machine Learning · Computer Science 2020-06-26 Biwei Huang , Kun Zhang , Jiji Zhang , Joseph Ramsey , Ruben Sanchez-Romero , Clark Glymour , Bernhard Schölkopf

The goal of Causal Discovery is to find automated search methods for learning causal structures from observational data. In some cases all variables of the interested causal mechanism are measured, and the task is to predict the effects one…

Machine Learning · Statistics 2024-01-11 Shuyan Wang

Causal Temporal Representation Learning (Ctrl) methods aim to identify the temporal causal dynamics of complex nonstationary temporal sequences. Despite the success of existing Ctrl methods, they require either directly observing the domain…

Machine Learning · Computer Science 2024-09-06 Xiangchen Song , Zijian Li , Guangyi Chen , Yujia Zheng , Yewen Fan , Xinshuai Dong , Kun Zhang

Most work on causality in machine learning assumes that causal relationships are driven by a constant underlying process. However, the flexibility of agents' actions or tipping points in the environmental process can change the qualitative…