English
Related papers

Related papers: Nonlinear Invariant Risk Minimization: A Causal Ap…

200 papers

Owing to the cross-pollination between causal discovery and deep learning, non-statistical data (e.g., images, text, etc.) encounters significant conflicts in terms of properties and methods with traditional causal data. To unify these data…

Machine Learning · Computer Science 2023-08-14 Hang Chen , Xinyu Yang , Qing Yang

This paper considers the out-of-distribution (OOD) generalization problem under the setting that both style distribution shift and spurious features exist and domain labels are missing. This setting frequently arises in real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ruimeng Li , Yuanhao Pu , Zhaoyi Li , Hong Xie , Defu Lian

Invariant prediction uses the prediction stability of causal relationships across different environments to identify causal variables. Conversely, using causal variables gives prediction guarantees even in out-of-sample data settings. In…

Methodology · Statistics 2025-11-04 Lucas Kania , Ernst Wit

Out-of-distribution (OOD) generalization is indispensable for learning models in the wild, where testing distribution typically unknown and different from the training. Recent methods derived from causality have shown great potential in…

Machine Learning · Computer Science 2024-05-13 Mengyue Yang , Zhen Fang , Yonggang Zhang , Yali Du , Furui Liu , Jean-Francois Ton , Jianhong Wang , Jun Wang

Despite recent success in using the invariance principle for out-of-distribution (OOD) generalization on Euclidean data (e.g., images), studies on graph data are still limited. Different from images, the complex nature of graphs poses…

Machine Learning · Computer Science 2022-10-12 Yongqiang Chen , Yonggang Zhang , Yatao Bian , Han Yang , Kaili Ma , Binghui Xie , Tongliang Liu , Bo Han , James Cheng

Visual representations underlie object recognition tasks, but they often contain both robust and non-robust features. Our main observation is that image classifiers may perform poorly on out-of-distribution samples because spurious…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Chengzhi Mao , Kevin Xia , James Wang , Hao Wang , Junfeng Yang , Elias Bareinboim , Carl Vondrick

Offline model-based reinforcement learning (MBRL) enhances data efficiency by utilizing pre-collected datasets to learn models and policies, especially in scenarios where exploration is costly or infeasible. Nevertheless, its performance…

Machine Learning · Computer Science 2025-03-04 Haohong Lin , Wenhao Ding , Jian Chen , Laixi Shi , Jiacheng Zhu , Bo Li , Ding Zhao

In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables…

Machine Learning · Statistics 2023-12-07 Simon Bing , Jonas Wahl , Urmi Ninad , Jakob Runge

Learning representations purely from observations concerns the problem of learning a low-dimensional, compact representation which is beneficial to prediction models. Under the hypothesis that the intrinsic latent factors follow some casual…

Machine Learning · Computer Science 2023-10-24 Mengyue Yang , Xinyu Cai , Furui Liu , Weinan Zhang , Jun Wang

In many problems, the measured variables (e.g., image pixels) are just mathematical functions of the latent causal variables (e.g., the underlying concepts or objects). For the purpose of making predictions in changing environments or…

Machine Learning · Computer Science 2024-08-13 Kun Zhang , Shaoan Xie , Ignavier Ng , Yujia Zheng

Causal representation learning aims to unveil latent high-level causal representations from observed low-level data. One of its primary tasks is to provide reliable assurance of identifying these latent causal models, known as…

Machine Learning · Computer Science 2024-12-02 Yuhang Liu , Zhen Zhang , Dong Gong , Mingming Gong , Biwei Huang , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Context-based offline meta-reinforcement learning (OMRL) methods have achieved appealing success by leveraging pre-collected offline datasets to develop task representations that guide policy learning. However, current context-based OMRL…

Machine Learning · Computer Science 2025-02-04 Zhengzhe Zhang , Wenjia Meng , Haoliang Sun , Gang Pan

We consider learning from labeled data collected across multiple environments, where the data distribution may vary across these environments. This problem is commonly approached from a causal perspective, seeking invariant representations…

Machine Learning · Statistics 2026-04-30 Yuli Slavutsky , David M. Blei

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Distributional robustness is a central goal of prediction algorithms due to the prevalent distribution shifts in real-world data. The prediction model aims to minimize the worst-case risk among a class of distributions, a.k.a., an…

Machine Learning · Statistics 2025-05-20 Marin Šola , Peter Bühlmann , Xinwei Shen

Causal representation learning seeks to uncover causal relationships among high-level latent variables from low-level, entangled, and noisy observations. Existing approaches often either rely on deep neural networks, which lack…

Methodology · Statistics 2026-03-27 Wenjin Zhang , Yixin Wang , Yuqi Gu

Existing open set recognition (OSR) methods are typically designed for static scenarios, where models aim to classify known classes and identify unknown ones within fixed scopes. This deviates from the expectation that the model should…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Runqing Yang , Yimin Fu , Changyuan Wu , Zhunga Liu

The Invariant Risk Minimization (IRM) framework aims to learn invariant features from a set of environments for solving the out-of-distribution (OOD) generalization problem. The underlying assumption is that the causal components of the…

Machine Learning · Computer Science 2021-12-28 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Current supervised learning can learn spurious correlation during the data-fitting process, imposing issues regarding interpretability, out-of-distribution (OOD) generalization, and robustness. To avoid spurious correlation, we propose a…

Machine Learning · Computer Science 2021-04-29 Xinwei Sun , Botong Wu , Xiangyu Zheng , Chang Liu , Wei Chen , Tao Qin , Tie-yan Liu

The task of inferring high-level causal variables from low-level observations, commonly referred to as causal representation learning, is fundamentally underconstrained. As such, recent works to address this problem focus on various…

Machine Learning · Statistics 2024-03-26 Simon Bing , Urmi Ninad , Jonas Wahl , Jakob Runge