English
Related papers

Related papers: Causal Fine-Tuning under Latent Confounded Shift

200 papers

We present a constraint-based algorithm for learning causal structures from observational time-series data, in the presence of latent confounders. We assume a discrete-time, stationary structural vector autoregressive process, with both…

Artificial Intelligence · Computer Science 2023-06-02 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Gal Novik

Climate models are essential to understand and project climate change, yet long-standing biases and uncertainties in their projections remain. This is largely associated with the representation of subgrid-scale processes, particularly…

Confounding is a significant obstacle to unbiased estimation of causal effects from observational data. For settings with high-dimensional covariates -- such as text data, genomics, or the behavioral social sciences -- researchers have…

Artificial Intelligence · Computer Science 2024-02-01 Katherine A. Keith , Sergey Feldman , David Jurgens , Jonathan Bragg , Rohit Bhattacharya

Temporal causal representation learning is a powerful tool for uncovering complex patterns in observational studies, which are often represented as low-dimensional time series. However, in many real-world applications, data are…

Machine Learning · Computer Science 2025-07-21 Jianhong Chen , Meng Zhao , Mostafa Reisi Gahrooei , Xubo Yue

Within the field of causal inference, we consider the problem of estimating heterogeneous treatment effects from data. We propose and validate a novel approach for learning feature representations to aid the estimation of the conditional…

Machine Learning · Statistics 2022-06-23 Michael C. Burkhart , Gabriel Ruiz

Anomaly detection in multivariate time series is a central challenge in industrial monitoring, as failures frequently arise from complex temporal dynamics and cross-sensor interactions. While recent deep learning models, including graph…

Machine Learning · Computer Science 2026-04-21 Pooyan Khosravinia , João Gama , Bruno Veloso

Current supervised learning can learn spurious correlation during the data-fitting process, imposing issues regarding interpretability, out-of-distribution (OOD) generalization, and robustness. To avoid spurious correlation, we propose a…

Machine Learning · Computer Science 2021-04-29 Xinwei Sun , Botong Wu , Xiangyu Zheng , Chang Liu , Wei Chen , Tao Qin , Tie-yan Liu

Deep learning has revolutionized the field of artificial intelligence. Based on the statistical correlations uncovered by deep learning-based methods, computer vision has contributed to tremendous growth in areas like autonomous driving and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Kexuan Zhang , Qiyu Sun , Chaoqiang Zhao , Yang Tang

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

Machine Learning · Computer Science 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

Causal models can compactly and efficiently encode the data-generating process under all interventions and hence may generalize better under changes in distribution. These models are often represented as Bayesian networks and learning them…

Machine Learning · Statistics 2020-08-24 Nan Rosemary Ke , Jane. X. Wang , Jovana Mitrovic , Martin Szummer , Danilo J. Rezende

Continual post-training (CPT) is a popular and effective technique for adapting foundation models like multimodal large language models to specific and ever-evolving downstream tasks. While existing research has primarily concentrated on…

Machine Learning · Computer Science 2026-01-22 Song Lai , Haohan Zhao , Rong Feng , Changyi Ma , Wenzhuo Liu , Hongbo Zhao , Xi Lin , Dong Yi , Qingfu Zhang , Hongbin Liu , Gaofeng Meng , Fei Zhu

Meta-learning methods perform well on new within-distribution tasks but often fail when adapting to out-of-distribution target tasks, where transfer from source tasks can induce negative transfer. We propose a causally-aware Bayesian…

Machine Learning · Computer Science 2026-02-24 Lotta Mäkinen , Jorge Loría , Samuel Kaski

Handling class imbalance remains a central challenge in machine learning, particularly in pattern recognition tasks where identifying rare but critical anomalies is of paramount importance. Traditional generative models often decouple data…

Machine Learning · Computer Science 2026-05-05 Hanbeot Park , Yunjeong Cho , Hunhee Kim

Learning about cause and effect is arguably the main goal in applied econometrics. In practice, the validity of these causal inferences is contingent on a number of critical assumptions regarding the type of data that has been collected and…

Econometrics · Economics 2023-03-03 Paul Hünermund , Elias Bareinboim

Classical machine learning techniques often struggle with overfitting and unreliable predictions when exposed to novel conditions. Introducing causality into the modelling process offers a promising way to mitigate these challenges by…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 David Zapata Gonzalez , Marcel Meyer , Oliver Mueller

The emergence of large pre-trained networks has revolutionized the AI field, unlocking new possibilities and achieving unprecedented performance. However, these models inherit a fundamental limitation from traditional Machine Learning…

Fine-tuning Vision Foundation Models (VFMs) with a small number of parameters has shown remarkable performance in Domain Generalized Semantic Segmentation (DGSS). Most existing works either train lightweight adapters or refine intermediate…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Yin Zhang , Yongqiang Zhang , Yaoyue Zheng , Bogdan Raducanu , Dan Liu

Estimation of causal effects is critical to a range of scientific disciplines. Existing methods for this task either require interventional data, knowledge about the ground truth causal graph, or rely on assumptions such as…

Machine Learning · Computer Science 2025-11-21 Jake Robertson , Arik Reuter , Siyuan Guo , Noah Hollmann , Frank Hutter , Bernhard Schölkopf

Feature attribution is a fundamental task in both machine learning and data analysis, which involves determining the contribution of individual features or variables to a model's output. This process helps identify the most important…

Machine Learning · Computer Science 2023-10-26 Jinfeng Zhong , Elsa Negre

In-context Learning (ICL) utilizes structured demonstration-query inputs to induce few-shot learning on Language Models (LMs), which are not originally pre-trained on ICL-style data. To bridge the gap between ICL and pre-training, some…

Computation and Language · Computer Science 2025-09-30 Hakaze Cho , Peng Luo , Mariko Kato , Rin Kaenbyou , Naoya Inoue