English
Related papers

Related papers: Learning Causal Orderings for In-Context Tabular P…

200 papers

In the algorithm Intersort, Chevalley et al. (2024) proposed a score-based method to discover the causal order of variables in a Directed Acyclic Graph (DAG) model, leveraging interventional data to outperform existing methods. However, as…

Machine Learning · Computer Science 2024-10-14 Mathieu Chevalley , Arash Mehrjou , Patrick Schwab

We consider learning a causal ordering of variables in a linear non-Gaussian acyclic model called LiNGAM. Several existing methods have been shown to consistently estimate a causal ordering assuming that all the model assumptions are…

Machine Learning · Statistics 2013-07-30 Tatsuya Tashiro , Shohei Shimizu , Aapo Hyvarinen , Takashi Washio

Causal discovery is fundamental for multiple scientific domains, yet extracting causal information from real world data remains a significant challenge. Given the recent success on real data, we investigate whether TabPFN, a…

Machine Learning · Computer Science 2025-11-11 Omar Swelam , Lennart Purucker , Jake Robertson , Hanne Raum , Joschka Boedecker , Frank Hutter

Determining the causal structure of a set of variables is critical for both scientific inquiry and decision-making. However, this is often challenging in practice due to limited interventional data. Given that randomized experiments are…

Methodology · Statistics 2019-02-28 Raj Agrawal , Chandler Squires , Karren Yang , Karthik Shanmugam , Caroline Uhler

Understanding directed temporal interactions in multivariate time series is essential for interpreting complex dynamical systems and the predictive models trained on them. We present Causal-INSIGHT, a model-agnostic, post-hoc interpretation…

Machine Learning · Computer Science 2026-03-27 Benjamin Redden , Hui Wang , Shuyan Li

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

Machine Learning · Computer Science 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

Effective analysis of tabular data still poses a significant problem in deep learning, mainly because features in tabular datasets are often heterogeneous and have different levels of relevance. This work introduces TabSeq, a novel…

Machine Learning · Computer Science 2024-10-22 Al Zadid Sultan Bin Habib , Kesheng Wang , Mary-Anne Hartley , Gianfranco Doretto , Donald A. Adjeroh

Learning causal relations from observational data is challenging because the graph search space grows super-exponentially with the number of variables. Ordering-based methods reduce this space by first identifying the topological ordering,…

Machine Learning · Computer Science 2026-05-19 Rafat Ashraf Joy , Elena Zheleva

Deep learning methods have demonstrated outstanding performances on classification and regression tasks on homogeneous data types (e.g., image, audio, and text data). However, tabular data still pose a challenge, with classic machine…

Machine Learning · Computer Science 2023-11-15 Antonio Briola , Yuanrong Wang , Silvia Bartolucci , Tomaso Aste

Identifying causal relations from purely observational data typically requires additional assumptions on relations and/or noise. Most current methods restrict their analysis to datasets that are assumed to have pure linear or nonlinear…

Machine Learning · Computer Science 2024-10-10 Zhuopeng Xu , Yujie Li , Cheng Liu , Ning Gui

We derive a set of causal deep neural networks whose architectures are a consequence of tensor (multilinear) factor analysis, a framework that facilitates causal inference. Forward causal questions are addressed with a neural network…

Machine Learning · Computer Science 2025-06-17 M. Alex O. Vasilescu

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

Machine Learning · Computer Science 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

Learning high-level causal representations together with a causal model from unstructured low-level data such as pixels is impossible from observational data alone. We prove under mild assumptions that this representation is however…

Machine Learning · Statistics 2022-10-12 Johann Brehmer , Pim de Haan , Phillip Lippe , Taco Cohen

In strategic classification, an institution (e.g., a bank) anticipates adaptation from users who change their features to increase utility in a classification task (e.g., loan repayment). Since a key challenge is the distribution shift…

Machine Learning · Computer Science 2026-05-27 Antonio Gois , Sophia Gunluk , Nir Rosenfeld , Nidhi Hegde , Simon Lacoste-Julien , Dhanya Sridhar

Structural causal models are the basic modelling unit in Pearl's causal theory; in principle they allow us to solve counterfactuals, which are at the top rung of the ladder of causation. But they often contain latent variables that limit…

Artificial Intelligence · Computer Science 2021-11-23 Marco Zaffalon , Alessandro Antonucci , Rafael Cabañas

Neural networks have proven to be effective at solving machine learning tasks but it is unclear whether they learn any relevant causal relationships, while their black-box nature makes it difficult for modellers to understand and debug…

Machine Learning · Computer Science 2023-08-02 Fabrizio Russo , Francesca Toni

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

Machine Learning · Computer Science 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Causal structure learning with data from multiple contexts carries both opportunities and challenges. Opportunities arise from considering shared and context-specific causal graphs enabling to generalize and transfer causal knowledge across…

Machine Learning · Computer Science 2024-10-29 Martin Rabel , Wiebke Günther , Jakob Runge , Andreas Gerhardus

Deep neural networks can obtain impressive performance on various tasks under the assumption that their training domain is identical to their target domain. Performance can drop dramatically when this assumption does not hold. One…

Machine Learning · Computer Science 2024-10-10 Gaël Gendron , Michael Witbrock , Gillian Dobbie

Tabular learning is still dominated by row-wise predictors that score each row independently, which fits i.i.d. benchmarks but fails on transactional, temporal, and relational tables where labels depend on other rows. We show that row-wise…

Machine Learning · Computer Science 2026-02-05 Tamara Cucumides , Floris Geerts