English
Related papers

Related papers: Prior-Data Fitted Networks for Causal Inference: a…

200 papers

Thompson sampling is a widely used strategy for contextual bandits: at each round, it samples a reward function from a Bayesian posterior and acts greedily under that sample. Prior-data fitted networks (PFNs), such as TabPFN v2+ and TabICL…

Machine Learning · Statistics 2026-05-12 Yan Shuo Tan , Kenyon Ng , Ruizhe Deng , Sumetha Loganathan , Qiong Zhang , Bibhas Chakraborty

Foundation models are an emerging research direction in tabular deep learning. Notably, TabPFNv2 recently claimed superior performance over traditional GBDT-based methods on small-scale datasets using an in-context learning paradigm, which…

Machine Learning · Computer Science 2025-06-12 Ivan Rubachev , Akim Kotelnikov , Nikolay Kartashev , Artem Babenko

We introduce a multimodal deep learning framework, Prescriptive Neural Networks (PNNs), that combines ideas from optimization and machine learning, and is, to the best of our knowledge, the first prescriptive method to handle multimodal…

Machine Learning · Computer Science 2025-01-27 Dimitris Bertsimas , Lisa Everest , Vasiliki Stoumpou

Shapley values have become a cornerstone of explainable AI, but they are computationally expensive to use, especially when features are dependent. Evaluating them requires approximating a large number of conditional expectations, either via…

Artificial Intelligence · Computer Science 2026-02-11 Lars Henry Berge Olsen , Dennis Christensen

Causal discovery and inference from observational data is an essential problem in statistics posing both modeling and computational challenges. These are typically addressed by imposing strict assumptions on the joint distribution such as…

Machine Learning · Statistics 2024-02-20 Enrico Giudice , Jack Kuipers , Giusi Moffa

Traditional causal inference approaches leverage observational study data to estimate the difference in observed and unobserved outcomes for a potential treatment, known as the Conditional Average Treatment Effect (CATE). However, CATE…

Machine Learning · Statistics 2022-09-22 Tianhui Zhou , William E Carson , David Carlson

We study Federated Causal Inference, an approach to estimate treatment effects from decentralized data across centers. We compare three classes of Average Treatment Effect (ATE) estimators derived from the Plug-in G-Formula, ranging from…

Machine Learning · Statistics 2025-03-26 Rémi Khellaf , Aurélien Bellet , Julie Josse

The vast majority of time-series forecasting approaches require a substantial training dataset. However, many real-life forecasting applications have very little initial observations, sometimes just 40 or fewer. Thus, the applicability of…

Machine Learning · Computer Science 2023-11-06 Samuel Dooley , Gurnoor Singh Khurana , Chirag Mohapatra , Siddartha Naidu , Colin White

This paper studies the prediction task of tensor-on-tensor regression in which both covariates and responses are multi-dimensional arrays (a.k.a., tensors) across time with arbitrary tensor order and data dimension. Existing methods either…

Machine Learning · Statistics 2024-12-23 Guanhao Zhou , Yuefeng Han , Xiufan Yu

Non-parametric distributional regression has achieved significant milestones in recent years. Among these, the Tabular Prior-Data Fitted Network (TabPFN) has demonstrated state-of-the-art performance on various benchmarks. However, a…

Soft Condensed Matter · Physics 2026-01-12 Jonas Landsgesell

The practical utility of causality in decision-making is widespread and brought about by the intertwining of causal discovery and causal inference. Nevertheless, a notable gap exists in the evaluation of causal discovery methods, where…

Machine Learning · Computer Science 2023-08-01 Chris Chinenye Emezue , Alexandre Drouin , Tristan Deleu , Stefan Bauer , Yoshua Bengio

Synthetic tabular data generation has received increasing attention in recent years, particularly with the emergence of foundation models for tabular data. The breakthrough success of TabPFN (Hollmann et al.,2025), which leverages vast…

Machine Learning · Computer Science 2025-07-08 Frederik Hoppe , Astrid Franz , Lars Kleinemeier , Udo Göbel

Traditional panel-data causal inference frameworks, such as difference-in-differences and synthetic control methods, rely on pre-intervention data to estimate counterfactual means. However, such data may be unavailable in real-world…

Methodology · Statistics 2026-02-10 Zou Yang , Seung Hee Lee , Julia R. Köhler , AmirEmad Ghassami

Causal inference typically assumes centralized access to individual-level data. Yet, in practice, data are often decentralized across multiple sites, making centralization infeasible due to privacy, logistical, or legal constraints. We…

Methodology · Statistics 2026-02-04 Rémi Khellaf , Aurélien Bellet , Julie Josse

Generative modelling is a demanding test of foundation models, because it requires robust, holistic representation learning for a given data modality, rather than optimisation for a supervised prediction target alone. While recent work on…

Machine Learning · Computer Science 2026-05-12 Xiangjian Jiang , Mingxuan Liu , Nikola Simidjievski , Tassilo Klein , Mateja Jamnik

Foundational models (FMs), pretrained on extensive datasets using self-supervised techniques, are capable of learning generalized patterns from large amounts of data. This reduces the need for extensive labeled datasets for each new task,…

Machine Learning · Computer Science 2024-06-19 Quan M. Tran , Suong N. Hoang , Lam M. Nguyen , Dzung Phan , Hoang Thanh Lam

Estimating causal effects from large experimental and observational data has become increasingly prevalent in both industry and research. The bootstrap is an intuitive and powerful technique used to construct standard errors and confidence…

Methodology · Statistics 2023-02-07 Matthew Kosko , Lin Wang , Michele Santacatterina

Ternary Neural Networks (TNNs) have received much attention due to being potentially orders of magnitude faster in inference, as well as more power efficient, than full-precision counterparts. However, 2 bits are required to encode the…

Machine Learning · Computer Science 2021-07-30 Peng Chen , Bohan Zhuang , Chunhua Shen

We propose a Bayesian nonparametric (BNP) approach to causal inference using observational data consisting of outcome, treatment, and a set of confounders. The conditional distribution of the outcome given treatment and confounders is…

Methodology · Statistics 2025-12-01 Yongseok Hur , Joonhyuk Jung , Juhee Lee

Two-way fixed effects (TWFE) models are widely used in political science to establish causality, but recent methodological discussions highlight their limitations under heterogeneous treatment effects (HTE) and violations of the parallel…

Methodology · Statistics 2026-02-03 Albert Chiu , Xingchen Lan , Ziyi Liu , Yiqing Xu