English
Related papers

Related papers: Amortized Causal Discovery with Prior-Fitted Netwo…

200 papers

Building predictive models for tabular data presents fundamental challenges, notably in scaling consistently, i.e., more resources translating to better performance, and generalizing systematically beyond the training data distribution.…

Perturbation experiments allow biologists to discover causal relationships between variables of interest, but the sparsity and high dimensionality of these data pose significant challenges for causal structure learning algorithms.…

Quantitative Methods · Quantitative Biology 2024-10-21 Peiwen Li , Menghua Wu

Foundation models for tabular data, such as the Tabular Prior-data Fitted Network (TabPFN), are pre-trained on a massive number of synthetic datasets generated by structural causal models (SCM). They leverage in-context learning to offer…

Machine Learning · Computer Science 2026-01-28 Qinyi Liu , Mohammad Khalil , Naman Goel

Prior-Data Fitted Networks (PFNs) enable amortized Bayesian inference in a single forward pass, yet their internal representations remain opaque. It is unknown whether PFNs encode identifiable Bayesian structure or merely memorize…

Machine Learning · Computer Science 2026-05-14 Kaustubh Sharma , Srijan Tiwari , Ojasva Nema , Parikshit Pareek

Learning curve extrapolation aims to predict model performance in later epochs of training, based on the performance in earlier epochs. In this work, we argue that, while the inherent uncertainty in the extrapolation of learning curves…

Machine Learning · Computer Science 2023-11-01 Steven Adriaensen , Herilalaina Rakotoarison , Samuel Müller , Frank Hutter

Learning community structures in graphs has broad applications across scientific domains. While graph neural networks (GNNs) have been successful in encoding graph structures, existing GNN-based methods for community detection are limited…

Machine Learning · Statistics 2024-08-05 Yueqi Wang , Yoonho Lee , Pallab Basu , Juho Lee , Yee Whye Teh , Liam Paninski , Ari Pakman

A decision-maker must consider cofounding bias when attempting to apply machine learning prediction, and, while feature selection is widely recognized as important process in data-analysis, it could cause cofounding bias. A causal Bayesian…

Machine Learning · Statistics 2020-03-02 Akihiro Yabe

Probabilistic programming languages (PPLs) are a powerful modeling tool, able to represent any computable probability distribution. Unfortunately, probabilistic program inference is often intractable, and existing PPLs mostly rely on…

Artificial Intelligence · Computer Science 2016-10-19 Daniel Ritchie , Paul Horsfall , Noah D. Goodman

Prior-Fitted Networks (PFNs) have recently been proposed to efficiently perform tabular classification tasks. Although they achieve good performance on small datasets, they encounter limitations with larger datasets. These limitations…

Machine Learning · Computer Science 2025-03-04 Yuxin Wang , Botian Jiang , Yiran Guo , Quan Gan , David Wipf , Xuanjing Huang , Xipeng Qiu

Real-world data is frequently noisy and ambiguous. In crowdsourcing, for example, human annotators may assign conflicting class labels to the same instances. Partial-label learning (PLL) addresses this challenge by training classifiers when…

Machine Learning · Computer Science 2026-01-12 Tobias Fuchs , Nadja Klein

Structural Causal Models (SCMs) offer a principled framework to reason about interventions and support out-of-distribution generalization, which are key goals in scientific discovery. However, the task of learning SCMs from observed data…

Machine Learning · Computer Science 2026-04-06 Divyat Mahajan , Jannes Gladrow , Agrin Hilmkil , Cheng Zhang , Meyer Scetbon

Federated learning of causal estimands offers a powerful strategy to improve estimation efficiency by leveraging data from multiple study sites while preserving privacy. Existing literature has primarily focused on the average treatment…

Methodology · Statistics 2025-11-24 Siqi Cao , Shu Yang

Leveraging deep learning for causal discovery in time series remains challenging because existing neural methods predominantly rely on component-wise architectures that fail to capture shared system dynamics or employ decoupled post-hoc…

Machine Learning · Computer Science 2026-05-11 Omar Muhammad , Pasupuleti Dhruv Shivkant , Deepak N. Subramani

This paper introduces an algorithm-agnostic approach to feature-based time series clustering via amortized neural inference. By training neural networks to approximate the optimal partitioning rule from simulated data, the proposed…

Machine Learning · Statistics 2026-05-14 Ángel López-Oriona , Ying Sun

Network structure is growing popular for capturing the intrinsic relationship between large-scale variables. In the paper we propose to improve the estimation accuracy for large-dimensional factor model when a network structure between…

Methodology · Statistics 2020-01-30 Long Yu , Yong He , Xinsheng Zhang , Ji Zhu

Autoregressive large language models (LLMs) compress knowledge from their training data through next-token conditional distributions. This limits tractable querying of this knowledge to start-to-end autoregressive sampling. However, many…

Machine Learning · Computer Science 2024-03-15 Edward J. Hu , Moksh Jain , Eric Elmoznino , Younesse Kaddar , Guillaume Lajoie , Yoshua Bengio , Nikolay Malkin

We present a novel technique for amortized posterior estimation using Normalizing Flows trained with likelihood-weighted importance sampling. This approach allows for the efficient inference of theoretical parameters in high-dimensional…

Machine Learning · Computer Science 2026-02-23 Rajneil Baruah

Prior-data fitted networks (PFNs) have achieved exceptional performance on tabular classification tasks. However, like other classifiers, their performance can suffer under the effect of class imbalance, resulting in poor performance for…

Machine Learning · Computer Science 2026-05-22 Samuel McDowell , Nathan Stromberg , Lalitha Sankar

Many of the causal discovery methods rely on the faithfulness assumption to guarantee asymptotic correctness. However, the assumption can be approximately violated in many ways, leading to sub-optimal solutions. Although there is a line of…

Machine Learning · Computer Science 2022-01-19 Ignavier Ng , Yujia Zheng , Jiji Zhang , Kun Zhang

Learning causal relationships from empirical observations is a central task in scientific research. A common method is to employ structural causal models that postulate noisy functional relations among a set of interacting variables. To…

Machine Learning · Statistics 2023-09-11 Grigor Keropyan , David Strieder , Mathias Drton