English
Related papers

Related papers: Arbitrary Conditional Distributions with Energy

200 papers

Selection bias is pervasive in observational studies. For example, large scale biobanks data can exhibit ``healthy volunteer bias'' when respondents are healthier and of higher socio-economic status than the population they are meant to…

Methodology · Statistics 2026-05-14 Yiwen Qiu , Filip Kovacevic , Shimeng Huang , Peter Spirtes , Francesco Locatello

Ordinary differential equations (ODEs), via their induced flow maps, provide a powerful framework to parameterize invertible transformations for the purpose of representing complex probability distributions. While such models have achieved…

Statistics Theory · Mathematics 2023-09-06 Youssef Marzouk , Zhi Ren , Sven Wang , Jakob Zech

In this paper, we introduce a new causal methodology that accounts for the rarity and frequency of events in observational studies based on their relevance to the underlying problem. Specifically, we propose a direct causal effect metric…

Artificial Intelligence · Computer Science 2025-02-28 Usef Faghihi , Amir Saki

We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a black-box machine-learning predictor is available. The goal is to perform statistical inference on…

Machine Learning · Statistics 2026-03-09 Yang Sui , Jin Zhou , Hua Zhou , Xiaowu Dai

Density regression provides a flexible strategy for modeling the distribution of a response variable $Y$ given predictors $\mathbf{X}=(X_1,\ldots,X_p)$ by letting that the conditional density of $Y$ given $\mathbf{X}$ as a completely…

Statistics Theory · Mathematics 2016-01-07 Weining Shen , Subhashis Ghosal

Density ratio estimation (DRE) is a fundamental machine learning technique for comparing two probability distributions. However, existing methods struggle in high-dimensional settings, as it is difficult to accurately compare probability…

Machine Learning · Computer Science 2022-03-15 Kristy Choi , Chenlin Meng , Yang Song , Stefano Ermon

Approximate Bayesian Computation (ABC) has become one of the major tools of likelihood-free statistical inference in complex mathematical models. Simultaneously, stochastic differential equations (SDEs) have developed to an established tool…

Computation · Statistics 2019-07-08 Evelyn Buckwar , Massimiliano Tamborrino , Irene Tubikanec

Current causal discovery approaches require restrictive model assumptions in the absence of interventional data to ensure structure identifiability. These assumptions often do not hold in real-world applications leading to a loss of…

Machine Learning · Statistics 2025-06-25 Anish Dhir , Ruby Sedgwick , Avinash Kori , Ben Glocker , Mark van der Wilk

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

Short-term forecasting is an important tool in understanding environmental processes. In this paper, we incorporate machine learning algorithms into a conditional distribution estimator for the purposes of forecasting tropical cyclone…

Machine Learning · Statistics 2020-08-19 David B. Huberman , Brian J. Reich , Howard D. Bondell

While significant progress has been made in specifying neural networks capable of representing uncertainty, deep networks still often suffer from overconfidence and misaligned predictive distributions. Existing approaches for measuring this…

Machine Learning · Computer Science 2025-10-24 Spencer Young , Riley Sinema , Cole Edgren , Andrew Hall , Nathan Dong , Porter Jenkins

Energy-based models (EBMs) are powerful probabilistic models, but suffer from intractable sampling and density evaluation due to the partition function. As a result, inference in EBMs relies on approximate sampling algorithms, leading to a…

Machine Learning · Computer Science 2020-01-10 Dieterich Lawson , George Tucker , Bo Dai , Rajesh Ranganath

Active Learning for discriminative models has largely been studied with the focus on individual samples, with less emphasis on how classes are distributed or which classes are hard to deal with. In this work, we show that this is harmful.…

Machine Learning · Computer Science 2020-12-04 Jongwon Choi , Kwang Moo Yi , Jihoon Kim , Jinho Choo , Byoungjip Kim , Jin-Yeop Chang , Youngjune Gwon , Hyung Jin Chang

Causal decomposition analysis (CDA) is an approach for modeling the impact of hypothetical interventions to reduce disparities. It is useful for identifying foci that future interventions, including multilevel and multimodal interventions,…

Methodology · Statistics 2026-04-28 John W. Jackson , Ting-Hsuan Chang , Aster Meche , Trang Q. Nguyen

Making sense of a dataset in an automatic and unsupervised fashion is a challenging problem in statistics and AI. Classical approaches for {exploratory data analysis} are usually not flexible enough to deal with the uncertainty inherent to…

Multi-attribute classification generalizes classification, presenting new challenges for making accurate predictions and quantifying uncertainty. We build upon recent work and show that architectures for multi-attribute prediction can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jacob Kelly , Richard Zemel , Will Grathwohl

A framework is proposed that addresses both conditional density estimation and latent variable discovery. The objective function maximizes explanation of variability in the data, achieved through the optimal transport barycenter generalized…

Optimization and Control · Mathematics 2026-02-18 Hongkang Yang , Esteban G. Tabak

Conditional neural processes (CNPs; Garnelo et al., 2018a) are attractive meta-learning models which produce well-calibrated predictions and are trainable via a simple maximum likelihood procedure. Although CNPs have many advantages, they…

Accumulated Local Effects (ALE) is a widely-used explainability method for isolating the average effect of a feature on the output, because it handles cases with correlated features well. However, it has two limitations. First, it does not…

Machine Learning · Computer Science 2023-09-21 Vasilis Gkolemis , Theodore Dalamagas , Eirini Ntoutsi , Christos Diou

Accumulated Local Effect (ALE) is a method for accurately estimating feature effects, overcoming fundamental failure modes of previously-existed methods, such as Partial Dependence Plots. However, ALE's approximation, i.e. the method for…

Machine Learning · Computer Science 2022-10-11 Vasilis Gkolemis , Theodore Dalamagas , Christos Diou