English
Related papers

Related papers: Arbitrary Conditional Distributions with Energy

200 papers

Estimating covariance matrix from massive high-dimensional and distributed data is significant for various real-world applications. In this paper, we propose a data-aware weighted sampling based covariance matrix estimator, namely DACE,…

Machine Learning · Computer Science 2020-10-13 Xixian Chen , Haiqin Yang , Shenglin Zhao , Michael R. Lyu , Irwin King

Aleatoric uncertainty quantification seeks for distributional knowledge of random responses, which is important for reliability analysis and robustness improvement in machine learning applications. Previous research on aleatoric uncertainty…

Machine Learning · Computer Science 2022-06-10 Ziyi Huang , Henry Lam , Haofeng Zhang

This study designs an adaptive experiment for efficiently estimating average treatment effects (ATEs). In each round of our adaptive experiment, an experimenter sequentially samples an experimental unit, assigns a treatment, and observes…

Methodology · Statistics 2024-06-21 Masahiro Kato , Akihiro Oga , Wataru Komatsubara , Ryo Inokuchi

Equivariant neural networks are designed to respect symmetries through their architecture, boosting generalization and sample efficiency when those symmetries are present in the data distribution. Real-world data, however, often departs…

Machine Learning · Computer Science 2025-12-12 Andrei Manolache , Luiz F. O. Chamon , Mathias Niepert

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

Machine Learning · Computer Science 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

Uncertainty estimation has been extensively studied in recent literature, which can usually be classified as aleatoric uncertainty and epistemic uncertainty. In current aleatoric uncertainty estimation frameworks, it is often neglected that…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Jing Zhang , Yuchao Dai , Mehrtash Harandi , Yiran Zhong , Nick Barnes , Richard Hartley

Approximate Bayesian Computation (ABC) is typically used when the likelihood is either unavailable or intractable but where data can be simulated under different parameter settings using a forward model. Despite the recent interest in ABC,…

Methodology · Statistics 2019-12-24 Rafael Izbicki , Ann B. Lee , Taylor Pospisil

Many real-world optimization problems involve uncertain parameters with probability distributions that can be estimated using contextual feature information. In contrast to the standard approach of first estimating the distribution of…

Machine Learning · Statistics 2023-08-03 Meng Qi , Paul Grigas , Zuo-Jun Max Shen

Using the maximum entropy method, we derive the "adaptive cluster expansion" (ACE), which can be trained to estimate probability density functions in high dimensional spaces. The main advantage of ACE over other Bayesian networks is its…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stephen Luttrell

Set prediction is about learning to predict a collection of unordered variables with unknown interrelations. Training such models with set losses imposes the structure of a metric space over sets. We focus on stochastic and underdefined…

Machine Learning · Computer Science 2021-02-23 David W. Zhang , Gertjan J. Burghouts , Cees G. M. Snoek

Establishing cause-effect relationships from observational data often relies on untestable assumptions. It is crucial to know whether, and to what extent, the conclusions drawn from non-experimental studies are robust to potential…

Model calibration usually requires optimizing some parameters (e.g., temperature) w.r.t an objective function (e.g., negative log-likelihood). In this paper, we report a plain, important but often neglected fact that the objective function…

Machine Learning · Computer Science 2023-03-10 Yuli Zou , Weijian Deng , Liang Zheng

In recent years, the field of causal inference from observational data has emerged rapidly. The literature has focused on (conditional) average causal effect estimation. When (remaining) variability of individual causal effects (ICEs) is…

Methodology · Statistics 2025-04-10 Richard Post , Edwin van den Heuvel

While deep learning-based classification is generally tackled using standardized approaches, a wide variety of techniques are employed for regression. In computer vision, one particularly popular such technique is that of confidence-based…

Machine Learning · Computer Science 2020-07-21 Fredrik K. Gustafsson , Martin Danelljan , Goutam Bhat , Thomas B. Schön

The conditional average treatment effect (CATE) is the best measure of individual causal effects given baseline covariates. However, the CATE only captures the (conditional) average, and can overlook risks and tail events, which are…

Machine Learning · Statistics 2025-06-05 Nathan Kallus , Miruna Oprescu

Modelling partial differential equations (PDEs) is of crucial importance in science and engineering, and it includes tasks ranging from forecasting to inverse problems, such as data assimilation. However, most previous numerical and machine…

Deep neural networks are notoriously sensitive to spurious correlations - where a model learns a shortcut that fails out-of-distribution. Existing work on spurious correlations has often focused on incomplete correlations,leveraging access…

Neural density estimators are flexible families of parametric models which have seen widespread use in unsupervised machine learning in recent years. Maximum-likelihood training typically dictates that these models be constrained to specify…

Machine Learning · Statistics 2019-04-12 Charlie Nash , Conor Durkan

We present Causal Posterior Estimation (CPE), a novel method for Bayesian inference in simulator models, i.e., models where the evaluation of the likelihood function is intractable or too computationally expensive, but where one can…

Machine Learning · Computer Science 2025-05-28 Simon Dirmeier , Antonietta Mira

The estimation of rare event probabilities plays a pivotal role in diverse fields. Our aim is to determine the probability of a hazard or system failure occurring when a quantity of interest exceeds a critical value. In our approach, the…

Methodology · Statistics 2025-04-11 Lea Friedli , David Ginsbourger , Arnaud Doucet , Niklas Linde