English
Related papers

Related papers: Observable dictionary learning for high-dimensiona…

200 papers

We describe a simple method for making inference on a functional of a multivariate distribution. The method is based on a copula representation of the multivariate distribution and it is based on the properties of an Approximate Bayesian…

Methodology · Statistics 2017-07-18 Clara Grazian , Brunero Liseo

Mutual information is widely used, in a descriptive way, to measure the stochastic dependence of categorical random variables. In order to address questions such as the reliability of the descriptive value, one must consider…

Machine Learning · Computer Science 2007-07-13 Marcus Hutter , Marco Zaffalon

A machine-learning-based framework for constructing generator-level observables optimized for parameter extraction in particle physics analyses is introduced, referred to as the Optimal Observable Machine (OOM). Unfoldable differential…

We consider the problem of weakly supervised object detection, where the training samples are annotated using only image-level labels that indicate the presence or absence of an object category. In order to model the uncertainty in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Aditya Arun , C. V. Jawahar , M. Pawan Kumar

In this work we consider the problem of approximating the statistics of a given Quantity of Interest (QoI) that depends on the solution of a linear elliptic PDE defined over a random domain parameterized by $N$ random variables. The random…

Numerical Analysis · Mathematics 2023-11-21 Julio E. Castrillon-Candas , Fabio Nobile , Raul F. Tempone

We introduce a simple and intuitive framework that provides quantitative explanations of statistical models through the probabilistic assessment of input feature importance. The core idea comes from utilizing the Dirichlet distribution to…

Machine Learning · Statistics 2022-09-20 Kamil Adamczewski , Frederik Harder , Mijung Park

Existing frameworks for probabilistic inference assume the quantity of interest is the parameter of a posited statistical model. In machine learning applications, however, often there is no statistical model/parameter; the quantity of…

Statistics Theory · Mathematics 2022-11-22 Leonardo Cella , Ryan Martin

Influence diagnosis is important since presence of influential observations could lead to distorted analysis and misleading interpretations. For high-dimensional data, it is particularly so, as the increased dimensionality and complexity…

Statistics Theory · Mathematics 2013-11-27 Junlong Zhao , Chenlei Leng , Lexin Li , Hansheng Wang

Question answering (QA) models are well-known to exploit data bias, e.g., the language prior in visual QA and the position bias in reading comprehension. Recent debiasing methods achieve good out-of-distribution (OOD) generalizability with…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yulei Niu , Hanwang Zhang

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

Machine Learning · Statistics 2020-11-30 Junhao Hua , Chunguang Li

We propose a quantum multi-level estimation framework for a functional $\sum_{i=1}^n f(p_i)$ of a discrete distribution $(p_i)_{i=1}^n$. We partition the values $p_i$ into logarithmically many intervals whose length decays exponentially.…

Quantum Physics · Physics 2026-05-06 Kean Chen , Minbo Gao , Tongyang Li , Qisheng Wang , Xinzhao Wang

Classical a posteriori error analysis for differential equations quantifies the error in a Quantity of Interest (QoI) which is represented as a bounded linear functional of the solution. In this work we consider a posteriori error estimates…

Numerical Analysis · Mathematics 2020-07-07 Jehanzeb H. Chaudhry , Donald Estep , Zachary Stevens , Simon J. Tavener

Recent decades have seen an interest in prediction problems for which Bayesian methodology has been used ubiquitously. Sampling from or approximating the posterior predictive distribution in a Bayesian model allows one to make inferential…

Machine Learning · Statistics 2017-09-12 Giri Gopalan

In Generalised Bayesian Inference (GBI), the learning rate and hyperparameters of the loss must be estimated. These inference-hyperparameters can't be estimated jointly with the other parameters, from the data, by giving them a prior.…

Methodology · Statistics 2026-05-18 Jeong Eun Lee , Sitong Liu , Geoff K. Nicholls

As machine learning models grow increasingly competent, their predictions can supplement scarce or expensive data in various important domains. In support of this paradigm, algorithms have emerged to combine a small amount of high-fidelity…

Machine Learning · Computer Science 2025-07-08 Zhun Deng , Thomas P Zollo , Benjamin Eyre , Amogh Inamdar , David Madras , Richard Zemel

We propose a method to approximate the distribution of robot configurations satisfying multiple objectives. Our approach uses variational inference, a popular method in Bayesian computation, which has several advantages over sampling-based…

Robotics · Computer Science 2019-11-25 Emmanuel Pignat , Teguh Lembono , Sylvain Calinon

We design efficient distance approximation algorithms for several classes of structured high-dimensional distributions. Specifically, we show algorithms for the following problems: - Given sample access to two Bayesian networks $P_1$ and…

Data Structures and Algorithms · Computer Science 2020-02-17 Arnab Bhattacharyya , Sutanu Gayen , Kuldeep S. Meel , N. V. Vinodchandran

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter