English
Related papers

Related papers: Operator Calculus for Information Field Theory

200 papers

The Bayesian approach to machine learning amounts to computing posterior distributions of random variables from a probabilistic model of how the variables are related (that is, a prior distribution) and a set of observations of variables.…

Logic in Computer Science · Computer Science 2015-07-01 Johannes Borgström , Andrew D Gordon , Michael Greenberg , James Margetson , Jurgen Van Gael

Quantum estimation theory is a reformulation of random statistical theory with the modern language of quantum mechanics. In fact, the density operator plays a role similar to that of probability distribution functions in classical…

Quantum Physics · Physics 2022-11-15 Bakmou Lahcen , Daoud Mohammed

An integration by parts formula is derived for the first order differential operator corresponding to the action of translations on the space of locally finite simple configurations of infinitely many points on R^d. As reference measures,…

Mathematical Physics · Physics 2011-03-31 Florian Conrad , Tobias Kuna

There has been much recent interest in modifying Bayesian inference for misspecified models so that it is useful for specific purposes. One popular modified Bayesian inference method is "cutting feedback" which can be used when the model…

Performing inference in Bayesian models requires sampling algorithms to draw samples from the posterior. This becomes prohibitively expensive as the size of data sets increase. Constructing approximations to the posterior which are cheap to…

Statistics Theory · Mathematics 2023-04-19 George Wynne

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

Machine Learning · Computer Science 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

Recently, there has been rising interest in Bayesian optimization -- the optimization of an unknown function with assumptions usually expressed by a Gaussian Process (GP) prior. We study an optimization strategy that directly uses an…

Machine Learning · Statistics 2018-08-14 Zi Wang , Bolei Zhou , Stefanie Jegelka

We introduce priors and algorithms to perform Bayesian inference in Gaussian models defined by acyclic directed mixed graphs. Such a class of graphs, composed of directed and bi-directed edges, is a representation of conditional…

Methodology · Statistics 2012-07-02 Ricardo Silva , Zoubin Ghahramani

A systematic replica field theory calculations are analysed using the examples of two particular one-dimensional "toy" random models with Gaussian disorder. Due to apparent simplicity of the model the replica trick calculations can be…

Statistical Mechanics · Physics 2010-10-20 Victor Dotsenko

Bayesian probabilistic numerical methods are a set of tools providing posterior distributions on the output of numerical methods. The use of these methods is usually motivated by the fact that they can represent our uncertainty due to…

Computation · Statistics 2018-08-01 Xiaoyue Xi , François-Xavier Briol , Mark Girolami

In this paper we take a look at Automatic Differentiation through the eyes of Tensor and Operational Calculus. This work is best consumed as supplementary material for learning tensor and operational calculus by those already familiar with…

Symbolic Computation · Computer Science 2018-09-03 Žiga Sajovic

The study of neural operators has paved the way for the development of efficient approaches for solving partial differential equations (PDEs) compared with traditional methods. However, most of the existing neural operators lack the…

Machine Learning · Statistics 2024-04-25 Sawan Kumar , Rajdip Nayek , Souvik Chakraborty

Practically and intrinsically, inclusions of operator algebras are of fundamental interest. The subject of this paper is intermediate operator algebras of inclusions. There are two previously known theorems which naturally and completely…

Operator Algebras · Mathematics 2020-04-16 Yuhei Suzuki

We propose an efficient transfer Bayesian optimization method, which finds the maximum of an expensive-to-evaluate black-box function by using data on related optimization tasks. Our method uses auxiliary information that represents the…

Machine Learning · Statistics 2019-09-18 Tomoharu Iwata , Takuma Otsuka

The free expansion of a Gaussian wavepacket is a problem commonly discussed in undergraduate quantum classes by directly solving the time-dependent Schrodinger equation as a differential equation. In this work, we provide an alternative way…

Quantum Physics · Physics 2023-06-07 Alessandro M. Orjuela , J. K. Freericks

Scientists often express their understanding of the world through a computationally demanding simulation program. Analyzing the posterior distribution of the parameters given observations (the inverse problem) can be extremely challenging.…

Machine Learning · Computer Science 2014-01-14 Edward Meeds , Max Welling

In this paper we consider Bayesian estimation for the parameters of inverse Gaussian distribution. Our emphasis is on Markov Chain Monte Carlo methods. We provide complete implementation of the Gibbs sampler algorithm. Assuming an…

Methodology · Statistics 2012-10-17 B. N. Pandey , Pulastya Bandyopadhyay

Bayesian filtering is a general framework for recursively estimating the state of a dynamical system. Classical solutions such that Kalman filter and Particle filter are introduced in this report. Gaussian processes have been introduced as…

Information Theory · Computer Science 2010-11-04 Mr. Chong Han , Dr. Ido Nevat , Dr. Gareth Peters , Prof. Jinhong Yuan

In this work we present a theoretical model for differentiable programming. We construct an algebraic language that encapsulates formal semantics of differentiable programs by way of Operational Calculus. The algebraic nature of Operational…

Formal Languages and Automata Theory · Computer Science 2019-01-08 Žiga Sajovic , Martin Vuk

This paper introduces a new method for performing computational inference on log-Gaussian Cox processes. The likelihood is approximated directly by making novel use of a continuously specified Gaussian random field. We show that for…

Computation · Statistics 2015-11-02 Daniel Simpson , Janine Illian , Finn Lindgren , Sigrunn Sørbye , Håvard Rue