English
Related papers

Related papers: Variational inference via Gaussian interacting par…

200 papers

We propose a new variational inference algorithm for learning in Gaussian Process State-Space Models (GPSSMs). Our algorithm enables learning of unstable and partially observable systems, where previous algorithms fail. Our main algorithmic…

Machine Learning · Computer Science 2020-06-11 Silvan Melchior , Sebastian Curi , Felix Berkenkamp , Andreas Krause

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

We propose a general purpose variational inference algorithm that forms a natural counterpart of gradient descent for optimization. Our method iteratively transports a set of particles to match the target distribution, by applying a form of…

Machine Learning · Statistics 2019-09-10 Qiang Liu , Dilin Wang

We study first order methods to compute the barycenter of a probability distribution $P$ over the space of probability measures with finite second moment. We develop a framework to derive global rates of convergence for both gradient…

Statistics Theory · Mathematics 2020-06-16 Sinho Chewi , Tyler Maunu , Philippe Rigollet , Austin J. Stromme

Optimal transport and Wasserstein distances are flourishing in many scientific fields as a means for comparing and connecting random structures. Here we pioneer the use of an optimal transport distance between L\'{e}vy measures to solve a…

Statistics Theory · Mathematics 2023-09-18 Marta Catalano , Hugo Lavenant , Antonio Lijoi , Igor Prünster

We study the problem of causal discovery through targeted interventions. Starting from few observational measurements, we follow a Bayesian active learning approach to perform those experiments which, in expectation with respect to the…

Machine Learning · Statistics 2019-10-10 Julius von Kügelgen , Paul K Rubenstein , Bernhard Schölkopf , Adrian Weller

Bayesian optimization is a popular formalism for global optimization, but its computational costs limit it to expensive-to-evaluate functions. A competing, computationally more efficient, global optimization framework is optimistic…

Machine Learning · Computer Science 2022-09-05 Julia Grosse , Cheng Zhang , Philipp Hennig

Designing a fast and efficient optimization method with local optima avoidance capability on a variety of optimization problems is still an open problem for many researchers. In this work, the concept of a new global optimization method…

Neural and Evolutionary Computing · Computer Science 2012-08-13 Fereydoun Farrahi Moghaddam , Reza Farrahi Moghaddam , Mohamed Cheriet

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

Machine Learning · Computer Science 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen

One of the fundamental tasks of science is to find explainable relationships between observed phenomena. One approach to this task that has received attention in recent years is based on probabilistic graphical modelling with sparsity…

Machine Learning · Statistics 2014-04-16 Peter Orchard , Felix Agakov , Amos Storkey

Binary optimization is a fundamental area in computational science, with wide-ranging applications from logistics to cryptography, where the tasks are often formulated as Quadratic or Polynomial Unconstrained Binary Optimization problems…

Quantum Physics · Physics 2024-12-20 Jean Cazalis , Tirth Shah , Yahui Chai , Karl Jansen , Stefan Kühn

We have previously reported a Bayesian algorithm for determining the coordinates of points in three-dimensional space from uncertain constraints. This method is useful in the determination of biological molecular structure. It is limited,…

Artificial Intelligence · Computer Science 2013-02-28 Russ B. Altman , Cheng C. Chen , William B. Poland , Jaswinder Pal Singh

The detection and estimation of gravitational wave (GW) signals belonging to a parameterized family of waveforms requires, in general, the numerical maximization of a data-dependent function of the signal parameters. Due to noise in the…

General Relativity and Quantum Cosmology · Physics 2010-04-21 Yan Wang , Soumya D. Mohanty

We introduce a practical method for incorporating equality and inequality constraints in global optimization methods based on stochastic interacting particle systems, specifically consensus-based optimization (CBO) and ensemble Kalman…

Optimization and Control · Mathematics 2021-11-05 J. A. Carrillo , C. Totzeck , U. Vaes

This works extends the Random Embedding Bayesian Optimization approach by integrating a warping of the high dimensional subspace within the covariance kernel. The proposed warping, that relies on elementary geometric considerations, allows…

Optimization and Control · Mathematics 2015-03-19 Mickaël Binois , David Ginsbourger , Olivier Roustant

Bayesian optimisation (BO) is a powerful framework for global optimisation of costly functions, using predictions from Gaussian process models (GPs). In this work, we apply BO to functions that exhibit invariance to a known group of…

Machine Learning · Computer Science 2024-10-23 Theodore Brown , Alexandru Cioba , Ilija Bogunovic

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

Machine Learning · Computer Science 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations. The key…

Machine Learning · Statistics 2015-09-08 David A. Knowles

The Gromov-Wasserstein (GW) problem, a variant of the classical optimal transport (OT) problem, has attracted growing interest in the machine learning and data science communities due to its ability to quantify similarity between measures…

Machine Learning · Computer Science 2025-03-25 Yikun Bai , Abihith Kothapalli , Hengrong Du , Rocio Diaz Martin , Soheil Kolouri