English
Related papers

Related papers: Variational inference via Gaussian interacting par…

200 papers

We study linear models under heavy-tailed priors from a probabilistic viewpoint. Instead of computing a single sparse most probable (MAP) solution as in standard deterministic approaches, the focus in the Bayesian compressed sensing…

Computer Vision and Pattern Recognition · Computer Science 2014-03-05 George Papandreou , Alan Yuille

Gaussian mixture models (GMM) are powerful parametric tools with many applications in machine learning and computer vision. Expectation maximization (EM) is the most popular algorithm for estimating the GMM parameters. However, EM…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Soheil Kolouri , Gustavo K. Rohde , Heiko Hoffmann

We introduce an iterative method to search for time-optimal Hamiltonians that drive a quantum system between two arbitrary, and in general mixed, quantum states. The method is based on the idea of progressively improving the efficiency of…

Quantum Physics · Physics 2019-12-25 Francesco Campaioli , William Sloan , Kavan Modi , Felix Alexander Pollock

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

Optimization and Control · Mathematics 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

Optimization and Control · Mathematics 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

We consider stochastic systems of interacting particles or agents, with dynamics determined by an interaction kernel which only depends on pairwise distances. We study the problem of inferring this interaction kernel from observations of…

Statistics Theory · Mathematics 2020-07-31 Fei Lu , Mauro Maggioni , Sui Tang

Local Bayesian optimization is a promising practical approach to solve the high dimensional black-box function optimization problem. Among them is the approximated gradient class of methods, which implements a strategy similar to gradient…

Machine Learning · Computer Science 2024-05-27 Zheyi Fan , Wenyu Wang , Szu Hui Ng , Qingpei Hu

Experimental design is central to science and engineering. A ubiquitous challenge is how to maximize the value of information obtained from expensive or constrained experimental settings. Bayesian optimal experimental design (OED) provides…

Methodology · Statistics 2026-02-13 Sofia Mäkinen , Andrew B. Duncan , Tapio Helin

The sliced Wasserstein distance (SW) reduces optimal transport on $\mathbb{R}^d$ to a sum of one-dimensional projections, and thanks to this efficiency, it is widely used in geometry, generative modeling, and registration tasks. Recent work…

Machine Learning · Computer Science 2025-09-24 Manish Acharya , David Hyde

We demonstrate an efficient algorithm for inverse problems in time-dependent quantum dynamics based on feedback loops between Hamiltonian parameters and the solutions of the Schr\"{o}dinger equation. Our approach formulates the inverse…

Computational Physics · Physics 2020-10-27 Z. Deng , I. Tutunnikov , I. Sh. Averbukh , M. Thachuk , R. V. Krems

Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been…

Optimization and Control · Mathematics 2025-04-04 Stefania Bellavia , Greta Malaspina

Stochastic spectral methods have achieved great success in the uncertainty quantification of many engineering problems, including electronic and photonic integrated circuits influenced by fabrication process variations. Existing techniques…

Numerical Analysis · Mathematics 2018-12-06 Chunfeng Cui , Zheng Zhang

Many numerical and learning algorithms rely on the solution of the Monge-Kantorovich problem and Wasserstein distances, which provide appropriate distributional metrics. While the natural approach is to treat the problem as an…

Optimization and Control · Mathematics 2025-12-11 Mohsen Sadr , Peyman Mohajerin Esfahani , Hossein Gorji

A natural way to quantify uncertainties in Gaussian mixture models (GMMs) is through Bayesian methods. That said, sampling from the joint posterior distribution of GMMs via standard Markov chain Monte Carlo (MCMC) imposes several…

Methodology · Statistics 2024-05-20 Santiago Marin , Bronwyn Loong , Anton H. Westveld

Although Bayesian Optimization (BO) has been employed for accelerating materials design in computational materials engineering, existing works are restricted to problems with quantitative variables. However, real designs of materials…

Machine Learning · Statistics 2019-10-07 Yichi Zhang , Daniel Apley , Wei Chen

A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much…

Methodology · Statistics 2021-06-29 Haim Bar , James Booth , Martin T. Wells

In this paper we study consensus-based optimization (CBO), a versatile, flexible and customizable optimization method suitable for performing nonconvex and nonsmooth global optimizations in high dimensions. CBO is a multi-particle…

Numerical Analysis · Mathematics 2026-05-28 Konstantin Riedl

Solving optimisation problems is a promising near-term application of quantum computers. Quantum variational algorithms leverage quantum superposition and entanglement to optimise over exponentially large solution spaces using an…

Quantum Physics · Physics 2022-10-13 Edric Matwiejew , Jason Pye , Jingbo B. Wang

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

Complex system design problems, such as those involved in aerospace engineering, require the use of numerically costly simulation codes in order to predict the performance of the system to be designed. In this context, these codes are often…

Optimization and Control · Mathematics 2024-02-14 Loic Brevault , Mathieu Balesdent