English
Related papers

Related papers: Surrogate-Guided Adaptive Importance Sampling for …

200 papers

The offline time of the reduced basis method can be very long given a large training set of parameter samples. This usually happens when the system has more than two independent parameters. On the other hand, if the training set includes…

Numerical Analysis · Mathematics 2023-04-04 Sridhar Chellappa , Lihong Feng , Peter Benner

Gaussian Process Latent Variable Models (GPLVMs) have become increasingly popular for unsupervised tasks such as dimensionality reduction and missing data recovery due to their flexibility and non-linear nature. An importance-weighted…

Machine Learning · Computer Science 2026-03-10 Jian Xu , Shian Du , Junmei Yang , Qianli Ma , Delu Zeng , John Paisley

Increased access to computing resources has led to the development of algorithms that can run efficiently on multi-core processing units or in distributed computing environments. In the context of Bayesian inference, many parallel computing…

Methodology · Statistics 2025-09-11 Daniel Würzler Barreto , Mevin B. Hooten

This paper introduces Adaptive Mixture Importance Sampling (AMIS) as a novel approach for optimizing key performance indicators (KPIs) in large-scale recommender systems, such as online ad auctions. Traditional importance sampling (IS)…

Machine Learning · Computer Science 2024-09-23 Yimeng Jia , Kaushal Paneri , Rong Huang , Kailash Singh Maurya , Pavan Mallapragada , Yifan Shi

In Bayesian optimization, Thompson sampling selects the evaluation point by sampling from the posterior distribution over the objective function maximizer. Because this sampling problem is intractable for Gaussian process (GP) surrogates,…

Machine Learning · Computer Science 2026-04-13 Donney Fan , Geoff Pleiss

Sequential importance sampling algorithms have been defined to estimate likelihoods in models of ancestral population processes. However, these algorithms are based on features of the models with constant population size, and become…

Statistics Theory · Mathematics 2016-03-24 Coralie Merle , Raphaël Leblois , François Rousset , Pierre Pudlo

An important step in the design of autonomous systems is to evaluate the probability that a failure will occur. In safety-critical domains, the failure probability is extremely small so that the evaluation of a policy through Monte Carlo…

Machine Learning · Computer Science 2022-11-23 Anthony Corso , Kyu-Young Kim , Shubh Gupta , Grace Gao , Mykel J. Kochenderfer

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

In the field of reliability engineering, the Active learning reliability method combining Kriging and Monte Carlo Simulation (AK-MCS) has been developed and demonstrated to be effective in reliability analysis. However, the performance of…

Computational Engineering, Finance, and Science · Computer Science 2025-05-20 Wenxiong Li , Rong Geng , Suiyin Chen

The pairwise objective paradigms are an important and essential aspect of machine learning. Examples of machine learning approaches that use pairwise objective functions include differential network in face recognition, metric learning,…

Machine Learning · Computer Science 2022-10-04 Hilal AlQuabeh , Aliakbar Abdurahimov

Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the…

Machine Learning · Statistics 2021-07-01 Ghassen Jerfel , Serena Wang , Clara Fannjiang , Katherine A. Heller , Yian Ma , Michael I. Jordan

Estimating the parameters of compact binaries which coalesce and produce gravitational waves is a challenging Bayesian inverse problem. Gravitational-wave parameter estimation lies within the class of multifidelity problems, where a variety…

General Relativity and Quantum Cosmology · Physics 2024-05-31 Bassel Saleh , Aaron Zimmerman , Peng Chen , Omar Ghattas

The Integrated Nested Laplace Approximation (INLA) is a deterministic approach to Bayesian inference on latent Gaussian models (LGMs) and focuses on fast and accurate approximation of posterior marginals for the parameters in the models.…

Computation · Statistics 2021-03-05 Martin Outzen Berild , Sara Martino , Virgilio Gómez-Rubio , Håvard Rue

This work proposes an adaptive sequential Monte Carlo sampling algorithm to solve Bayesian inverse problems in scenarios where likelihood evaluations are costly but can be approximated using a surrogate model built from previous evaluations…

Computation · Statistics 2025-08-26 Frederic Cerou , Patrick Heas , Mathias Rousset

Model fitting is possibly the most extended problem in science. Classical approaches include the use of least-squares fitting procedures and maximum likelihood methods to estimate the value of the parameters in the model. However, in recent…

Instrumentation and Methods for Astrophysics · Physics 2022-04-12 J. Lopez-Santiago , L. Martino , J. Miguez , M. A. Vazquez

We propose a new sampling algorithm combining two quite powerful ideas in the Markov chain Monte Carlo literature -- adaptive Metropolis sampler and two-stage Metropolis-Hastings sampler. The proposed sampling method will be particularly…

Computation · Statistics 2021-01-05 Anirban Mondal , Kai Yin , Abhijit Mandal

We propose an algorithm for an optimal adaptive selection of points from the design domain of input random variables that are needed for an accurate estimation of failure probability and the determination of the boundary between safe and…

Computational Engineering, Finance, and Science · Computer Science 2023-06-30 Aleksei Gerasimov , Miroslav Vořechovský

Reliability-oriented sensitivity analysis aims at combining both reliability and sensitivity analyses by quantifying the influence of each input variable of a numerical model on a quantity of interest related to its failure. In particular,…

Statistics Theory · Mathematics 2022-10-25 Julien Demange-Chryst , François Bachoc , Jérôme Morio

We propose an estimation procedure for linear functionals based on Gaussian model selection techniques. We show that the procedure is adaptive, and we give a non asymptotic oracle inequality for the risk of the selected estimator with…

Statistics Theory · Mathematics 2008-10-27 Béatrice Laurent , Carenne Ludeña , Clémentine Prieur

Piecewise deterministic Markov processes (PDMPs) can be used to model complex dynamical industrial systems. The counterpart of this modeling capability is their simulation cost, which makes reliability assessment untractable with standard…

Computation · Statistics 2023-06-08 Guillaume Chennetier , Hassane Chraibi , Anne Dutfoy , Josselin Garnier