English
Related papers

Related papers: Sample-Efficient Optimisation over the Outputs of …

200 papers

Protein function relies on dynamic conformational ensembles, yet current generative models like AlphaFold3 often fail to produce ensembles that match experimental data. Recent experiment-guided generators attempt to address this by steering…

The optimization of expensive black-box functions is ubiquitous in science and engineering. A common solution to this problem is Bayesian optimization (BO), which is generally comprised of two components: (i) a surrogate model and (ii) an…

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

Global optimization of expensive, derivative-free black-box functions requires extreme sample efficiency. While Bayesian optimization (BO) is the current state-of-the-art, its performance hinges on surrogate and acquisition function…

This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand…

Machine Learning · Computer Science 2024-04-04 Diego Botache , Jens Decke , Winfried Ripken , Abhinay Dornipati , Franz Götz-Hahn , Mohamed Ayeb , Bernhard Sick

Bayesian optimization is an effective method for solving expensive black-box optimization problems. Most existing methods use Gaussian processes (GP) as the surrogate model for approximating the black-box objective function, it is…

Machine Learning · Computer Science 2025-12-23 Wei Peng , Jianchen Hu , Kang Liu , Qiaozhu Zhai

Most current sampling algorithms for high-dimensional distributions are based on MCMC techniques and are approximate in the sense that they are valid only asymptotically. Rejection sampling, on the other hand, produces valid samples, but is…

Artificial Intelligence · Computer Science 2012-07-04 Marc Dymetman , Guillaume Bouchard , Simon Carter

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

Recent studies suggest utilizing generative models instead of traditional auto-regressive algorithms for time series forecasting (TSF) tasks. These non-auto-regressive approaches involving different generative methods, including GAN,…

Machine Learning · Computer Science 2025-03-19 Jiangxuan Long , Zhao Song , Chiwun Yang

Explainable AI is a crucial component for edge services, as it ensures reliable decision making based on complex AI models. Surrogate models are a prominent approach of XAI where human-interpretable models, such as a linear regression…

Machine Learning · Computer Science 2025-03-12 Foivos Charalampakos , Thomas Tsouparopoulos , Iordanis Koutsopoulos

Surrogate model can replace the parametric full-order model (FOM) by an approximation model, which can significantly improve the efficiency of optimization design and reduce the complexity of engineering systems. However, due to limitations…

Fluid Dynamics · Physics 2025-03-18 Xu Wang , Ruiqi Huang , Jiaqing Kou , Hui Tang , Weiwei Zhang

Flow-matching models have recently emerged as a powerful framework for continuous generative modeling, including 3D point cloud synthesis. However, their deployment is limited by the need for multiple sequential sampling steps at inference…

Machine Learning · Computer Science 2026-03-20 Elaheh Akbari , Shansita Sharma , Ping He , Ahmadreza Moradipari , Kyungtae Han , Hamed Pirsiavash , Yikun Bai , Soheil Kolouri

Sampling from generative models has become a crucial tool for applications like data synthesis and augmentation. Diffusion, Flow Matching and Continuous Normalising Flows have shown effectiveness across various modalities, and rely on…

Machine Learning · Statistics 2025-11-10 Erik Bodin , Alexandru Stere , Dragos D. Margineantu , Carl Henrik Ek , Henry Moss

We study the problem of training diffusion and flow generative models to sample from target distributions defined by an exponential tilting of a base density; a formulation that subsumes both sampling from unnormalized densities and reward…

Machine Learning · Statistics 2026-05-04 Carles Domingo-Enrich , Yuanqi Du , Michael S. Albergo

Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high computational demands. To tackle these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Yixiao Wang , Chen Tang , Lingfeng Sun , Simone Rossi , Yichen Xie , Chensheng Peng , Thomas Hannagan , Stefano Sabatini , Nicola Poerio , Masayoshi Tomizuka , Wei Zhan

Offline model-based optimization seeks to optimize against a learned surrogate model without querying the true oracle objective function during optimization. Such tasks are commonly encountered in protein design, robotics, and clinical…

Machine Learning · Computer Science 2024-09-27 Michael S. Yao , Yimeng Zeng , Hamsa Bastani , Jacob Gardner , James C. Gee , Osbert Bastani

Bayesian Optimization (BO) is a powerful method for optimizing black-box functions by combining prior knowledge with ongoing function evaluations. BO constructs a probabilistic surrogate model of the objective function given the covariates,…

Machine Learning · Statistics 2025-08-26 Roi Naveiro , Becky Tang

Diffusion models have recently driven significant breakthroughs in generative modeling. While state-of-the-art models produce high-quality samples on average, individual samples can still be low quality. Detecting such samples without human…

Machine Learning · Computer Science 2025-06-13 Metod Jazbec , Eliot Wong-Toi , Guoxuan Xia , Dan Zhang , Eric Nalisnick , Stephan Mandt
‹ Prev 1 3 4 5 6 7 10 Next ›