English
Related papers

Related papers: Gradient-based Optimization for Bayesian Preferenc…

200 papers

Item recommendation task predicts a personalized ranking over a set of items for each individual user. One paradigm is the rating-based methods that concentrate on explicit feedbacks and hence face the difficulties in collecting them.…

Information Retrieval · Computer Science 2021-01-15 Guang-Neng Hu , Xin-Yu Dai

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

Scalable and effective exploration remains a key challenge in reinforcement learning (RL). While there are methods with optimality guarantees in the setting of discrete state and action spaces, these methods cannot be applied in…

Machine Learning · Computer Science 2017-01-30 Rein Houthooft , Xi Chen , Yan Duan , John Schulman , Filip De Turck , Pieter Abbeel

Trajectory planning for automated vehicles commonly employs optimization over a moving horizon - Model Predictive Control - where the cost function critically influences the resulting driving style. However, finding a suitable cost function…

Systems and Control · Electrical Eng. & Systems 2025-10-20 Lukas Theiner , Sebastian Hirt , Alexander Steinke , Rolf Findeisen

Allocating multiple scarce items across a set of individuals is an important practical problem. In the case of divisible goods and additive preferences a convex program can be used to find the solution that maximizes Nash welfare (MNW). The…

Computer Science and Game Theory · Computer Science 2019-09-25 Christian Kroer , Alexander Peysakhovich

Bayesian optimization has been successful at global optimization of expensive-to-evaluate multimodal objective functions. However, unlike most optimization methods, Bayesian optimization typically does not use derivative information. In…

Machine Learning · Statistics 2018-02-08 Jian Wu , Matthias Poloczek , Andrew Gordon Wilson , Peter I. Frazier

We study the multi-agent Bayesian optimization (BO) problem, where multiple agents maximize a black-box function via iterative queries. We focus on Entropy Search (ES), a sample-efficient BO algorithm that selects queries to maximize the…

Machine Learning · Computer Science 2023-03-13 Haitong Ma , Tianpeng Zhang , Yixuan Wu , Flavio P. Calmon , Na Li

We propose EVOlutionary Selector (EVOS), an efficient training paradigm for accelerating Implicit Neural Representation (INR). Unlike conventional INR training that feeds all samples through the neural network in each iteration, our…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Weixiang Zhang , Shuzhao Xie , Chengwei Ren , Siyi Xie , Chen Tang , Shijia Ge , Mingzi Wang , Zhi Wang

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Bilevel Optimization Programming is used to model complex and conflicting interactions between agents, for example in Robust AI or Privacy-preserving AI. Integrating bilevel mathematical programming within deep learning is thus an essential…

Machine Learning · Computer Science 2023-03-01 Francesco Alesiani

Designing evolutionary algorithms capable of uncovering highly evolvable representations is an open challenge; such evolvability is important because it accelerates evolution and enables fast adaptation to changing circumstances. This paper…

Neural and Evolutionary Computing · Computer Science 2019-07-16 Alexander Gajewski , Jeff Clune , Kenneth O. Stanley , Joel Lehman

Optimizing multiple competing objectives is a common problem across science and industry. The inherent inextricable trade-off between those objectives leads one to the task of exploring their Pareto front. A meaningful quantity for the…

Machine Learning · Computer Science 2023-10-24 Jim Boelrijk , Bernd Ensing , Patrick Forré

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

Machine Learning · Statistics 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional performance across a wide range of tasks, generating significant interest in their application to recommendation systems. However, existing methods have not…

Computation and Language · Computer Science 2025-04-28 Jieyong Kim , Hyunseo Kim , Hyunjin Cho , SeongKu Kang , Buru Chang , Jinyoung Yeo , Dongha Lee

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

Machine Learning · Statistics 2019-10-17 Valerio Perrone , Iaroslav Shcherbatyi , Rodolphe Jenatton , Cedric Archambeau , Matthias Seeger

Gradients have been exploited in proposal distributions to accelerate the convergence of Markov chain Monte Carlo algorithms on discrete distributions. However, these methods require a natural differentiable extension of the target discrete…

Machine Learning · Computer Science 2023-02-28 Yue Xiang , Dongyao Zhu , Bowen Lei , Dongkuan Xu , Ruqi Zhang

We deal with the efficient parallelization of Bayesian global optimization algorithms, and more specifically of those based on the expected improvement criterion and its variants. A closed form formula relying on multivariate Gaussian…

Machine Learning · Statistics 2016-09-12 Sébastien Marmin , Clément Chevalier , David Ginsbourger

Preference optimization has become a central paradigm for aligning large language models with human feedback. Direct Preference Optimization (DPO) simplifies reinforcement learning from human feedback by directly optimizing pairwise…

Machine Learning · Computer Science 2026-05-05 Inoussa Mouiche

Simulation-based inference (SBI) methods tackle complex scientific models with challenging inverse problems. However, SBI models often face a significant hurdle due to their non-differentiable nature, which hampers the use of gradient-based…

Machine Learning · Computer Science 2023-06-29 Vincent D. Zaballa , Elliot E. Hui

Adaptive gradient methods for stochastic optimization adjust the learning rate for each parameter locally. However, there is also a global learning rate which must be tuned in order to get the best performance. In this paper, we present a…

Machine Learning · Computer Science 2018-06-12 Hiroaki Hayashi , Jayanth Koushik , Graham Neubig