English
Related papers

Related papers: A Data-Driven Bayesian Nonparametric Approach for …

200 papers

In performative stochastic optimization, decisions can influence the distribution of random parameters, rendering the data-generating process itself decision-dependent. In practice, decision-makers rarely have access to the true…

Optimization and Control · Mathematics 2025-10-27 Zhuangzhuang Jia , Yijie Wang , Roy Dong , Grani A. Hanasusanto

Many black-box optimization tasks arising in high-stakes applications require risk-averse decisions. The standard Bayesian optimization (BO) paradigm, however, optimizes the expected value only. We generalize BO to trade mean and…

Machine Learning · Computer Science 2021-11-10 Anastasiia Makarova , Ilnura Usmanova , Ilija Bogunovic , Andreas Krause

Bayesian Optimization (BO) is a popular framework for optimizing black-box functions. Despite its effectiveness, BO is often inefficient for high-dimensional problems due to the exponential growth of the search space, heterogeneity of the…

Optimization and Control · Mathematics 2026-05-08 Sourav Das , Debjani Chakraborty , Pabitra Mitra

This paper studies the challenging black-box adversarial attack that aims to generate adversarial examples against a black-box model by only using output feedback of the model to input queries. Some previous methods improve the query…

Machine Learning · Computer Science 2024-05-30 Shuyu Cheng , Yibo Miao , Yinpeng Dong , Xiao Yang , Xiao-Shan Gao , Jun Zhu

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

Machine Learning · Statistics 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Inverse optimization (IO) is used to estimate unknown parameters of an optimization model from observed decisions. In the data-driven context, the estimated parameters are inherently uncertain, yet quantifying this uncertainty has received…

Optimization and Control · Mathematics 2026-05-26 Timothy C. Y. Chan , Nathan Sandholtz , Nasrin Yousefi

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

Optimization and Control · Mathematics 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

This paper reviews the state-of-the-art model-based adaptive sampling approaches for single-objective black-box optimization (BBO). While BBO literature includes various promising sampling techniques, there is still a lack of comprehensive…

Optimization and Control · Mathematics 2022-04-25 Nazanin Nezami , Hadis Anahideh

This paper presents a distributed algorithm applicable to a wide range of practical multi-robot applications. In such multi-robot applications, the user-defined objectives of the mission can be cast as a general optimization problem,…

Robotics · Computer Science 2021-12-28 Athanasios Ch. Kapoutsis , Savvas A. Chatzichristofis , Elias B. Kosmatopoulos

This paper studies the distributed optimization problem with possibly nonidentical local constraints, where its global objective function is composed of $N$ convex functions. The aim is to solve the considered optimization problem in a…

Optimization and Control · Mathematics 2022-08-26 Hongzhe Liu , Wenwu Yu , Guanghui Wen , Wei Xing Zheng

Bayesian optimization (BO) is a widely used algorithm for solving expensive black-box optimization problems. However, its performance decreases significantly on high-dimensional problems due to the inherent high-dimensionality of the…

Machine Learning · Computer Science 2025-04-16 Jundi Huang , Dawei Zhan

Bayesian optimization (BO ) is an effective method for optimizing expensive-to-evaluate black-box functions. While high-dimensional problems can be particularly challenging, due to the multitude of parameter choices and the potentially high…

Machine Learning · Computer Science 2025-04-09 Erik Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

This work concerns the evolutionary approaches to distributed stochastic black-box optimization, in which each worker can individually solve an approximation of the problem with nature-inspired algorithms. We propose a distributed evolution…

Neural and Evolutionary Computing · Computer Science 2022-04-12 Xiaoyu He , Zibin Zheng , Chuan Chen , Yuren Zhou , Chuan Luo , Qingwei Lin

Learning decompositions of expensive-to-evaluate black-box functions promises to scale Bayesian optimisation (BO) to high-dimensional problems. However, the success of these techniques depends on finding proper decompositions that…

Machine Learning · Computer Science 2023-05-30 Juliusz Ziomek , Haitham Bou-Ammar

A novel distributed algorithm is proposed for finite-time converging to a feasible consensus solution satisfying global optimality to a certain accuracy of the distributed robust convex optimization problem (DRCO) subject to bounded…

Optimization and Control · Mathematics 2023-09-06 Xunhao Wu , Jun Fu

Bayesian optimization (BO) methods choose sample points by optimizing an acquisition function derived from a statistical model of the objective. These acquisition functions are chosen to balance sampling regions with predicted good…

Machine Learning · Computer Science 2024-08-16 Darian Nwankwo , David Bindel

Bayesian Optimization has become the reference method for the global optimization of black box, expensive and possibly noisy functions. Bayesian Op-timization learns a probabilistic model about the objective function, usually a Gaussian…

Machine Learning · Statistics 2020-03-10 Antonio Candelieri , Ilaria Giordani , Riccardo Perego , Francesco Archetti

This work addresses data-driven inverse optimization (IO), where the goal is to estimate unknown parameters in an optimization model from observed decisions that can be assumed to be optimal or near-optimal solutions to the optimization…

Optimization and Control · Mathematics 2024-05-29 Yen-An Lu , Wei-Shou Hu , Joel A. Paulson , Qi Zhang

We introduce a novel alignment method for diffusion models from distribution optimization perspectives while providing rigorous convergence guarantees. We first formulate the problem as a generic regularized loss minimization over…

Machine Learning · Computer Science 2025-03-07 Ryotaro Kawata , Kazusato Oko , Atsushi Nitanda , Taiji Suzuki