English
Related papers

Related papers: Efficient global optimization of constrained mixed…

200 papers

The Quantum Approximate Optimization Algorithm (QAOA) has emerged as a promising variational quantum algorithm for addressing NP hard combinatorial optimization problems. However, a significant limitation lies in optimizing its classical…

Quantum Physics · Physics 2023-09-22 Peter Gleißner , Georg Kruse , Andreas Roßkopf

We consider the bound-constrained global optimization of functions with low effective dimensionality, that are constant along an (unknown) linear subspace and only vary over the effective (complement) subspace. We aim to implicitly explore…

Optimization and Control · Mathematics 2020-09-23 Coralia Cartis , Estelle Massart , Adilet Otemissov

This paper proposes and justifies two globally convergent Newton-type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are…

Optimization and Control · Mathematics 2023-04-27 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran

Standard Gaussian Process (GP) regression, a powerful machine learning tool, is computationally expensive when it is applied to large datasets, and potentially inaccurate when data points are sparsely distributed in a high-dimensional…

Machine Learning · Computer Science 2016-03-08 Z. Zhang , K. Duraisamy , N. A. Gumerov

This paper presents a novel stochastic gradient descent algorithm for constrained optimization. The proposed algorithm randomly samples constraints and components of the finite sum objective function and relies on a relaxed logarithmic…

Optimization and Control · Mathematics 2025-05-13 Naum Dimitrieski , Jing Cao , Christian Ebenbauer

Bayesian optimization (BO) is a powerful framework for optimizing expensive black-box objectives, yet extending it to graph-structured domains remains challenging due to the discrete and combinatorial nature of graphs. Existing approaches…

Machine Learning · Computer Science 2025-11-12 Shu Hong , Yongsheng Mei , Mahdi Imani , Tian Lan

Combinatorial optimization problems are ubiquitous in industry. In addition to finding a solution with minimum cost, problems of high relevance involve a number of constraints that the solution must satisfy. Variational quantum algorithms…

We propose a new globalization strategy that can be used in unconstrained optimization algorithms to support rapid convergence from remote starting points. Our approach is based on using multiple points at each iteration to build a…

Optimization and Control · Mathematics 2017-05-16 Figen Öztoprak , Ş. İlker Birbil

Gaussian processes regression models are an appealing machine learning method as they learn expressive non-linear models from exemplar data with minimal parameter tuning and estimate both the mean and covariance of unseen points. However,…

Machine Learning · Computer Science 2020-08-25 Vladimir Joukov , Dana Kulić

Many engineering problems involve the optimization of computationally expensive models for which derivative information is not readily available. The Bayesian optimization (BO) framework is a particularly promising approach for solving…

Optimization and Control · Mathematics 2022-02-10 Joel A. Paulson , Congwen Lu

We study the deterministic global optimization of trained Gaussian process posterior mean functions over hyperrectangular domains. Although the posterior mean function has a compact closed-form representation, its global optimization is…

Optimization and Control · Mathematics 2026-05-05 Wei-Ting Tang , Akshay Kudva , Calvin Tsay , Joel A. Paulson

Shortened abstract: Given a constrained minimization problem, under what conditions does there exist a related, unconstrained problem having the same minimum points? This basic question in global optimization motivates this paper, which…

Statistical Mechanics · Physics 2007-05-23 M. Costeniuc , R. S. Ellis , H. Touchette , B. Turkington

Adhesive joints are increasingly used in industry for a wide variety of applications because of their favorable characteristics such as high strength-to-weight ratio, design flexibility, limited stress concentrations, planar force transfer,…

In this paper, we present a distributed algorithm for solving convex, constraint-coupled, optimization problems over peer-to-peer networks. We consider a network of processors that aim to cooperatively minimize the sum of local cost…

Optimization and Control · Mathematics 2021-04-14 Andrea Camisa , Alessia Benevento , Giuseppe Notarstefano

We develop two adaptive discretization algorithms for convex semi-infinite optimization, which terminate after finitely many iterations at approximate solutions of arbitrary precision. In particular, they terminate at a feasible point of…

Optimization and Control · Mathematics 2022-01-14 Jochen Schmid , Miltiadis Poursanidis

High-dimensional black-box optimisation remains an important yet notoriously challenging problem. Despite the success of Bayesian optimisation methods on continuous domains, domains that are categorical, or that mix continuous and…

Machine Learning · Statistics 2021-06-11 Xingchen Wan , Vu Nguyen , Huong Ha , Binxin Ru , Cong Lu , Michael A. Osborne

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

A large-scale complex system comprising many, often spatially distributed, dynamical subsystems with partial autonomy and complex interactions are called system of systems. This paper describes an efficient algorithm for model predictive…

Optimization and Control · Mathematics 2019-04-25 Branimir Novoselnik , Vedrana Spudić , Mato Baotić

The ability to differentiate through optimization problems has unlocked numerous applications, from optimization-based layers in machine learning models to complex design problems formulated as bilevel programs. It has been shown that…

Optimization and Control · Mathematics 2024-03-05 Lucas Fuentes Valenzuela , Robin Brown , Marco Pavone

The characterization of nanostructued materials under reactive environments is challenging due to the complexity of the structural motifs involved and their chemical transformations. Global optimization approaches allow predicting stable…