English
Related papers

Related papers: Global optimization via inverse distance weighting…

200 papers

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

We present a reformulation of stochastic global optimization as a filtering problem. The motivation behind this reformulation comes from the fact that for many optimization problems we cannot evaluate exactly the objective function to be…

Numerical Analysis · Mathematics 2009-12-22 Panagiotis Stinis

Design optimization under uncertainty is notoriously difficult when the objective function is expensive to evaluate. State-of-the-art techniques, e.g, stochastic optimization or sampling average approximation, fail to learn exploitable…

Optimization and Control · Mathematics 2019-06-20 Piyush Pandita , Ilias Bilionis , Jitesh Panchal

This paper presents a practical method for finding the globally optimal solution to the sum-of-ratios problem arising in image processing, engineering and management. Unlike traditional methods which may get trapped in local minima due to…

Optimization and Control · Mathematics 2012-08-07 Yunchol Jong

Consider the problem of finding an optimal value of some objective functional subject to constraints over numerical domain. This type of problem arises frequently in practical engineering tasks. Nowdays almost all general methods for…

Optimization and Control · Mathematics 2019-09-13 Sergey Karpukhin

Multivariate adaptive regression splines (MARS) is a flexible statistical modeling method that has been popular for data mining applications. MARS has also been employed to approxmiate unknown relationships in optimzation for complex…

Optimization and Control · Mathematics 2020-06-30 Xinglong Ju , Jay M. Rosenberger , Victoria C. P. Chen , Feng Liu

This work demonstrates the utility of gradients for the global optimization of certain differentiable functions with many suboptimal local minima. To this end, a principle for generating search directions from non-local quadratic…

Optimization and Control · Mathematics 2023-08-21 Nils Müller

In this investigation, we propose several algorithms to recover the location and intensity of a radiation source located in a simulated 250 m x 180 m block in an urban center based on synthetic measurements. Radioactive decay and detection…

Applications · Statistics 2016-07-05 Razvan Stefanescu , Kathleen Schmidt , Jason Hite , Ralph Smith , John Mattingly

The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional…

Optimization and Control · Mathematics 2018-10-23 Mickaël Binois , David Ginsbourger , Olivier Roustant

The key idea of Bayesian optimization is replacing an expensive target function with a cheap surrogate model. By selection of an acquisition function for Bayesian optimization, we trade off between exploration and exploitation. The…

Machine Learning · Statistics 2019-02-20 Leonid Matyushin , Alexey Zaytsev , Oleg Alenkin , Andrey Ustuzhanin

Bayesian optimization (BO) is a global optimization strategy designed to find the minimum of an expensive black-box function, typically defined on a compact subset of $\mathcal{R}^d$, by using a Gaussian process (GP) as a surrogate model…

Machine Learning · Statistics 2018-09-24 Eero Siivola , Aki Vehtari , Jarno Vanhatalo , Javier González , Michael Riis Andersen

Bayesian Optimization has become the reference method for the global optimization of black box, expensive and possibly noisy functions. Bayesian Op-timization learns a probabilistic model about the objective function, usually a Gaussian…

Machine Learning · Statistics 2020-03-10 Antonio Candelieri , Ilaria Giordani , Riccardo Perego , Francesco Archetti

Gradient-based optimization is now ubiquitous across graphics, but unfortunately can not be applied to problems with undefined or zero gradients. To circumvent this issue, the loss function can be manually replaced by a ``surrogate'' that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Michael Fischer , Tobias Ritschel

We consider the problem of global optimization with noisy zeroth order oracles - a well-motivated problem useful for various applications ranging from hyper-parameter tuning for deep learning to new material design. Existing work relies on…

Machine Learning · Computer Science 2023-07-21 Chong Liu , Yu-Xiang Wang

A new technique of global optimization and its applications in particular to neural networks are presented. The algorithm is also compared to other global optimization algorithms such as Gradient descent (GD), Monte Carlo (MC), Genetic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-18 Homayoun Valafar , Okan K. Ersoy , Faramarz Valafar

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

Bayesian Optimization is an effective method for searching the global maxima of an objective function especially if the function is unknown. The process comprises of using a surrogate function and choosing an acquisition function followed…

Machine Learning · Computer Science 2021-11-10 Ashish Anil Pawar , Ujwal Warbhe

This paper introduces a numerical method to enclose the global minimum of a nonlinear function subject to simple bounds on the variables. Using interval analysis, coupled with the computational power and architecture of graphics processing…

Numerical Analysis · Mathematics 2026-04-15 Guanglu Zhang , Qihang Shan , Jonathan Cagan

This paper considers the efficient minimization of the infinite time average of a stationary ergodic process in the space of a handful of design parameters which affect it. Problems of this class, derived from physical or numerical…

Optimization and Control · Mathematics 2019-10-29 Pooriya Beyhaghi , Ryan Alimo , Thomas Bewley