中文
相关论文

相关论文: Escaping local minima with derivative-free methods…

200 篇论文

Local Bayesian optimization is a promising practical approach to solve the high dimensional black-box function optimization problem. Among them is the approximated gradient class of methods, which implements a strategy similar to gradient…

机器学习 · 计算机科学 2024-05-27 Zheyi Fan , Wenyu Wang , Szu Hui Ng , Qingpei Hu

In this paper, we propose a new non-monotone line-search method for smooth unconstrained optimization problems with objective functions that have many non-global local minimizers. The method is based on a relaxed Armijo condition that…

最优化与控制 · 数学 2025-02-27 Zohreh Aminifard , Geovani Nunes Grapiglia

This paper deals with the identification of linear stochastic dynamical systems, where the unknowns include system coefficients and noise variances. Conventional approaches that rely on the maximum likelihood estimation (MLE) require…

机器学习 · 统计学 2025-08-18 Jinwen Xu , Qin Lu , Yaakov Bar-Shalom

Bayesian optimisation (BO) has been a successful approach to optimise functions which are expensive to evaluate and whose observations are noisy. Classical BO algorithms, however, do not account for errors about the location where…

机器学习 · 计算机科学 2019-02-22 Rafael Oliveira , Lionel Ott , Fabio Ramos

We present GLASSES: Global optimisation with Look-Ahead through Stochastic Simulation and Expected-loss Search. The majority of global optimisation approaches in use are myopic, in only considering the impact of the next function value; the…

机器学习 · 统计学 2015-10-22 Javier González , Michael Osborne , Neil D. Lawrence

Model-based control is a crucial component of robotic navigation. However, it often struggles with entrapment in local minima due to its inherent nature as a finite, myopic optimization procedure. Previous studies have addressed this issue…

机器人学 · 计算机科学 2024-11-12 Takahiro Fuke , Masafumi Endo , Kohei Honda , Genya Ishigami

We extend our recently introduced stochastic nonlocal traffic flow model to more general random perturbations, including Markovian noise derived from a discretized Jacobi-type stochastic differential equation. Invoking a deterministic…

数值分析 · 数学 2026-03-26 Timo Böhme , Simone Göttlich , Andreas Neuenkirch

We consider the problem of global optimization of an unknown non-convex smooth function with zeroth-order feedback. In this setup, an algorithm is allowed to adaptively query the underlying function at different locations and receives noisy…

机器学习 · 统计学 2018-03-26 Yining Wang , Sivaraman Balakrishnan , Aarti Singh

The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional…

最优化与控制 · 数学 2018-10-23 Mickaël Binois , David Ginsbourger , Olivier Roustant

Abstaining classifiers have been widely used in cost-sensitive applications to avoid ambiguous classification and reduce the cost of misclassification. Previous abstaining classification models rely on cost information, such as a cost…

机器学习 · 计算机科学 2019-05-20 Hongjiao Guan

Planning problems are hard, motion planning, for example, isPSPACE-hard. Such problems are even more difficult in the presence of uncertainty. Although, Markov Decision Processes (MDPs) provide a formal framework for such problems, finding…

人工智能 · 计算机科学 2013-01-14 Carlos E. Guestrin , Dirk Ormoneit

The article discusses distributed gradient-descent algorithms for computing local and global minima in nonconvex optimization. For local optimization, we focus on distributed stochastic gradient descent (D-SGD)--a simple network-based…

最优化与控制 · 数学 2020-09-17 Brian Swenson , Soummya Kar , H. Vincent Poor , José M. F. Moura , Aaron Jaech

A gradient-free deterministic method is developed to solve global optimization problems for Lipschitz continuous functions defined in arbitrary path-wise connected compact sets in Euclidean spaces. The method can be regarded as granular…

最优化与控制 · 数学 2021-07-15 Tao Qian , Lei Dai , Liming Zhang , Zehua Chen

Combinatorial optimization problems can be mapped onto Ising models, and their ground state is generally difficult to find. A lot of heuristics for these problems have been proposed, and one promising approach is to use continuous…

统计力学 · 物理学 2022-11-03 Shintaro Sato

This paper investigates the problem of efficient constrained global optimization of hybrid models that are a composition of a known white-box function and an expensive multi-output black-box function subject to noisy observations, which…

机器学习 · 统计学 2023-07-31 Congwen Lu , Joel A. Paulson

We propose a derivative-free trust-region method based on finite-difference gradient approximations for smooth optimization problems with convex constraints. The proposed method does not require computing an approximate stationarity…

最优化与控制 · 数学 2025-10-21 Dânâ Davar , Geovani Nunes Grapiglia

Policy optimization has drawn increasing attention in reinforcement learning, particularly in the context of derivative-free methods for linear quadratic regulator (LQR) problems with unknown dynamics. This paper focuses on characterizing…

最优化与控制 · 数学 2025-06-17 Weijian Li , Panagiotis Kounatidis , Zhong-Ping Jiang , Andreas A. Malikopoulos

Many computer vision problems are formulated as the optimization of a cost function. This approach faces two main challenges: (i) designing a cost function with a local optimum at an acceptable solution, and (ii) developing an efficient…

计算机视觉与模式识别 · 计算机科学 2019-04-15 Jayakorn Vongkulbhisal , Fernando De la Torre , João P. Costeira

Variational Hybrid Quantum Classical Algorithms (VHQCAs) are a class of quantum algorithms intended to run on noisy intermediate-scale quantum (NISQ) devices. These algorithms employ a parameterized quantum circuit (ansatz) and a…

量子物理 · 物理学 2021-06-17 Aidan Pellow-Jarman , Ilya Sinayskiy , Anban Pillay , Francesco Petruccione

Robust discrete optimization is a highly active field of research where a plenitude of combinations between decision criteria, uncertainty sets and underlying nominal problems are considered. Usually, a robust problem becomes harder to…

最优化与控制 · 数学 2022-01-14 Marc Goerigk , Mohammad Khosravi