English
Related papers

Related papers: borealis - A generalized global update algorithm f…

200 papers

In this work, we deal with unconstrained nonlinear optimization problems. Specifically, we are interested in methods carrying out updates possibly along directions not of descent, like Polyak's heavy-ball algorithm. Instead of enforcing…

Optimization and Control · Mathematics 2025-05-27 Federica Donnini , Matteo Lapucci , Pierluigi Mansueto

Optimization problems pervade essentially every scientific discipline and industry. Many such problems require finding a solution that maximizes the number of constraints satisfied. Often, these problems are particularly difficult to solve…

Artificial Intelligence · Computer Science 2017-10-26 Fabio L. Traversa , Pietro Cicotti , Forrest Sheldon , Massimiliano Di Ventra

Combinatorial optimization problems are central to both practical applications and the development of optimization methods. While classical and quantum algorithms have been refined over decades, machine learning--assisted approaches are…

Disordered Systems and Neural Networks · Physics 2026-05-12 Luca Maria Del Bono , Federico Ricci-Tersenghi , Francesco Zamponi

Bayesian optimization has recently emerged as a popular method for the sample-efficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains…

Machine Learning · Computer Science 2020-02-26 David Eriksson , Michael Pearce , Jacob R Gardner , Ryan Turner , Matthias Poloczek

A new methodology is proposed to solve classical Boolean problems as Hamiltonians, using the quantum approximate optimization algorithm (QAOA). Our methodology successfully finds all optimized approximated solutions for Boolean problems,…

Quantum Physics · Physics 2024-07-11 Ali Al-Bayaty , Marek Perkowski

Spin systems with frustration and disorder are notoriously difficult to study both analytically and numerically. While the simulation of ferromagnetic statistical mechanical models benefits greatly from cluster algorithms, these accelerated…

Disordered Systems and Neural Networks · Physics 2015-08-18 Zheng Zhu , Andrew J. Ochoa , Helmut G. Katzgraber

This paper shows how a class of non-convex optimization problems constrained by discretized nonlinear partial differential equations may be solved to global optimality using an interior point continuation method. The solution procedure…

Optimization and Control · Mathematics 2020-03-13 Jorn Baayen , Teresa Piovesan , Jesse VanderWees

Boolean optimization finds a wide range of application domains, that motivated a number of different organizations of Boolean optimizers since the mid 90s. Some of the most successful approaches are based on iterative calls to an NP oracle,…

Artificial Intelligence · Computer Science 2011-09-14 Antonio Morgado , Joao Marques-Silva

In this paper, an efficient modified Newton type algorithm is proposed for nonlinear unconstrianed optimization problems. The modified Hessian is a convex combination of the identity matrix (for steepest descent algorithm) and the Hessian…

Optimization and Control · Mathematics 2015-10-09 Yaguang Yang

We present GLASSES: Global optimisation with Look-Ahead through Stochastic Simulation and Expected-loss Search. The majority of global optimisation approaches in use are myopic, in only considering the impact of the next function value; the…

Machine Learning · Statistics 2015-10-22 Javier González , Michael Osborne , Neil D. Lawrence

We present a novel efficient theoretical and numerical framework for solving global non-convex polynomial optimization problems. We analytically demonstrate that such problems can be efficiently reformulated using a non-linear objective…

Optimization and Control · Mathematics 2024-05-17 Pierre-David Letourneau , Dalton Jones , Matthew Morse , M. Harper Langston

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg

In many important design problems, some decisions should be made by finding the global optimum of a multiextremal objective function subject to a set of constrains. Frequently, especially in engineering applications, the functions involved…

Optimization and Control · Mathematics 2015-09-17 Dmitri E. Kvasov , Yaroslav D. Sergeyev

When optimizing real-time systems, designers often face a challenging problem where the schedulability constraints are non-convex, non-continuous, or lack an analytical form to understand their properties. Although the optimization…

Systems and Control · Electrical Eng. & Systems 2024-01-23 Sen Wang , Dong Li , Shao-Yu Huang , Xuanliang Deng , Ashrarul H. Sifat , Changhee Jung , Ryan Williams , Haibo Zeng

This study presents a novel heuristic algorithm called the "Minimal Positive Negative Product Strategy" to guide the CDCL algorithm in solving the Boolean satisfiability problem. It provides a mathematical explanation for the superiority of…

Artificial Intelligence · Computer Science 2023-10-31 Qun Zhao , Xintao Wang , Menghui Yang

Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain because the feasible set is a non-smooth and non-convex algebraic variety. Existing techniques include projected gradient descent, fixed-rank…

Optimization and Control · Mathematics 2024-06-21 Quentin Rebjock , Nicolas Boumal

In this paper, the global optimization problem $\min_{y\in S} F(y)$ with $S$ being a hyperinterval in $\Re^N$ and $F(y)$ satisfying the Lipschitz condition with an unknown Lipschitz constant is considered. It is supposed that the function…

Optimization and Control · Mathematics 2015-09-14 Daniela Lera , Yaroslav D. Sergeyev

Probabilistic smoothing is a standard tool for global optimization, but existing methods rely on Gaussian kernels and specific transforms, often resulting in strong hyperparameter sensitivity and limited robustness. We propose a general…

Machine Learning · Computer Science 2026-05-27 Kukyoung Jang , Taehyun Cho , Junrui Zhang , Ping Xu , Kyungjae Lee

We consider the problem of parameter estimation in dynamic systems described by ordinary differential equations. A review of the existing literature emphasizes the need for deterministic global optimization methods due to the nonconvex…

Optimization and Control · Mathematics 2025-06-16 M. Fernández de Dios , Ángel M. González-Rueda , Julio R. Banga , Julio González-Díaz , David R. Penas

Recent hardware advances in quantum and quantum-inspired annealers promise substantial speedup for solving NP-hard combinatorial optimization problems compared to general-purpose computers. These special-purpose hardware are built for…

Quantum Physics · Physics 2020-01-06 Avradip Mandal , Arnab Roy , Sarvagya Upadhyay , Hayato Ushijima-Mwesigwa