English
Related papers

Related papers: Pareto-like Sequential Sampling Heuristic for Glob…

200 papers

This work presents a novel lattice-based methodology for incorporating multidimensional constraints into continuous decision variables within a genetic algorithm (GA) framework. The proposed approach consolidates established transcription…

Neural and Evolutionary Computing · Computer Science 2024-10-17 Cameron D. Harris , Kevin B. Schroeder , Jonathan Black

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

Optimization and Control · Mathematics 2023-10-04 Xiaoxue Jiang

We present an algorithm for multi-objective optimization of computationally expensive problems. The proposed algorithm is based on solving a set of surrogate problems defined by models of the real one, so that only solutions estimated to be…

Neural and Evolutionary Computing · Computer Science 2021-04-20 Santiago Cuervo , Miguel Melgarejo , Angie Blanco-Cañon , Laura Reyes-Fajardo , Sergio Rojas-Galeano

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

Optimization and Control · Mathematics 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

Optimization problems become fundamentally challenging as the number of variables increases. Because the volume of the search space grows exponentially, classical algorithms frequently fail to locate the global minimum of non-convex…

Quantum Physics · Physics 2026-04-23 Dominik Soós , Marc Paterno , John Stenger , Nikos Chrisochoides

Global optimization is a challenging problem, with plenty of algorithms displaying empirical success, but scarce theoretical backing. In this work, we propose a new theoretical framework called Proximal Basin Hopping (PBH), carefully…

Machine Learning · Computer Science 2026-05-19 Guillaume Lauga , Cesare Molinari , Samuel Vaiter

Neural network pruning is a key technique towards engineering large yet scalable, interpretable, and generalizable models. Prior work on the subject has developed largely along two orthogonal directions: (1) differentiable pruning for…

Machine Learning · Computer Science 2025-02-12 Taisuke Yasuda , Kyriakos Axiotis , Gang Fu , MohammadHossein Bateni , Vahab Mirrokni

We propose a new random method to minimize deterministic continuous functions over subsets $\mathcal{S}$ of high-dimensional space $\mathbb{R}^K$ without assuming convexity. Our procedure alternates between a Global Search (GS) regime to…

Data Analysis, Statistics and Probability · Physics 2025-06-09 Pierre Bertrand , Michel Broniatowski , Wolfgang Stummer

In this paper, we propose a method that has foundations in the line search sequential quadratic programming paradigm for solving general nonlinear equality constrained optimization problems. The method employs a carefully designed modified…

Optimization and Control · Mathematics 2024-07-29 Albert S. Berahas , Raghu Bollapragada , Jiahao Shi

We present a novel adaptive optimization algorithm for black-box multi-objective optimization problems with binary constraints on the foundation of Bayes optimization. Our method is based on probabilistic regression and classification…

Machine Learning · Statistics 2021-03-01 Raoul Heese , Michael Bortz

This paper proposes a unified framework for the global optimization of a continuous function in a bounded rectangular domain. Specifically, we show that: (1) under the optimal strategy for a two-armed decision model, the sample mean…

Optimization and Control · Mathematics 2025-11-11 Xiaohong Chen , Zengjing Chen , Wayne Yuan Gao , Xiaodong Yan , Guodong Zhang

Sampling-based algorithms solve the path planning problem by generating random samples in the search-space and incrementally growing a connectivity graph or a tree. Conventionally, the sampling strategy used in these algorithms is biased…

Robotics · Computer Science 2021-02-26 Sagar Suhas Joshi , Seth Hutchinson , Panagiotis Tsiotras

In the past few decades, many multiobjective evolutionary optimization algorithms (MOEAs) have been proposed to find a finite set of approximate Pareto solutions for a given problem in a single run, each with its own structure. However, in…

Neural and Evolutionary Computing · Computer Science 2024-04-30 Xi Lin , Xiaoyuan Zhang , Zhiyuan Yang , Qingfu Zhang

Designing a fast and efficient optimization method with local optima avoidance capability on a variety of optimization problems is still an open problem for many researchers. In this work, the concept of a new global optimization method…

Neural and Evolutionary Computing · Computer Science 2012-08-13 Fereydoun Farrahi Moghaddam , Reza Farrahi Moghaddam , Mohamed Cheriet

In this paper, we develop a global descent method for non-convex multi-objective optimization problems. The proposed approach builds upon foundational concepts from single-objective global descent techniques while removing the need for…

Optimization and Control · Mathematics 2025-07-31 Bikram Adhikary , Md Abu Talhamainuddin Ansary , Savin Treanta

Combinatorial optimization problems are notoriously challenging for neural networks, especially in the absence of labeled instances. This work proposes an unsupervised learning framework for CO problems on graphs that can provide integral…

Machine Learning · Computer Science 2021-03-09 Nikolaos Karalias , Andreas Loukas

In multi-objective optimization, a single decision vector must balance the trade-offs between many objectives. Solutions achieving an optimal trade-off are said to be Pareto optimal: these are decision vectors for which improving any one…

Optimization and Control · Mathematics 2023-08-07 Abhishek Roy , Geelon So , Yi-An Ma

Scalarization allows to solve a multi-objective optimization problem by solving many single-objective sub-problems, uniquely determined by some parameters. In this work, we propose several adaptive strategies to select such parameters in…

Optimization and Control · Mathematics 2022-11-08 Giacomo Borghi

We study zeroth-order optimization where solutions must minimize a cost $d(s)$ while maintaining high probability under a complex generative prior $L(s)$ (e.g., a parameterized model). This reduces to sampling from a target distribution…

Machine Learning · Computer Science 2026-05-06 Pranjal Awasthi , Sreenivas Gollapudi , Ravi Kumar , Kamesh Munagala

Many real world applications can be framed as multi-objective optimization problems, where we wish to simultaneously optimize for multiple criteria. Bayesian optimization techniques for the multi-objective setting are pertinent when the…

Machine Learning · Computer Science 2019-06-24 Biswajit Paria , Kirthevasan Kandasamy , Barnabás Póczos