English
Related papers

Related papers: A Light-Weight Multi-Objective Asynchronous Hyper-…

200 papers

Multiobjective optimization problems are important in analysis and application of nonlinear dynamical systems. As a first step, this paper studies a biobjective optimization problem in a simple nonlinear switched dynamical system: a…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Ryunosuke Numata , Toshimichi Saito

Multi-objective optimization problems can be found in many real-world applications, where the objectives often conflict each other and cannot be optimized by a single solution. In the past few decades, numerous methods have been proposed to…

Machine Learning · Computer Science 2024-07-24 Xi Lin , Xiaoyuan Zhang , Zhiyuan Yang , Fei Liu , Zhenkun Wang , Qingfu Zhang

Automatically tuning software configuration for optimizing a single performance attribute (e.g., minimizing latency) is not trivial, due to the nature of the configuration systems (e.g., complex landscape and expensive measurement). To deal…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-03 Tao Chen , Miqing Li

Hyper-parameter Tuning is among the most critical stages in building machine learning solutions. This paper demonstrates how multi-agent systems can be utilized to develop a distributed technique for determining near-optimal values for any…

Machine Learning · Computer Science 2022-05-12 Ahmad Esmaeili , Zahra Ghorrati , Eric Matson

In practical engineering and optimization, solving multi-objective optimization (MOO) problems typically involves scalarization methods that convert a multi-objective problem into a single-objective one. While effective, these methods often…

Optimization and Control · Mathematics 2025-02-05 Ilgam Latypov , Yuriy Dorn

Sampling-based motion planning algorithms have been continuously developed for more than two decades. Apart from mobile robots, they are also widely used in manipulator motion planning. Hence, these methods play a key role in collaborative…

Robotics · Computer Science 2023-07-13 Carl Gaebert , Sascha Kaden , Benjamin Fischer , Ulrike Thomas

Optimization models generally aim for efficiency by maximizing total benefit or minimizing cost. Yet a trade-off between fairness and efficiency is an important element of many practical decisions. We propose a principled and practical…

Optimization and Control · Mathematics 2020-06-11 Violet Xinying Chen , J. N. Hooker

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

Hyper-parameter optimization is one of the most tedious yet crucial steps in training machine learning models. There are numerous methods for this vital model-building stage, ranging from domain-specific manual tuning guidelines suggested…

Machine Learning · Computer Science 2023-03-08 Ahmad Esmaeili , Zahra Ghorrati , Eric T. Matson

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

This study presents AIOptimizer, a prototype for a cost-reduction-based software performance optimisation tool. The study focuses on the design elements of AIOptimizer, including user-friendliness, scalability, accuracy, and adaptability.…

Software Engineering · Computer Science 2024-09-17 Noopur Zambare

Efficient handover algorithms are essential for highly performing mobile wireless communications. These algorithms depend on numerous parameters, whose settings must be appropriately optimized to offer a seamless connectivity. Nevertheless,…

Networking and Internet Architecture · Computer Science 2012-11-15 Carlo Fischione , George Athanasiou , Fortunato Santucci

We propose a novel, flexible algorithm for combining together metaheuristicoptimizers for non-convex optimization problems. Our approach treatsthe constituent optimizers as a team of complex agents that communicateinformation amongst each…

Neural and Evolutionary Computing · Computer Science 2019-06-06 Sujit Pramod Khanna , Alexander Ororbia

The multi-objective optimization is to optimize several objective functions over a common feasible set. Since the objectives usually do not share a common optimizer, people often consider (weakly) Pareto points. This paper studies…

Optimization and Control · Mathematics 2023-12-05 Jiawang Nie , Zi Yang

In this paper we characterize sharp time-data tradeoffs for optimization problems used for solving linear inverse problems. We focus on the minimization of a least-squares objective subject to a constraint defined as the sub-level set of a…

Information Theory · Computer Science 2016-01-06 Samet Oymak , Benjamin Recht , Mahdi Soltanolkotabi

Despite the recent progress in hyperparameter optimization (HPO), available benchmarks that resemble real-world scenarios consist of a few and very large problem instances that are expensive to solve. This blocks researchers and…

Machine Learning · Computer Science 2019-11-26 Aaron Klein , Zhenwen Dai , Frank Hutter , Neil Lawrence , Javier Gonzalez

Designing a multi-layer optical system with designated optical characteristics is an inverse design problem in which the resulting design is determined by several discrete and continuous parameters. In particular, we consider three design…

Machine Learning · Computer Science 2021-11-17 Heribert Wankerl , Maike L. Stern , Ali Mahdavi , Christoph Eichler , Elmar W. Lang

A typical assumption in supervised machine learning is that the train (source) and test (target) datasets follow completely the same distribution. This assumption is, however, often violated in uncertain real-world applications, which…

Machine Learning · Computer Science 2021-08-17 Masahiro Nomura , Yuta Saito

Zero-shot hyperparameter optimization (HPO) is a simple yet effective use of transfer learning for constructing a small list of hyperparameter (HP) configurations that complement each other. That is to say, for any given dataset, at least…

Machine Learning · Statistics 2020-07-28 Fela Winkelmolen , Nikita Ivkin , H. Furkan Bozkurt , Zohar Karnin

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

Machine Learning · Computer Science 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney