English
Related papers

Related papers: The Hypervolume Indicator: Problems and Algorithms

200 papers

In this paper, we generalize the chance optimization problems and introduce constrained volume optimization where enables us to obtain convex formulation for challenging problems in systems and control. We show that many different problems…

Optimization and Control · Mathematics 2017-02-01 Ashkan Jasour , Constantino Lagoa

During the training phase of machine learning (ML) models, it is usually necessary to configure several hyperparameters. This process is computationally intensive and requires an extensive search to infer the best hyperparameter set for the…

Machine Learning · Computer Science 2024-04-19 Angelos Chatzimparmpas , Rafael M. Martins , Kostiantyn Kucher , Andreas Kerren

A vast majority of machine learning algorithms train their models and perform inference by solving optimization problems. In order to capture the learning and prediction problems accurately, structural constraints such as sparsity or low…

Machine Learning · Statistics 2017-12-22 Prateek Jain , Purushottam Kar

Hyperdimensional computing (HDC) is an emerging computing paradigm with significant promise for efficient and robust learning. In HDC, objects are encoded with high-dimensional vector symbolic sequences called hypervectors. The quality of…

Machine Learning · Computer Science 2023-11-20 Sercan Aygun , M. Hassan Najafi

Benchmarks are a useful tool for empirical performance comparisons. However, one of the main shortcomings of existing benchmarks is that it remains largely unclear how they relate to real-world problems. What does an algorithm's performance…

Neural and Evolutionary Computing · Computer Science 2020-04-15 Koen van der Blom , Timo M. Deist , Tea Tušar , Mariapia Marchi , Yusuke Nojima , Akira Oyama , Vanessa Volz , Boris Naujoks

A general condition determining the optimal performance of a complex system has not yet been found and the possibility of its existence is unknown. To contribute in this direction, an optimization algorithm as a complex system is presented.…

Computational Complexity · Computer Science 2007-05-23 Victor Korotkikh , Galina Korotkikh , Darryl Bond

With the rapid development of digital information, the data volume generated by humans and machines is growing exponentially. Along with this trend, machine learning algorithms have been formed and evolved continuously to discover new…

Machine Learning · Computer Science 2019-03-25 Thanh Tung Khuat , Dymitr Ruta , Bogdan Gabrys

Hyperparameters are configuration variables controlling the behavior of machine learning algorithms. They are ubiquitous in machine learning and artificial intelligence and the choice of their values determines the effectiveness of systems…

This paper presents methodological improvements to variational quantum algorithms (VQAs) for solving multicriteria optimization problems. We introduce two key contributions. First, we reformulate the parameter optimization task of VQAs as a…

In this letter, a new hypervolume contribution approximation method is proposed which is formulated as an R2 indicator. The basic idea of the proposed method is to use different line segments only in the hypervolume contribution region for…

Optimization and Control · Mathematics 2019-04-08 Ke Shang , Hisao Ishibuchi , Xizi Ni

Errors or failures in a high-volume manufacturing environment can have significant impact that can result in both the loss of time and money. Identifying such failures early has been a top priority for manufacturing industries and various…

Machine Learning · Computer Science 2024-07-15 Siddarth Reddy Karuka , Abhinav Sunderrajan , Zheng Zheng , Yong Woon Tiean , Ganesh Nagappan , Allan Luk

Algorithms for continuous optimization problems have a rich history of design and innovation over the past several decades, in which mathematical analysis of their convergence and complexity properties plays a central role. Besides their…

Optimization and Control · Mathematics 2025-12-03 Stephen J. Wright

In this paper, we develop a stochastic set-valued optimization (SVO) framework tailored for robust machine learning. In the SVO setting, each decision variable is mapped to a set of objective values, and optimality is defined via set…

Optimization and Control · Mathematics 2026-03-19 Tommaso Giovannelli , Jingfu Tan , Luis Nunes Vicente

It has been found that stochastic algorithms often find good solutions much more rapidly than inherently-batch approaches. Indeed, a very useful rule of thumb is that often, when solving a machine learning problem, an iterative technique…

Machine Learning · Computer Science 2013-08-19 Andrew Cotter

Distributed optimization algorithms are widely used in many industrial machine learning applications. However choosing the appropriate algorithm and cluster size is often difficult for users as the performance and convergence rate of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-21 Xinghao Pan , Shivaram Venkataraman , Zizheng Tai , Joseph Gonzalez

A wide variety of problems in machine learning, including exemplar clustering, document summarization, and sensor placement, can be cast as constrained submodular maximization problems. Unfortunately, the resulting submodular optimization…

Machine Learning · Computer Science 2015-04-23 Rafael da Ponte Barbosa , Alina Ene , Huy L. Nguyen , Justin Ward

We present a novel approach for constructing discrete optimization benchmarks that enables fine-grained control over problem properties, and such benchmarks can facilitate analyzing discrete algorithm behaviors. We build benchmark problems…

Neural and Evolutionary Computing · Computer Science 2026-04-09 Furong Ye , Frank Neumann , Thomas Bäck , Niki van Stein

Machine Learning models incorporating multiple layered learning networks have been seen to provide effective models for various classification problems. The resulting optimization problem to solve for the optimal vector minimizing the…

Optimization and Control · Mathematics 2018-07-03 Vyacheslav Kungurtsev , Tomas Pevny

An algorithm which computes a solution of a set optimization problem is provided. The graph of the objective map is assumed to be given by finitely many linear inequalities. A solution is understood to be a set of points in the domain…

Optimization and Control · Mathematics 2014-05-29 Andreas Löhne , Carola Schrage

Computation of confidence sets is central to data science and machine learning, serving as the workhorse of A/B testing and underpinning the operation and analysis of reinforcement learning algorithms. Among all valid confidence sets for…

Machine Learning · Statistics 2026-01-27 Heguang Lin , Binhao Chen , Mengze Li , Daniel Pimentel-Alarcón , Matthew L. Malloy