English
Related papers

Related papers: VOPy: A Framework for Black-box Vector Optimizatio…

200 papers

Robust estimation provides essential tools for analyzing data that contain outliers, ensuring that statistical models remain reliable even in the presence of some anomalous data. While robust methods have long been available in R, users of…

Computation · Statistics 2024-11-05 Sarah Leyder , Jakob Raymaekers , Peter J. Rousseeuw , Thomas Servotte , Tim Verdonck

Most black-box optimization methods require extensive hyperparameter tuning, often limiting their ability to generalize across different optimization domains. Foundation models for black-box optimization that learn optimization principles…

Machine Learning · Computer Science 2026-05-25 Aaron Klein , Herilalaina Rakotoarison , Luca Thale-Bombien , David Salinas

Benchmarking is one of the key ways in which we can gain insight into the strengths and weaknesses of optimization algorithms. In sampling-based optimization, considering the anytime behavior of an algorithm can provide valuable insights…

Neural and Evolutionary Computing · Computer Science 2024-12-11 Diederick Vermetten , Jeroen Rook , Oliver L. Preuß , Jacob de Nobel , Carola Doerr , Manuel López-Ibañez , Heike Trautmann , Thomas Bäck

Combinatorial optimization problems are prevalent across a wide variety of domains. These problems are often nuanced, their optimal solutions might not be efficiently obtainable, and they may require lots of time and compute resources to…

Machine Learning · Computer Science 2025-07-03 Akshay Sathiya , Rohit Pandey

Meta-Black-Box Optimization (MetaBBO) streamlines the automation of optimization algorithm design through meta-learning. It typically employs a bi-level structure: the meta-level policy undergoes meta-training to reduce the manual effort…

Simultaneously visualizing the decision and objective space of continuous multi-objective optimization problems (MOPs) recently provided key contributions in understanding the structure of their landscapes. For the sake of advancing these…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Lennart Schäpermeier , Christian Grimme , Pascal Kerschke

In the current paper, we present an optimization system solving multi objective production scheduling problems (MOOPPS). The identification of Pareto optimal alternatives or at least a close approximation of them is possible by a set of…

Artificial Intelligence · Computer Science 2008-09-08 Martin Josef Geiger

Constrained multiobjective optimization has gained much interest in the past few years. However, constrained multiobjective optimization problems (CMOPs) are still unsatisfactorily understood. Consequently, the choice of adequate CMOPs for…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

There are different solution concepts for convex vector optimization problems (CVOPs) and a recent one, which is motivated from a set optimization point of view, consists of finitely many efficient solutions that generate polyhedral inner…

Optimization and Control · Mathematics 2019-05-28 Firdevs Ulus

We present NeuralOperator, an open-source Python library for operator learning. Neural operators generalize neural networks to maps between function spaces instead of finite-dimensional Euclidean spaces. They can be trained and inferenced…

Multiscale modeling, which integrates material properties from ab initio calculations into continuum-scale simulations, is a promising strategy for optimizing semiconductor devices. However, a key challenge remains: while ab initio methods…

Materials Science · Physics 2026-01-12 Taeyoung Jeong , Kun Hee Ye , Seungjae Yoon , Dohyun Kim , Yunjae Kim , Jung-Hae Choi

This paper is concerned with synthesizing programs based on black-box oracles: we are interested in the case where there exists an executable implementation of a component or library, but its internal structure is unknown. We are provided…

Programming Languages · Computer Science 2020-10-13 Bruce Collie , Jackson Woodruff , Michael F. P. O'Boyle

Black-box optimization minimizes an objective function without derivatives or explicit forms. Such an optimization method with continuous variables has been successful in the fields of machine learning and material science. For discrete…

In this paper we introduce DISROPT, a Python package for distributed optimization over networks. We focus on cooperative set-ups in which an optimization problem must be solved by peer-to-peer processors (without central coordinators) that…

Optimization and Control · Mathematics 2021-04-21 Francesco Farina , Andrea Camisa , Andrea Testa , Ivano Notarnicola , Giuseppe Notarstefano

Hyperloop system design is a uniquely coupled problem because it involves the simultaneous design of a complex, high-performance vehicle and its accompanying infrastructure. In the clean-sheet design of this new mode of high-speed mass…

Computational Engineering, Finance, and Science · Computer Science 2021-04-23 Philippe Kirschen , Edward Burnell

Mixed-integer convex programming (MICP) has seen significant algorithmic and hardware improvements with several orders of magnitude solve time speedups compared to 25 years ago. Despite these advances, MICP has been rarely applied to…

Robotics · Computer Science 2022-04-12 A. Cauligi , P. Culbertson , B. Stellato , D. Bertsimas , M. Schwager , M. Pavone

Variational inference has become a widely used method to approximate posteriors in complex latent variables models. However, deriving a variational inference algorithm generally requires significant model-specific analysis, and these…

Machine Learning · Statistics 2014-01-03 Rajesh Ranganath , Sean Gerrish , David M. Blei

Many machine learning models, such as logistic regression~(LR) and support vector machine~(SVM), can be formulated as composite optimization problems. Recently, many distributed stochastic optimization~(DSO) methods have been proposed to…

Machine Learning · Statistics 2016-12-13 Shen-Yi Zhao , Ru Xiang , Ying-Hao Shi , Peng Gao , Wu-Jun Li

Machine learning techniques have been paramount throughout the last years, being applied in a wide range of tasks, such as classification, object recognition, person identification, and image segmentation. Nevertheless, conventional…

Machine Learning · Computer Science 2021-08-03 Gustavo Henrique de Rosa , João Paulo Papa , Alexandre Xavier Falcão

Frequently, the burgeoning field of black-box optimization encounters challenges due to a limited understanding of the mechanisms of the objective function. To address such problems, in this work we focus on the deterministic concept of…

Optimization and Control · Mathematics 2024-12-30 Aleksandr Lobanov , Alexander Gasnikov , Andrei Krasnov