English
Related papers

Related papers: Optimal Black-Box Reductions Between Optimization …

200 papers

This work deals with the design optimization of electrical machines under the consideration of manufacturing uncertainties. In order to efficiently quantify the uncertainty, blackbox machine learning methods are employed. A multi-objective…

Computational Engineering, Finance, and Science · Computer Science 2023-11-27 Morten Huber , Mona Fuhrländer , Sebastian Schöps

Reductions---rules that reduce input size while maintaining the ability to compute an optimal solution---are critical for developing efficient maximum independent set algorithms in both theory and practice. While several simple reductions…

Data Structures and Algorithms · Computer Science 2016-08-03 Darren Strash

The encoding of solutions in black-box optimization is a delicate, handcrafted balance between expressiveness and domain knowledge -- between exploring a wide variety of solutions, and ensuring that those solutions are useful. Our main…

Neural and Evolutionary Computing · Computer Science 2020-07-07 Adam Gaier , Alexander Asteroth , Jean-Baptiste Mouret

Simulation Optimization (SO) refers to the optimization of an objective function subject to constraints, both of which can be evaluated through a stochastic simulation. To address specific features of a particular simulation---discrete or…

Data Structures and Algorithms · Computer Science 2017-06-28 Satyajith Amaran , Nikolaos V. Sahinidis , Bikram Sharda , Scott J. Bury

The rapid growth of data in the recent years has led to the development of complex learning algorithms that are often used to make decisions in real world. While the positive impact of the algorithms has been tremendous, there is a need to…

Machine Learning · Computer Science 2022-01-03 Ankit Kulshrestha , Ilya Safro

An algorithm which computes a solution of a set optimization problem is provided. The graph of the objective map is assumed to be given by finitely many linear inequalities. A solution is understood to be a set of points in the domain…

Optimization and Control · Mathematics 2014-05-29 Andreas Löhne , Carola Schrage

Numerical and symbolic methods for optimization are used extensively in engineering, industry, and finance. Various methods are used to reduce problems of interest to ones that are amenable to solution by such software. We develop a…

Logic in Computer Science · Computer Science 2023-02-23 Alexander Bentkamp , Ramon Fernández Mir , Jeremy Avigad

Frequently, the burgeoning field of black-box optimization encounters challenges due to a limited understanding of the mechanisms of the objective function. To address such problems, in this work we focus on the deterministic concept of…

Optimization and Control · Mathematics 2024-12-30 Aleksandr Lobanov , Alexander Gasnikov , Andrei Krasnov

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das

Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate…

Human-Computer Interaction · Computer Science 2022-06-30 Charles Wan , Rodrigo Belo , Leid Zejnilović

Large reasoning models (LRMs) often consume excessive tokens, inflating computational cost and latency. More broadly, in goal reaching sequential decision problems we often want to reach the goal quickly, and LRM reasoning can be viewed…

Machine Learning · Computer Science 2026-05-27 Alex Ayoub , Kavosh Asadi , Dale Schuurmans , Csaba Szepesvári , Karim Bouyarmane

Designing effective black-box optimizers is hampered by limited problem-specific knowledge and manual control that spans months for almost every detail. In this paper, we present \textit{DesignX}, the first automated algorithm design…

Machine Learning · Computer Science 2025-10-24 Hongshu Guo , Zeyuan Ma , Yining Ma , Xinglin Zhang , Wei-Neng Chen , Yue-Jiao Gong

Machine learning systems are often trained using data collected from historical decisions. If past decisions were biased, then automated systems that learn from historical data will also be biased. We propose a black-box approach to…

Machine Learning · Computer Science 2021-02-08 Sahil Verma , Michael Ernst , Rene Just

We consider a class of combinatorial optimization problems that emerge in a variety of domains among which: condensed matter physics, theory of financial risks, error correcting codes in information transmissions, molecular and protein…

Numerical Analysis · Mathematics 2025-10-20 L. Bussolari , P. Contucci , C. Giardina' , C. Giberti , F. Unguendoli , C. Vernia

We study the L1 minimization problem with additional box constraints. We motivate the problem with two different views of optimality considerations. We look into imposing such constraints in projected gradient techniques and propose a worst…

Data Structures and Algorithms · Computer Science 2010-10-04 Mithun Das Gupta , Sanjeev Kumar , Jing Xiao

Black-box algorithms are designed to optimize functions without relying on their underlying analytical structure or gradient information, making them essential when gradients are inaccessible or difficult to compute. Traditional methods for…

Machine Learning · Computer Science 2026-01-21 Yedidya Kfir , Elad Sarafian , Sarit Kraus , Yoram Louzoun

Process control and optimization have been widely used to solve decision-making problems in chemical engineering applications. However, identifying and tuning the best solution algorithm is challenging and time-consuming. Machine learning…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Ilias Mitrai , Prodromos Daoutidis

The performance of many machine learning models depends on their hyper-parameter settings. Bayesian Optimization has become a successful tool for hyper-parameter optimization of machine learning algorithms, which aims to identify optimal…

Machine Learning · Computer Science 2020-08-04 Lidan Wang , Franck Dernoncourt , Trung Bui

In real-time systems optimization, designers often face a challenging problem posed by the non-convex and non-continuous schedulability conditions, which may even lack an analytical form to understand their properties. To tackle this…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Sen Wang , Dong Li , Shao-Yu Huang , Xuanliang Deng , Ashrarul H. Sifat , Changhee Jung , Ryan Williams , Haibo Zeng

Optimization is an important module of modern machine learning applications. Tremendous efforts have been made to accelerate optimization algorithms. A common formulation is achieving a lower loss at a given time. This enables a…

Machine Learning · Computer Science 2025-05-29 Zhonglin Xie , Yiman Fong , Haoran Yuan , Zaiwen Wen