English
Related papers

Related papers: Towards a Systematic Development Process of Optimi…

200 papers

Optimization underpins many of the challenges that science and technology face on a daily basis. Recent years have witnessed a major shift from traditional optimization paradigms grounded on batch algorithms for medium-scale problems to…

Optimization and Control · Mathematics 2021-11-29 Andrea Simonetto , Emiliano Dall'Anese , Santiago Paternain , Geert Leus , Georgios B. Giannakis

Learning to optimize (L2O) is an emerging approach that leverages machine learning to develop optimization methods, aiming at reducing the laborious iterations of hand engineering. It automates the design of an optimization method based on…

Optimization and Control · Mathematics 2021-07-05 Tianlong Chen , Xiaohan Chen , Wuyang Chen , Howard Heaton , Jialin Liu , Zhangyang Wang , Wotao Yin

Trained ML models are commonly embedded in optimization problems. In many cases, this leads to large-scale NLPs that are difficult to solve to global optimality. While ML models frequently lead to large problems, they also exhibit…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Alexander Mitsos

Real world problems always have different multiple solutions. For instance, optical engineers need to tune the recording parameters to get as many optimal solutions as possible for multiple trials in the varied-line-spacing holographic…

Neural and Evolutionary Computing · Computer Science 2015-08-04 Ka-Chun Wong

In the first part of this paper, we present a unified framework for analyzing the algorithmic complexity of any optimization problem, whether it be continuous or discrete in nature. This helps to formalize notions like "input", "size" and…

Optimization and Control · Mathematics 2022-07-06 Amitabh Basu

In this presentation, we will develop a short overview of main trends of optimization in systems and control, and from there outline some new perspectives emerging today. More specifically, we will focus on the current situation, where it…

Optimization and Control · Mathematics 2012-05-02 Emile Simon

Learning-to-optimize leverages machine learning to accelerate optimization algorithms. While empirical results show tremendous improvements compared to classical optimization algorithms, theoretical guarantees are mostly lacking, such that…

Machine Learning · Computer Science 2025-06-02 Michael Sucker , Peter Ochs

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

For optimization models to be used in practice, it is crucial that users trust the results. A key factor in this aspect is the interpretability of the solution process. A previous framework for inherently interpretable optimization models…

Optimization and Control · Mathematics 2026-02-13 Marc Goerigk , Michael Hartisch , Sebastian Merten , Kartikey Sharma

Algorithm selection, aiming to identify the best algorithm for a given problem, plays a pivotal role in continuous black-box optimization. A common approach involves representing optimization functions using a set of features, which are…

Machine Learning · Computer Science 2025-05-13 Gašper Petelin , Gjorgjina Cenikj

Selecting an appropriate optimizer for a given problem is of major interest for researchers and practitioners. Many analytical optimizers have been proposed using a variety of theoretical and empirical approaches; however, none can offer a…

Machine Learning · Computer Science 2022-03-16 Tianshu Huang , Tianlong Chen , Sijia Liu , Shiyu Chang , Lisa Amini , Zhangyang Wang

When a computational task tolerates a relaxation of its specification or when an algorithm tolerates the effects of noise in its execution, hardware, programming languages, and system software can trade deviations from correct behavior for…

Code super-optimization is the task of transforming any given program to a more efficient version while preserving its input-output behaviour. In some sense, it is similar to the paraphrase problem from natural language processing where the…

Machine Learning · Computer Science 2017-06-29 Rudy Bunel , Alban Desmaison , M. Pawan Kumar , Philip H. S. Torr , Pushmeet Kohli

For many decades, formal methods are considered to be the way forward to help the software industry to make more reliable and trustworthy software. However, despite this strong belief and many individual success stories, no real change in…

Software Engineering · Computer Science 2024-02-14 Marieke Huisman , Dilian Gurov , Alexander Malkis

We propose a general-purpose method for finding high-quality solutions to hard optimization problems, inspired by self-organizing processes often found in nature. The method, called Extremal Optimization, successively eliminates extremely…

Statistical Mechanics · Physics 2018-07-06 S. Boettcher , A. Percus

In many two-sided markets, the parties to be matched have incomplete information about their characteristics. We consider the settings where the parties engaged are extremely patient and are interested in long-term partnerships. Hence, once…

Computer Science and Game Theory · Computer Science 2019-08-30 Kartik Ahuja , Mihaela van der Schaar

Business Process Management and Operations Research are two research fields that both aim to enhance value creation in organizations. While Business Process Management has historically emphasized on providing precise models, Operations…

Software Engineering · Computer Science 2024-09-04 Michel Kunkler , Felix Schumann , Stefanie Rinderle-Ma

Code optimization is the process of enhancing code efficiency, while preserving its intended functionality. This process often requires a deep understanding of the code execution behavior at run-time to identify and address inefficiencies…

Software Engineering · Computer Science 2026-04-02 Federico Di Menna , Luca Traini , Gabriele Bavota , Vittorio Cortellessa

Optimization models have been broadly used within side the energy industry as useful decision-making systems for scheduling and dispatching electric powered energy resources; this is applied in a system called unit commitment (UC). Unit…

Optimization and Control · Mathematics 2022-04-01 Angel Zambrano

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný