English
Related papers

Related papers: COBRA++: Enhanced COBRA Optimizer with Augmented S…

200 papers

In this paper, we study optimization methods consisting of iteratively minimizing surrogates of an objective function. By proposing several algorithmic variants and simple convergence analyses, we make two main contributions. First, we…

Machine Learning · Statistics 2013-05-15 Julien Mairal

Recent works in learning-integrated optimization have shown promise in settings where the optimization problem is only partially observed or where general-purpose optimizers perform poorly without expert tuning. By learning an optimizer…

Machine Learning · Computer Science 2023-11-06 Arman Zharmagambetov , Brandon Amos , Aaron Ferber , Taoan Huang , Bistra Dilkina , Yuandong Tian

Sample efficiency in the face of computationally expensive simulations is a common concern in surrogate modeling. Current strategies to minimize the number of samples needed are not as effective in simulated environments with wide state…

Machine Learning · Computer Science 2025-09-03 Julen Cestero , Marco Quartulli , Marcello Restelli

Most real-world optimization problems are difficult to solve with traditional statistical techniques or with metaheuristics. The main difficulty is related to the existence of a considerable number of local optima, which may result in the…

Neural and Evolutionary Computing · Computer Science 2022-06-08 Gloria Pietropolli , Giuliamaria Menara , Mauro Castelli

Offline optimization has recently emerged as an increasingly popular approach to mitigate the prohibitively expensive cost of online experimentation. The key idea is to learn a surrogate of the black-box function that underlines the target…

Machine Learning · Computer Science 2025-03-07 Manh Cuong Dao , Phi Le Nguyen , Thao Nguyen Truong , Trong Nghia Hoang

Safe reinforcement learning (RL) is still very challenging since it requires the agent to consider both return maximization and safe exploration. In this paper, we propose CUP, a Conservative Update Policy algorithm with a theoretical…

Machine Learning · Computer Science 2022-02-16 Long Yang , Jiaming Ji , Juntao Dai , Yu Zhang , Pengfei Li , Gang Pan

Variational quantum algorithms are a leading candidate for early applications on noisy intermediate-scale quantum computers. These algorithms depend on a classical optimization outer-loop that minimizes some function of a parameterized…

The optimal and robust design of structures has gained much attention in the past ten years due to the ever increasing need for manufacturers to build robust systems at the lowest cost. Reliability-based design optimization (RBDO) allows…

Applications · Statistics 2017-04-12 Vincent Dubourg , Jean-Marc Bourinet , Bruno Sudret

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

A novel design optimization approach (ActivO) that employs an ensemble of machine learning algorithms is presented. The proposed approach is a surrogate-based scheme, where the predictions of a weak leaner and a strong learner are utilized…

Machine Learning · Computer Science 2021-01-06 Opeoluwa Owoyele , Pinaki Pal

The problem of constrained reinforcement learning (CRL) holds significant importance as it provides a framework for addressing critical safety satisfaction concerns in the field of reinforcement learning (RL). However, with the introduction…

Machine Learning · Computer Science 2023-05-24 Chengbin Xuan , Feng Zhang , Faliang Yin , Hak-Keung Lam

In constraint learning, we use a neural network as a surrogate for part of the constraints or of the objective function of an optimization model. However, the tractability of the resulting model is heavily influenced by the size of the…

Optimization and Control · Mathematics 2026-03-19 Hung Pham , Aiden Ren , Ibrahim Tahir , Jiatai Tong , Thiago Serra

The aim of the present paper is to develop a strategy for solving reliability-based design optimization (RBDO) problems that remains applicable when the performance models are expensive to evaluate. Starting with the premise that…

Methodology · Statistics 2011-04-20 V. Dubourg , B. Sudret , J. -M. Bourinet

Expensive optimization problems (EOPs) are prevalent in real-world applications, where the evaluation of a single solution requires a significant amount of resources. In our study of surrogate-assisted evolutionary algorithms (SAEAs) in…

Neural and Evolutionary Computing · Computer Science 2024-12-06 Hao Hao , Xiaoqun Zhang , Aimin Zhou

Many real-world systems are modelled using complex ordinary differential equations (ODEs). However, the dimensionality of these systems can make them challenging to analyze. Dimensionality reduction techniques like Proper Orthogonal…

Computational Engineering, Finance, and Science · Computer Science 2025-02-26 Abhishek Ajayakumar , Soumyendu Raha

This paper introduces a novel two-stage machine learning-based surrogate modeling framework to address inverse problems in scientific and engineering fields. In the first stage of the proposed framework, a machine learning model termed the…

Machine Learning · Computer Science 2024-01-05 Farhad Pourkamali-Anaraki , Jamal F. Husseini , Evan J. Pineda , Brett A. Bednarcyk , Scott E. Stapleton

This paper studies optimization proxies, machine learning (ML) models trained to efficiently predict optimal solutions for AC Optimal Power Flow (ACOPF) problems. While promising, optimization proxy performance heavily depends on training…

Machine Learning · Computer Science 2025-11-11 Miao Li , Michael Klamkin , Pascal Van Hentenryck , Wenting Li , Russell Bent

Constrained optimization is popularly seen in reinforcement learning for addressing complex control tasks. From the perspective of dynamic system, iteratively solving a constrained optimization problem can be framed as the temporal…

Machine Learning · Computer Science 2025-01-28 Tianqi Zhang , Puzhen Yuan , Guojian Zhan , Ziyu Lin , Yao Lyu , Zhenzhi Qin , Jingliang Duan , Liping Zhang , Shengbo Eben Li

Several methods have been proposed in the literature to solve reliability-based optimization problems, where failure probabilities are design constraints. However, few methods address the problem of life-cycle cost or risk optimization,…

Computation · Statistics 2020-07-09 H. M. Kroetz , M. Moustapha , A. T. Beck , B. Sudret