English
Related papers

Related papers: An improved educational competition optimizer with…

200 papers

In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization (CBO) can exploit the causal…

Machine Learning · Statistics 2025-02-21 Shriya Bhatija , Paul-David Zuercher , Jakob Thumm , Thomas Bohné

Many robotics problems, from robot motion planning to object manipulation, can be modeled as mixed-integer convex programs (MICPs). However, state-of-the-art algorithms are still unable to solve MICPs for control problems quickly enough for…

Robotics · Computer Science 2021-07-20 A. Cauligi , P. Culbertson , E. Schmerling , M. Schwager , B. Stellato , M. Pavone

Ant Colony Optimization (ACO) is a meta-heuristic algorithm that has been successfully applied to various Combinatorial Optimization Problems (COPs). Traditionally, customizing ACO for a specific problem requires the expert design of…

Neural and Evolutionary Computing · Computer Science 2023-11-07 Haoran Ye , Jiarui Wang , Zhiguang Cao , Helan Liang , Yong Li

Many real-world optimization problems involve uncertain parameters with probability distributions that can be estimated using contextual feature information. In contrast to the standard approach of first estimating the distribution of…

Machine Learning · Statistics 2023-08-03 Meng Qi , Paul Grigas , Zuo-Jun Max Shen

Recently, the Deep Learning community has become interested in evolutionary optimization (EO) as a means to address hard optimization problems, e.g. meta-learning through long inner loop unrolls or optimizing non-differentiable operators.…

Neural and Evolutionary Computing · Computer Science 2023-11-07 Robert Tjarko Lange , Yujin Tang , Yingtao Tian

The optimization algorithm and its hyperparameters can significantly affect the training speed and resulting model accuracy in machine learning applications. The wish list for an ideal optimizer includes fast and smooth convergence to low…

Machine Learning · Computer Science 2024-02-20 Marco Eckhoff , Markus Reiher

Combinatorial Optimization (CO) has been a long-standing challenging research topic featured by its NP-hard nature. Traditionally such problems are approximately solved with heuristic algorithms which are usually fast but may sacrifice the…

Machine Learning · Computer Science 2021-10-26 Runzhong Wang , Zhigang Hua , Gan Liu , Jiayi Zhang , Junchi Yan , Feng Qi , Shuang Yang , Jun Zhou , Xiaokang Yang

The field of Contextual Optimization (CO) integrates machine learning and optimization to solve decision making problems under uncertainty. Recently, a risk sensitive variant of CO, known as Conditional Robust Optimization (CRO), combines…

Machine Learning · Computer Science 2024-03-08 Abhilash Chenreddy , Erick Delage

PDE-Constrained Optimization (PDECO) problems can be accelerated significantly by employing gradient-based methods with surrogate models like neural operators compared to traditional numerical solvers. However, this approach faces two key…

Machine Learning · Computer Science 2025-06-17 Ze Cheng , Zhuoyu Li , Xiaoqiang Wang , Jianing Huang , Zhizhou Zhang , Zhongkai Hao , Hang Su

Electromagnetismlike Optimization (EMO) is a global optimization algorithm, particularly well suited to solve problems featuring nonlinear and multimodal cost functions. EMO employs searcher agents that emulate a population of charged…

Artificial Intelligence · Computer Science 2014-05-21 Erik Cuevas , Diego Oliva , Daniel Zaldivar , Marco Perez , Gonzalo Pajares

Recent reinforcement learning studies extensively explore the interplay between cooperative and competitive behaviour in mixed environments. Unlike cooperative environments where agents strive towards a common goal, mixed environments are…

Machine Learning · Computer Science 2021-02-25 Dmitry Ivanov , Vladimir Egorov , Aleksei Shpilman

Machine learning problems with multiple objective functions appear either in learning with multiple criteria where learning has to make a trade-off between multiple performance metrics such as fairness, safety and accuracy; or, in…

Machine Learning · Computer Science 2024-03-20 Heshan Fernando , Han Shen , Miao Liu , Subhajit Chaudhury , Keerthiram Murugesan , Tianyi Chen

Relevant combinatorial optimization problems (COPs) are often NP-hard. While they have been tackled mainly via handcrafted heuristics in the past, advances in neural networks have motivated the development of general methods to learn…

Machine Learning · Computer Science 2025-09-05 Tim Dernedde , Daniela Thyssens , Sören Dittrich , Maximilian Stubbemann , Lars Schmidt-Thieme

Proximal policy optimization (PPO) algorithm is a deep reinforcement learning algorithm with outstanding performance, especially in continuous control tasks. But the performance of this method is still affected by its exploration ability.…

Machine Learning · Computer Science 2020-11-12 Junwei Zhang , Zhenghao Zhang , Shuai Han , Shuai Lü

First-order methods for stochastic optimization have undeniable relevance, in part due to their pivotal role in machine learning. Variance reduction for these algorithms has become an important research topic. In contrast to common…

Machine Learning · Computer Science 2021-09-08 Manuel Madeira , Renato Negrinho , João Xavier , Pedro M. Q. Aguiar

Recent advances in Large Language Models (LLMs) have permitted the development of language-guided multi-robot systems, which allow robots to execute tasks based on natural language instructions. However, achieving effective coordination in…

Robotics · Computer Science 2025-07-24 Yoshiki Yano , Kazuki Shibata , Maarten Kokshoorn , Takamitsu Matsubara

Recent deep reinforcement learning methods have achieved remarkable success in solving multi-objective combinatorial optimization problems (MOCOPs) by decomposing them into multiple subproblems, each associated with a specific weight…

Artificial Intelligence · Computer Science 2026-03-23 Mingfeng Fan , Jianan Zhou , Yifeng Zhang , Yaoxin Wu , Jinbiao Chen , Guillaume Adrien Sartoretti

In expensive multi-objective optimization, where the evaluation budget is strictly limited, selecting promising candidate solutions for expensive fitness evaluations is critical for accelerating convergence and improving algorithmic…

Neural and Evolutionary Computing · Computer Science 2025-06-16 Huixiang Zhen , Xiaotong Li , Wenyin Gong , Xiangyun Hu

Learned optimization has emerged as a promising alternative to hand-crafted optimizers, with the potential to discover stronger learned update rules that enable faster, hyperparameter-free training of neural networks. A critical element for…

Machine Learning · Computer Science 2025-06-23 Abhinav Moudgil , Boris Knyazev , Guillaume Lajoie , Eugene Belilovsky

Metaheuristics are widely applied for their ability to provide more efficient solutions. The RIME algorithm is a recently proposed physical-based metaheuristic algorithm with certain advantages. However, it suffers from rapid loss of…

Neural and Evolutionary Computing · Computer Science 2025-09-12 Shangqing Shi , Luoxiao Zhang , Yuchen Yin , Xiong Yang , Hoileong Lee