English
Related papers

Related papers: Meta Learning Black-Box Population-Based Optimizer…

200 papers

POMDPs capture a broad class of decision making problems, but hardness results suggest that learning is intractable even in simple settings due to the inherent partial observability. However, in many realistic problems, more information is…

Machine Learning · Computer Science 2023-02-07 Jonathan N. Lee , Alekh Agarwal , Christoph Dann , Tong Zhang

Multi-objective optimization problems (MOPs) require the simultaneous optimization of conflicting objectives. Real-world MOPs often exhibit complex characteristics, including high-dimensional decision spaces, many objectives, or…

Neural and Evolutionary Computing · Computer Science 2025-10-20 Haokai Hong , Liang Feng , Min Jiang , Kay Chen Tan

We present a meta-algorithm for learning a posterior-inference algorithm for restricted probabilistic programs. Our meta-algorithm takes a training set of probabilistic programs that describe models with observations, and attempts to learn…

Machine Learning · Computer Science 2021-12-28 Gwonsoo Che , Hongseok Yang

Learning-to-optimize leverages machine learning to accelerate optimization algorithms. While empirical results show tremendous improvements compared to classical optimization algorithms, theoretical guarantees are mostly lacking, such that…

Machine Learning · Computer Science 2025-06-02 Michael Sucker , Peter Ochs

Real-world applications involve various discrete optimization problems. Designing a specialized optimizer for each of these problems is challenging, typically requiring significant domain knowledge and human efforts. Hence, developing…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Shengcai Liu , Zhiyuan Wang , Yew-Soon Ong , Xin Yao , Ke Tang

Meta-Black-Box Optimization (MetaBBO) garners attention due to its success in automating the configuration and generation of black-box optimizers, significantly reducing the human effort required for optimizer design and discovering…

Machine Learning · Computer Science 2025-05-20 Jiyuan Pei , Yi Mei , Jialin Liu , Mengjie Zhang

We present a model-free reinforcement learning algorithm to find an optimal policy for a finite-horizon Markov decision process while guaranteeing a desired lower bound on the probability of satisfying a signal temporal logic (STL)…

Systems and Control · Electrical Eng. & Systems 2021-09-29 Krishna C. Kalagarla , Rahul Jain , Pierluigi Nuzzo

Data-efficient learning algorithms are essential in many practical applications for which data collection is expensive, e.g., for the optimal deployment of wireless systems in unknown propagation scenarios. Meta-learning can address this…

Machine Learning · Computer Science 2022-05-25 Ivana Nikoloska , Osvaldo Simeone

We study zeroth-order optimization where solutions must minimize a cost $d(s)$ while maintaining high probability under a complex generative prior $L(s)$ (e.g., a parameterized model). This reduces to sampling from a target distribution…

Machine Learning · Computer Science 2026-05-06 Pranjal Awasthi , Sreenivas Gollapudi , Ravi Kumar , Kamesh Munagala

Dynamic Optimization Problems (DOPs) are challenging to address due to their complex nature, i.e., dynamic environment variation. Evolutionary Computation methods are generally advantaged in solving DOPs since they resemble dynamic…

Neural and Evolutionary Computing · Computer Science 2026-02-02 Zijian Gao , Yuanting Zhong , Zeyuan Ma , Yue-Jiao Gong , Hongshu Guo

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

Machine Learning · Computer Science 2022-06-14 Kostiantyn Khabarlak

Quality-Diversity has emerged as a powerful family of evolutionary algorithms that generate diverse populations of high-performing solutions by implementing local competition principles inspired by biological evolution. While these…

Neural and Evolutionary Computing · Computer Science 2025-02-05 Maxence Faldor , Robert Tjarko Lange , Antoine Cully

Learned optimizers -- neural networks that are trained to act as optimizers -- have the potential to dramatically accelerate training of machine learning models. However, even when meta-trained across thousands of tasks at huge…

Machine Learning · Computer Science 2022-09-23 James Harrison , Luke Metz , Jascha Sohl-Dickstein

Population-based evolutionary algorithms are often considered when approaching computationally expensive black-box optimization problems. They employ a selection mechanism to choose the best solutions from a given population after comparing…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Judith Echevarrieta , Etor Arza , Aritz Pérez

The broader application of reinforcement learning (RL) is limited by challenges including data efficiency, generalization capability, and ability to learn in sparse-reward environments. Meta-learning has emerged as a promising approach to…

Machine Learning · Computer Science 2026-03-05 Octavio Pappalardo , Rodrigo Ramele , Juan Miguel Santos

We consider the problem of finding the best memoryless stochastic policy for an infinite-horizon partially observable Markov decision process (POMDP) with finite state and action spaces with respect to either the discounted or mean reward…

Optimization and Control · Mathematics 2022-05-02 Johannes Müller , Guido Montúfar

Deep learning models require a large amount of data to perform well. When data is scarce for a target task, we can transfer the knowledge gained by training on similar tasks to quickly learn the target. A successful approach is…

Machine Learning · Computer Science 2021-03-18 Alberto Bernacchia

Challenging optimization problems, which elude acceptable solution via conventional calculus methods, arise commonly in different areas of industrial design and practice. Hard optimization problems are those who manifest the following…

Machine Learning · Computer Science 2013-12-03 Loris Serafino

How can robots learn and adapt to new tasks and situations with little data? Systematic exploration and simulation are crucial tools for efficient robot learning. We present a novel black-box policy search algorithm focused on…

Robotics · Computer Science 2025-02-11 Shiming He , Alexander von Rohr , Dominik Baumann , Ji Xiang , Sebastian Trimpe

Meta-learning has been proposed as a promising machine learning topic in recent years, with important applications to image classification, robotics, computer games, and control systems. In this paper, we study the problem of using…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Yunian Pan , Tao Li , Quanyan Zhu