English
Related papers

Related papers: Discovering Evolution Strategies via Meta-Black-Bo…

200 papers

We hypothesize that curiosity is a mechanism found by evolution that encourages meaningful exploration early in an agent's life in order to expose it to experiences that enable it to obtain high rewards over the course of its lifetime. We…

Machine Learning · Computer Science 2020-03-12 Ferran Alet , Martin F. Schneider , Tomas Lozano-Perez , Leslie Pack Kaelbling

Bayesian optimization (BO) is a successful methodology to optimize black-box functions that are expensive to evaluate. While traditional methods optimize each black-box function in isolation, there has been recent interest in speeding up BO…

Machine Learning · Statistics 2019-09-30 Valerio Perrone , Huibin Shen , Matthias Seeger , Cedric Archambeau , Rodolphe Jenatton

We discuss a new optimization strategy, which considerably improves the effectivity of evolutionary algorithms applied to a certain class of optimization problems. The basic principle is to solve first a simpler related problem, which is…

Disordered Systems and Neural Networks · Physics 2007-05-23 Volkhard Buchholtz , Thorsten Poeschel

In this work we show that Evolution Strategies (ES) are a viable method for learning non-differentiable parameters of large supervised models. ES are black-box optimization algorithms that estimate distributions of model parameters; however…

Neural and Evolutionary Computing · Computer Science 2019-06-10 Karel Lenc , Erich Elsen , Tom Schaul , Karen Simonyan

Control of chaotic systems to given targets is a subject of substantial and well-developed research issue in nonlinear science, which can be formulated as a class of multi-modal constrained numerical optimization problem with…

Optimization and Control · Mathematics 2016-06-08 Yudong Wang , Xiaoyi Feng , Xin Lyu , Zhengyang Li , Bo Liu

We study the well-motivated problem of online distribution shift in which the data arrive in batches and the distribution of each batch can change arbitrarily over time. Since the shifts can be large or small, abrupt or gradual, the length…

Machine Learning · Computer Science 2025-04-11 Dheeraj Baby , Boran Han , Shuai Zhang , Cuixiong Hu , Yuyang Wang , Yu-Xiang Wang

With the growing deployment of sequential recommender systems in e-commerce and other fields, their black-box interfaces raise security concerns: models are vulnerable to extraction and subsequent adversarial manipulation. Existing…

Information Retrieval · Computer Science 2026-02-13 Hongyue Zhang , Mingming Li , Dongqin Liu , Hui Wang , Yaning Zhang , Xi Zhou , Honglei Lv , Jiao Dai , Jizhong Han

We develop algorithms capable of tackling robust black-box optimisation problems, where the number of model runs is limited. When a desired solution cannot be implemented exactly the aim is to find a robust one, where the worst case in an…

Optimization and Control · Mathematics 2020-04-17 Martin Hughes , Marc Goerigk , Trivikram Dokka

In this paper we propose a novel method for learning how algorithms perform. Classically, algorithms are compared on a finite number of existing (or newly simulated) benchmark datasets based on some fixed metrics. The algorithm(s) with the…

Data Structures and Algorithms · Computer Science 2019-11-01 Henry Wilde , Vincent Knight , Jonathan Gillard

Although deep reinforcement learning methods can learn effective policies for challenging problems such as Atari games and robotics tasks, algorithms are complex, and training times are often long. This study investigates how Evolution…

Machine Learning · Computer Science 2024-07-25 Annie Wong , Jacob de Nobel , Thomas Bäck , Aske Plaat , Anna V. Kononova

Control policies, trained using the Deep Reinforcement Learning, have been recently shown to be vulnerable to adversarial attacks introducing even very small perturbations to the policy input. The attacks proposed so far have been designed…

Machine Learning · Computer Science 2019-08-02 Alessio Russo , Alexandre Proutiere

Many real-world problems are usually computationally costly and the objective functions evolve over time. Data-driven, a.k.a. surrogate-assisted, evolutionary optimization has been recognized as an effective approach for tackling expensive…

Neural and Evolutionary Computing · Computer Science 2022-11-08 Ke Li , Renzhi Chen , Xin Yao

This paper explores a novel approach aimed at overcoming existing challenges in the realm of local search algorithms. Our aim is to improve the decision process that takes place within a local search algorithm so as to make the best…

Neural and Evolutionary Computing · Computer Science 2025-03-13 Mohamed Salim Amri Sakhri , Adrien Goëffon , Olivier Goudet , Frédéric Saubion , Chaïmaâ Touhami

Black-box attack methods aim to infer suitable attack patterns to targeted DNN models by only using output feedback of the models and the corresponding input queries. However, due to lack of prior and inefficiency in leveraging the query…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Jiawei Du , Hu Zhang , Joey Tianyi Zhou , Yi Yang , Jiashi Feng

The most data-efficient algorithms for reinforcement learning in robotics are model-based policy search algorithms, which alternate between learning a dynamical model of the robot and optimizing a policy to maximize the expected return…

Robotics · Computer Science 2018-03-14 Konstantinos Chatzilygeroudis , Jean-Baptiste Mouret

In this paper, we approach the problem of optimizing blackbox functions over large hybrid search spaces consisting of both combinatorial and continuous parameters. We demonstrate that previous evolutionary algorithms which rely on…

We present a meta-algorithm for learning a posterior-inference algorithm for restricted probabilistic programs. Our meta-algorithm takes a training set of probabilistic programs that describe models with observations, and attempts to learn…

Machine Learning · Computer Science 2021-12-28 Gwonsoo Che , Hongseok Yang

Black-box problems are common in real life like structural design, drug experiments, and machine learning. When optimizing black-box systems, decision-makers always consider multiple performances and give the final decision by comprehensive…

Machine Learning · Computer Science 2021-01-22 Wenjie Chen , Shengcai Liu , Ke Tang

Bayesian meta-learning enables robust and fast adaptation to new tasks with uncertainty assessment. The key idea behind Bayesian meta-learning is empirical Bayes inference of hierarchical model. In this work, we extend this framework to…

Machine Learning · Computer Science 2020-11-19 Yayi Zou , Xiaoqi Lu

Recent work has shown how easily white-box adversarial attacks can be applied to state-of-the-art image classifiers. However, real-life scenarios resemble more the black-box adversarial conditions, lacking transparency and usually imposing…

Cryptography and Security · Computer Science 2021-07-14 Andrei Ilie , Marius Popescu , Alin Stefanescu