English
Related papers

Related papers: Automatic Generation of Algorithms for Black-Box R…

200 papers

As machine learning black boxes are increasingly being deployed in real-world applications, there has been a growing interest in developing post hoc explanations that summarize the behaviors of these black boxes. However, existing…

Machine Learning · Computer Science 2020-11-13 Himabindu Lakkaraju , Nino Arsov , Osbert Bastani

Many expensive black-box optimisation problems are sensitive to their inputs. In these problems it makes more sense to locate a region of good designs, than a single-possibly fragile-optimal design. Expensive black-box functions can be…

Machine Learning · Computer Science 2021-12-16 Nicholas D. Sanders , Richard M. Everson , Jonathan E. Fieldsend , Alma A. M. Rahat

We introduce Adaptive Procedural Task Generation (APT-Gen), an approach to progressively generate a sequence of tasks as curricula to facilitate reinforcement learning in hard-exploration problems. At the heart of our approach, a task…

Machine Learning · Computer Science 2021-03-19 Kuan Fang , Yuke Zhu , Silvio Savarese , Li Fei-Fei

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

There is a great need for improved statistical sampling in a range of physical, chemical and biological systems. Even simulations based on correct algorithms suffer from statistical error, which can be substantial or even dominant when slow…

Computational Physics · Physics 2007-11-09 F. Marty Ytreberg , Daniel M. Zuckerman

We propose a novel approach for using unsupervised boosting to create an ensemble of generative models, where models are trained in sequence to correct earlier mistakes. Our meta-algorithmic framework can leverage any existing base learner…

Machine Learning · Computer Science 2017-12-25 Aditya Grover , Stefano Ermon

Testing algorithms across a wide range of problem instances is crucial to ensure the validity of any claim about one algorithm's superiority over another. However, when it comes to inference algorithms for probabilistic logic programs,…

Logic in Computer Science · Computer Science 2020-09-14 Paulius Dilkas , Vaishak Belle

Generative molecular design has moved from proof-of-concept to real-world applicability, as marked by the surge in very recent papers reporting experimental validation. Key challenges in explainability and sample efficiency present…

Biomolecules · Quantitative Biology 2024-03-05 Jeff Guo , Philippe Schwaller

The dose delivered to the planning target volume by proton beams is highly conformal, sparing organs at risk and normal tissues. New treatment planning systems adapted to spot scanning techniques have been recently proposed to…

Medical Physics · Physics 2022-05-18 François Smekens , Nicolas Freud , Bruno Sixou , Guillaume Beslon , Jean M Létang

Optimizing functions without access to gradients is the remit of black-box methods such as evolution strategies. While highly general, their learning dynamics are often times heuristic and inflexible - exactly the limitations that…

Neural and Evolutionary Computing · Computer Science 2023-03-03 Robert Tjarko Lange , Tom Schaul , Yutian Chen , Tom Zahavy , Valentin Dallibard , Chris Lu , Satinder Singh , Sebastian Flennerhag

Genetic algorithms are heuristic optimization techniques inspired by Darwinian evolution, which are characterized by successfully finding robust solutions for optimization problems. Here, we propose a subroutine-based quantum genetic…

Quantum Physics · Physics 2024-06-07 Rubén Ibarrondo , Giancarlo Gatti , Mikel Sanz

Finding the best configuration of algorithms' hyperparameters for a given optimization problem is an important task in evolutionary computation. We compare in this work the results of four different hyperparameter tuning approaches for a…

Neural and Evolutionary Computing · Computer Science 2022-03-18 Furong Ye , Carola Doerr , Hao Wang , Thomas Bäck

Meta-heuristics are powerful tools for solving optimization problems whose structural properties are unknown or cannot be exploited algorithmically. We propose such a meta-heuristic for a large class of optimization problems over discrete…

Discrete Mathematics · Computer Science 2021-06-22 Moritz Mühlenthaler , Alexander Raß , Manuel Schmitt , Rolf Wanka

Motivated by the problem of tuning hyperparameters in machine learning, we present a new approach for gradually and adaptively optimizing an unknown function using estimated gradients. We validate the empirical performance of the proposed…

Machine Learning · Computer Science 2019-06-05 Weijia Shao , Christian Geißler , Fikret Sivrikaya

A recently introduced general-purpose heuristic for finding high-quality solutions for many hard optimization problems is reviewed. The method is inspired by recent progress in understanding far-from-equilibrium phenomena in terms of {\em…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stefan Boettcher , Allon G. Percus

Challenges in natural sciences can often be phrased as optimization problems. Machine learning techniques have recently been applied to solve such problems. One example in chemistry is the design of tailor-made organic materials and…

Neural and Evolutionary Computing · Computer Science 2020-01-17 AkshatKumar Nigam , Pascal Friederich , Mario Krenn , Alán Aspuru-Guzik

The art of heuristic design has traditionally been a human pursuit. While Large Language Models (LLMs) can generate code for search heuristics, their application has largely been confined to adjusting simple functions within human-crafted…

Artificial Intelligence · Computer Science 2025-09-03 Guorui Quan , Mingfei Sun , Manuel López-Ibáñez

We present a new optimization method for the group selection problem in linear regression. In this problem, predictors are assumed to have a natural group structure and the goal is to select a small set of groups that best fits the…

Methodology · Statistics 2024-04-23 Anant Mathur , Sarat Moka , Benoit Liquet , Zdravko Botev

Simulation is increasingly being used for generating large labelled datasets in many machine learning problems. Recent methods have focused on adjusting simulator parameters with the goal of maximising accuracy on a validation task, usually…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Harkirat Singh Behl , Atılım Güneş Baydin , Ran Gal , Philip H. S. Torr , Vibhav Vineet

We solve robot trajectory planning problems at industry-relevant scales. Our end-to-end solution integrates highly versatile random-key algorithms with model stacking and ensemble techniques, as well as path relinking for solution…