English
Related papers

Related papers: Beetle Antennae Search without Parameter Tuning (B…

200 papers

Evolutionary algorithms excel in solving complex optimization problems, especially those with multiple objectives. However, their stochastic nature can sometimes hinder rapid convergence to the global optima, particularly in scenarios…

Neural and Evolutionary Computing · Computer Science 2024-05-10 Zeyi Wang , Songbai Liu , Jianyong Chen , Kay Chen Tan

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

There is an increasing need for effective active learning algorithms that are compatible with deep neural networks. This paper motivates and revisits a classic, Fisher-based active selection objective, and proposes BAIT, a practical,…

Machine Learning · Computer Science 2021-12-15 Jordan T. Ash , Surbhi Goel , Akshay Krishnamurthy , Sham Kakade

Controlling antenna tilts in cellular networks is imperative to reach an efficient trade-off between network coverage and capacity. In this paper, we devise algorithms learning optimal tilt control policies from existing data (in the…

Machine Learning · Computer Science 2022-01-07 Filippo Vannella , Alexandre Proutiere , Yassir Jedra , Jaeseong Jeong

The practical use of Bayesian Optimization (BO) in engineering applications imposes special requirements: high sampling efficiency on the one hand and finding a robust solution on the other hand. We address the case of adversarial…

Machine Learning · Computer Science 2024-06-03 Dorina Weichert , Alexander Kister , Sebastian Houben , Patrick Link , Gunar Ernis

Multiobjective blackbox optimization deals with problems where the objective and constraint functions are the outputs of a numerical simulation. In this context, no derivatives are available, nor can they be approximated by finite…

Optimization and Control · Mathematics 2025-04-07 Sébastien Le Digabel , Antoine Lesage-Landry , Ludovic Salomon , Christophe Tribes

Recurrent neural networks (RNNs) are a powerful approach for time series prediction. However, their performance is strongly affected by their architecture and hyperparameter settings. The architecture optimization of RNNs is a…

Machine Learning · Computer Science 2021-04-26 Andrés Camero , Hao Wang , Enrique Alba , Thomas Bäck

Long-horizon planning in realistic environments requires the ability to reason over sequential tasks in high-dimensional state spaces with complex dynamics. Classical motion planning algorithms, such as rapidly-exploring random trees, are…

Robotics · Computer Science 2020-10-14 Brian Ichter , Pierre Sermanet , Corey Lynch

Neural architecture search (NAS) is a recent methodology for automating the design of neural network architectures. Differentiable neural architecture search (DARTS) is a promising NAS approach that dramatically increases search efficiency.…

Machine Learning · Computer Science 2021-04-22 Erik Bodin , Federico Tomasi , Zhenwen Dai

Deploying deep neural networks (DNNs) on microcontrollers (TinyML) is a common trend to process the increasing amount of sensor data generated at the edge, but in practice, resource and latency constraints make it difficult to find optimal…

Machine Learning · Computer Science 2025-01-24 Mark Deutel , Georgios Kontes , Christopher Mutschler , Jürgen Teich

The active search for objects of interest in an unknown environment has many robotics applications including search and rescue, detecting gas leaks or locating animal poachers. Existing algorithms often prioritize the location accuracy of…

Robotics · Computer Science 2021-03-23 Ramina Ghods , William J. Durkin , Jeff Schneider

Applying Bayesian optimization in problems wherein the search space is unknown is challenging. To address this problem, we propose a systematic volume expansion strategy for the Bayesian optimization. We devise a strategy to guarantee that…

Machine Learning · Statistics 2019-10-30 Huong Ha , Santu Rana , Sunil Gupta , Thanh Nguyen , Hung Tran-The , Svetha Venkatesh

Neural architecture search (NAS) is a promising research direction that has the potential to replace expert-designed networks with learned, task-specific architectures. In this work, in order to help ground the empirical results in this…

Machine Learning · Computer Science 2019-08-01 Liam Li , Ameet Talwalkar

Evolutionary algorithms (EAs) are general-purpose problem solvers that usually perform an unbiased search. This is reasonable and desirable in a black-box scenario. For combinatorial optimization problems, often more knowledge about the…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Vahid Roostapour , Jakob Bossek , Frank Neumann

We have used Bayesian Optimisation (BO) to find hyper-parameters in an existing biologically plausible population neural network. The 8-dimensional optimal hyper-parameter combination should be such that the network dynamics simulate the…

Quantitative Methods · Quantitative Biology 2021-04-14 Mahak Kothari , Swapna Sasi , Jun Chen , Elham Zareian , Basabdatta Sen Bhattacharya

Bayesian Active Learning has had significant impact to various NLP problems, but nevertheless it's application to text summarization has been explored very little. We introduce Bayesian Active Summarization (BAS), as a method of combining…

Computation and Language · Computer Science 2021-10-12 Alexios Gidiotis , Grigorios Tsoumakas

Radiation Therapy (RT) plays a pivotal role in the treatment of cancer, offering the potential to effectively target and eliminate tumour cells while minimizing harm to surrounding healthy tissues. However, the success of RT heavily depends…

Medical Physics · Physics 2024-02-16 Keshav Kumar K. , NVSL Narasimham , A. Ramakrishna Prasad

Multi-objective optimization aims at finding trade-off solutions to conflicting objectives. These constitute the Pareto optimal set. In the context of expensive-to-evaluate functions, it is impossible and often non-informative to look for…

Machine Learning · Statistics 2020-02-20 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

In many high-throughput experimental design settings, such as those common in biochemical engineering, batched queries are more cost effective than one-by-one sequential queries. Furthermore, it is often not possible to directly choose…

Machine Learning · Computer Science 2019-04-18 Kevin K. Yang , Yuxin Chen , Alycia Lee , Yisong Yue

The problem of parameterization is often central to the effective deployment of nature-inspired algorithms. However, finding the optimal set of parameter values for a combination of problem instance and solution method is highly…

Neural and Evolutionary Computing · Computer Science 2014-06-26 Matthew Crossley , Andy Nisbet , Martyn Amos