English
Related papers

Related papers: Evaluating Noisy Optimisation Algorithms: First Hi…

200 papers

The fragility of deep neural networks to adversarially-chosen inputs has motivated the need to revisit deep learning algorithms. Including adversarial examples during training is a popular defense mechanism against adversarial attacks. This…

Optimization and Control · Mathematics 2020-05-05 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

Stochastic computer simulations enable users to gain new insights into complex physical systems. Optimization is a common problem in this context: users seek to find model inputs that maximize the expected value of an objective function.…

Optimization and Control · Mathematics 2018-09-13 Atiye Alaeddini , Daniel J. Klein

A novel quickest detection setting is proposed which is a generalization of the well-known Bayesian change-point detection model. Suppose \{(X_i,Y_i)\}_{i\geq 1} is a sequence of pairs of random variables, and that S is a stopping time with…

Statistics Theory · Mathematics 2016-11-17 Urs Niesen , Aslan Tchamkerten

In this paper, we study the optimal stopping problem in the so-called exploratory framework, in which the agent takes actions randomly conditioning on current state and an entropy-regularized term is added to the reward functional. Such a…

Optimization and Control · Mathematics 2023-09-04 Yuchao Dong

Bayesian Optimization is the state of the art technique for the optimization of black boxes, i.e., functions where we do not have access to their analytical expression nor its gradients, they are expensive to evaluate and its evaluation is…

Artificial Intelligence · Computer Science 2021-01-13 Eduardo C. Garrido Merchán , Luis C. Jariego Pérez

We consider the problem of system identification of partially observed linear time-invariant (LTI) systems. Given input-output data, we provide non-asymptotic guarantees for identifying the system parameters under general heavy-tailed noise…

Systems and Control · Electrical Eng. & Systems 2025-04-28 Vinay Kanakeri , Aritra Mitra

Novel reinforcement learning algorithms, or improvements on existing ones, are commonly justified by evaluating their performance on benchmark environments and are compared to an ever-changing set of standard algorithms. However, despite…

Machine Learning · Computer Science 2024-06-25 Scott M. Jordan , Adam White , Bruno Castro da Silva , Martha White , Philip S. Thomas

Fair algorithm evaluation is conditioned on the existence of high-quality benchmark datasets that are non-redundant and are representative of typical optimization scenarios. In this paper, we evaluate three heuristics for selecting diverse…

Neural and Evolutionary Computing · Computer Science 2022-04-26 Gjorgjina Cenikj , Ryan Dieter Lang , Andries Petrus Engelbrecht , Carola Doerr , Peter Korošec , Tome Eftimov

Ising machines are novel computing devices for the energy minimization of Ising models. These combinatorial optimization problems are of paramount importance for science and technology, but remain difficult to tackle on large scale by…

Optics · Physics 2020-04-28 Davide Pierangeli , Giulia Marcucci , Daniel Brunner , Claudio Conti

We present a comparison between various algorithms of inference of covariance and precision matrices in small datasets of real vectors, of the typical length and dimension of human brain activity time series retrieved by functional Magnetic…

Statistical Mechanics · Physics 2023-02-07 Miguel Ibáñez-Berganza , Carlo Lucibello , Francesca Santucci , Tommaso Gili , Andrea Gabrielli

Comparing, or benchmarking, of optimization algorithms is a complicated task that involves many subtle considerations to yield a fair and unbiased evaluation. In this paper, we systematically review the benchmarking process of optimization…

Optimization and Control · Mathematics 2017-09-26 Vahid Beiranvand , Warren Hare , Yves Lucet

Optimisation algorithms are commonly compared on benchmarks to get insight into performance differences. However, it is not clear how closely benchmarks match the properties of real-world problems because these properties are largely…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Koen van der Blom , Timo M. Deist , Vanessa Volz , Mariapia Marchi , Yusuke Nojima , Boris Naujoks , Akira Oyama , Tea Tušar

We initiate the study of stochastic optimization with oblivious noise, broadly generalizing the standard heavy-tailed noise setup. In our setting, in addition to random observation noise, the stochastic gradient may be subject to…

Data Structures and Algorithms · Computer Science 2024-08-06 Ilias Diakonikolas , Sushrut Karmalkar , Jongho Park , Christos Tzamos

In group testing, the goal is to identify a subset of defective items within a larger set of items based on tests whose outcomes indicate whether at least one defective item is present. This problem is relevant in areas such as medical…

Information Theory · Computer Science 2022-10-24 Eric Price , Jonathan Scarlett , Nelvin Tan

The hope of the quantum computing field is that quantum architectures are able to scale up and realize fault-tolerant quantum computing. Due to engineering challenges, such ''cheap'' error correction may be decades away. In the meantime, we…

Quantum Physics · Physics 2025-02-17 Rutuja Kshirsagar , Amara Katabarwa , Peter D. Johnson

Runtime analysis has produced many results on the efficiency of simple evolutionary algorithms like the (1+1) EA, and its analogue called GSEMO in evolutionary multiobjective optimisation (EMO). Recently, the first runtime analyses of the…

Neural and Evolutionary Computing · Computer Science 2023-06-08 Duc-Cuong Dang , Andre Opris , Bahare Salehi , Dirk Sudholt

We study momentum-based first-order optimization algorithms in which the iterations utilize information from the two previous steps and are subject to an additive white noise. This setup uses noise to account for uncertainty in either…

Optimization and Control · Mathematics 2024-06-21 Hesameddin Mohammadi , Meisam Razaviyayn , Mihailo R. Jovanović

Performance analysis of all kinds of randomised search heuristics is a rapidly growing and developing field. Run time and solution quality are two popular measures of the performance of these algorithms. The focus of this paper is on the…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Jun He , Thomas Jansen , Christine Zarges

Simulating real-time dynamics under a Hamiltonian is a central goal of quantum information science. While numerous Hamiltonian-simulation quantum algorithms have been proposed, the effects of physical noise have rarely been incorporated…

Quantum Physics · Physics 2026-03-13 Keisuke Murota , Synge Todo , Suguru Endo

In this paper we address the problem of designing an interruptible system in a setting in which $n$ problem instances, all equally important, must be solved concurrently. The system involves scheduling executions of contract algorithms…

Data Structures and Algorithms · Computer Science 2018-10-29 Spyros Angelopoulos , Alejandro Lopez-Ortiz