English
Related papers

Related papers: How Far Are We From an Optimal, Adaptive DE?

200 papers

The Efficient Global Optimization (EGO) algorithm uses a conditional Gaus-sian Process (GP) to approximate an objective function known at a finite number of observation points and sequentially adds new points which maximize the Expected…

Optimization and Control · Mathematics 2016-03-09 Hossein Mohammadi , Rodolphe Le Riche , Eric Touboul

We present the first PAC optimal algorithm for Bayes-Adaptive Markov Decision Processes (BAMDPs) in continuous state and action spaces, to the best of our knowledge. The BAMDP framework elegantly addresses model uncertainty by incorporating…

Machine Learning · Computer Science 2018-10-09 Gilwoo Lee , Sanjiban Choudhury , Brian Hou , Siddhartha S. Srinivasa

It is well known that exact notions of model abstraction and reduction for dynamical systems may not be robust enough in practice because they are highly sensitive to the specific choice of parameters. In this paper we consider this problem…

Systems and Control · Computer Science 2018-07-19 Luca Cardelli , Mirco Tribastone , Max Tschaikowski , Andrea Vandin

Approaches to self-adaptive software systems use models at runtime to leverage benefits of model-driven engineering (MDE) for providing views on running systems and for engineering feedback loops. Most of these approaches focus on causally…

Software Engineering · Computer Science 2018-05-23 Thomas Vogel , Holger Giese

We generalize the problem of online submodular welfare maximization to incorporate various stochastic elements that have gained significant attention in recent years. We show that a non-adaptive Greedy algorithm, which is oblivious to the…

Data Structures and Algorithms · Computer Science 2026-01-06 Rajan Udwani

Quantum Approximate Optimization Algorithm (QAOA) is one of the most promising quantum heuristics for combinatorial optimization. While QAOA has been shown to perform well on small-scale instances and to provide an asymptotic speedup over…

When solving a PDE problem numerically, a certain mesh-refinement process is always implicit, and very classically, mesh adaptivity is a very effective means to accelerate grid convergence. Similarly, when optimizing a shape by means of an…

Numerical Analysis · Mathematics 2015-09-11 Badr Abou El Majd

What really sparked my interest was how certain parameters worked better at executing and optimization algorithm convergence even though the objective formula had no significant differences. Thus the research question stated: 'Which…

Optimization and Control · Mathematics 2020-09-25 Valdimir Pieter

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

Machine Learning · Computer Science 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

Consider a kidney-exchange application where we want to find a max-matching in a random graph. To find whether an edge $e$ exists, we need to perform an expensive test, in which case the edge $e$ appears independently with a \emph{known}…

Data Structures and Algorithms · Computer Science 2019-02-07 Domagoj Bradac , Sahil Singla , Goran Zuzic

Learning to optimize is an approach that leverages training data to accelerate the solution of optimization problems. Many approaches use unrolling to parametrize the update step and learn optimal parameters. Although L2O has shown…

Optimization and Control · Mathematics 2025-07-15 Patrick Fahy , Mohammad Golbabaee , Matthias J. Ehrhardt

This paper considers online optimization for a system that performs a sequence of back-to-back tasks. Each task can be processed in one of multiple processing modes that affect the duration of the task, the reward earned, and an additional…

Optimization and Control · Mathematics 2024-01-17 Michael J. Neely

``Composable core-sets'' are an efficient framework for solving optimization problems in massive data models. In this work, we consider efficient construction of composable core-sets for the determinant maximization problem. This can also…

Data Structures and Algorithms · Computer Science 2019-07-09 Piotr Indyk , Sepideh Mahabadi , Shayan Oveis Gharan , Alireza Rezaei

Comparison-Based Optimization (CBO) is an optimization paradigm that assumes only very limited access to the objective function f(x). Despite the growing relevance of CBO to real-world applications, this field has received little attention…

Optimization and Control · Mathematics 2023-03-27 Isha Slavin , Daniel McKenzie

In this contribution we apply an adaptive model hierarchy, consisting of a full-order model, a reduced basis reduced order model, and a machine learning surrogate, to parametrized linear-quadratic optimal control problems. The involved…

Optimization and Control · Mathematics 2024-02-19 Hendrik Kleikamp

It is commonly believed that Bayesian optimization (BO) algorithms are highly efficient for optimizing numerically costly functions. However, BO is not often compared to widely different alternatives, and is mostly tested on narrow sets of…

Optimization and Control · Mathematics 2021-10-01 Rodolphe Le Riche , Victor Picheny

One of the problems in applying Genetic Algorithm is that there is some situation where the evolutionary process converges too fast to a solution which causes it to be trapped in local optima. To overcome this problem, a proper diversity in…

Neural and Evolutionary Computing · Computer Science 2011-09-02 Chaiwat Jassadapakorn , Prabhas Chongstitvatana

Most methods for decision-theoretic online learning are based on the Hedge algorithm, which takes a parameter called the learning rate. In most previous analyses the learning rate was carefully tuned to obtain optimal worst-case…

Machine Learning · Statistics 2015-03-04 Tim van Erven , Peter Grünwald , Wouter M. Koolen , Steven de Rooij

The frame algorithm uses a simple recursive formula to approximate an unknown vector from its frame coefficients. This note introduces an adaptive version of the frame algorithm that maximizes the error reduction between steps in terms of…

Functional Analysis · Mathematics 2025-06-24 Brody Dylan Johnson

We study sublinear time algorithms for estimating the size of maximum matching in graphs. Our main result is a $(\frac{1}{2}+\Omega(1))$-approximation algorithm which can be implemented in $O(n^{1+\epsilon})$ time, where $n$ is the number…

Data Structures and Algorithms · Computer Science 2022-06-28 Soheil Behnezhad , Mohammad Roghani , Aviad Rubinstein , Amin Saberi