English
Related papers

Related papers: Optimization of noisy blackboxes with adaptive pre…

200 papers

In noisy evolutionary optimization, sampling is a common strategy to deal with noise. By the sampling strategy, the fitness of a solution is evaluated multiple times (called \emph{sample size}) independently, and its true fitness is then…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Chao Bian , Yang Yu , Ke Tang , Xin Yao

The data-centric machine learning aims to find effective ways to build appropriate datasets which can improve the performance of AI models. In this paper, we mainly focus on designing an efficient data-centric scheme to improve robustness…

Machine Learning · Computer Science 2022-03-09 Xiaogeng Liu , Haoyu Wang , Yechao Zhang , Fangzhou Wu , Shengshan Hu

We consider learning to optimize a classification metric defined by a black-box function of the confusion matrix. Such black-box learning settings are ubiquitous, for example, when the learner only has query access to the metric of…

Machine Learning · Computer Science 2021-06-25 Gaurush Hiranandani , Jatin Mathur , Harikrishna Narasimhan , Mahdi Milani Fard , Oluwasanmi Koyejo

We address the problem of minimizing a smooth function $f^0(x)$ over a compact set $D$ defined by smooth functional constraints $f^i(x)\leq 0,~ i = 1,\ldots, m$ given noisy value measurements of $f^i(x)$. This problem arises in…

Optimization and Control · Mathematics 2019-12-20 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

Learning unnormalized statistical models (e.g., energy-based models) is computationally challenging due to the complexity of handling the partition function. To eschew this complexity, noise-contrastive estimation~(NCE) has been proposed by…

Machine Learning · Computer Science 2023-06-14 Wei Jiang , Jiayu Qin , Lingyu Wu , Changyou Chen , Tianbao Yang , Lijun Zhang

The quadratic system provided by the Time of Arrival technique can be solved analytical or by optimization algorithms. In real environments the measurements are always corrupted by noise. This measurement noise effects the analytical…

Signal Processing · Electrical Eng. & Systems 2018-02-08 Juri Sidorenko , Leo Doktorski , Volker Schatz , Norbert Scherer-Negenborn , Michael Arens

In this paper, we propose an approach to address the problems with ambiguity in tuning the process and observation noises for a discrete-time linear Kalman filter. Conventional approaches to tuning (e.g. using normalized estimation error…

Systems and Control · Electrical Eng. & Systems 2021-08-25 Zhaozhong Chen , Christoffer Heckman , Simon Julier , Nisar Ahmed

Stochastic programs where the uncertainty distribution must be inferred from noisy data samples are considered. The stochastic programs are approximated with distributionally-robust optimizations that minimize the worst-case expected cost…

Optimization and Control · Mathematics 2024-01-04 Farhad Farokhi

When a black-box optimization objective can only be evaluated with costly or noisy measurements, most standard optimization algorithms are unsuited to find the optimal solution. Specialized algorithms that deal with exactly this situation…

Machine Learning · Computer Science 2021-06-11 Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

Machine Learning · Computer Science 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney

In recent years, solving optimization problems involving black-box simulators has become a point of focus for the machine learning community due to their ubiquity in science and engineering. The simulators describe a forward process…

Machine Learning · Computer Science 2024-06-07 Fabio Valerio Massoli , Tim Bakker , Thomas Hehn , Tribhuvanesh Orekondy , Arash Behboodi

Computing derivatives of noisy measurement data is ubiquitous in the physical, engineering, and biological sciences, and it is often a critical step in developing dynamic models or designing control. Unfortunately, the mathematical…

Dynamical Systems · Mathematics 2020-09-09 Floris van Breugel , J. Nathan Kutz , Bingni W. Brunton

Optimizing noisy functions online, when evaluating the objective requires experiments on a deployed system, is a crucial task arising in manufacturing, robotics and many others. Often, constraints on safe inputs are unknown ahead of time,…

Optimization and Control · Mathematics 2023-06-06 Ilnura Usmanova , Yarden As , Maryam Kamgarpour , Andreas Krause

The goal of a denoising algorithm is to recover a signal from its noise-corrupted observations. Perfect recovery is seldom possible and performance is measured under a given single-letter fidelity criterion. For discrete signals corrupted…

Information Theory · Computer Science 2007-07-13 George Gemelos , Styrmir Sigurjonsson , Tsachy Weissman

Solving optimization problems in which functions are blackboxes and variables involve different types poses significant theoretical and algorithmic challenges. Nevertheless, such settings frequently occur in simulation-based engineering…

Optimization and Control · Mathematics 2025-06-25 Charles Audet , Youssef Diouane , Edward Hallé-Hannan , Sébastien Le Digabel , Christophe Tribes

Given a set of human's decisions that are observed, inverse optimization has been developed and utilized to infer the underlying decision making problem. The majority of existing studies assumes that the decision making problem is with a…

Machine Learning · Statistics 2018-08-03 Chaosheng Dong , Bo Zeng

This work considers stochastic optimization problems in which the objective function values can only be computed by a blackbox corrupted by some random noise following an unknown distribution. The proposed method is based on sequential…

Optimization and Control · Mathematics 2023-08-15 Charles Audet , Jean Bigeon , Romain Couderc , Michael Kokkolaras

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

Decentralized optimization is typically studied under the assumption of noise-free transmission. However, real-world scenarios often involve the presence of noise due to factors such as additive white Gaussian noise channels or…

Optimization and Control · Mathematics 2023-07-28 Suhail M. Shah , Raghu Bollapragada

We consider an agent trying to bring a system to an acceptable state by repeated probabilistic action. Several recent works on algorithmizations of the Lovasz Local Lemma (LLL) can be seen as establishing sufficient conditions for the agent…

Discrete Mathematics · Computer Science 2016-11-29 Dimitris Achlioptas , Fotis Iliopoulos , Nikos Vlassis