English
Related papers

Related papers: On the Robustness of Median Sampling in Noisy Evol…

200 papers

The sample mean is often used to aggregate different unbiased estimates of a parameter, producing a final estimate that is unbiased but possibly high-variance. This paper introduces the Bayesian median of means, an aggregation rule that…

Statistics Theory · Mathematics 2019-06-05 Paulo Orenstein

Evolutionary algorithms (EAs) are general-purpose optimization algorithms, inspired by natural evolution. Recent theoretical studies have shown that EAs can achieve good approximation guarantees for solving the problem classes of submodular…

Neural and Evolutionary Computing · Computer Science 2022-12-19 Chao Qian , Dan-Xuan Liu , Chao Feng , Ke Tang

Averaging, or smoothing, is a fundamental approach to obtain stable, de-noised estimates from noisy observations. In certain scenarios, observations made along trajectories of random dynamical systems are of particular interest. One popular…

Machine Learning · Statistics 2025-05-19 Frederik Köhne , Anton Schiela

The Covariance Matrix Adaptation Evolutionary Strategy (CMA-ES) is one of the most advanced algorithms in numerical black-box optimization. For noisy objective functions, several approaches were proposed to mitigate the noise, e.g.,…

Neural and Evolutionary Computing · Computer Science 2025-06-04 Catalin-Viorel Dinu , Yash J. Patel , Xavier Bonet-Monroig , Hao Wang

Stochastic, iterative search methods such as Evolutionary Algorithms (EAs) are proven to be efficient optimizers. However, they require evaluation of the candidate solutions which may be prohibitively expensive in many real world…

Neural and Evolutionary Computing · Computer Science 2013-03-12 Maumita Bhattacharya

In this paper, online linear regression in environments corrupted by non-Gaussian noise (especially heavy-tailed noise) is addressed. In such environments, the error between the system output and the label also does not follow a Gaussian…

Information Theory · Computer Science 2021-05-13 Sajjad Bahrami , Ertem Tuncel

Chance constrained optimization problems allow to model problems where constraints involving stochastic components should only be violated with a small probability. Evolutionary algorithms have been applied to this scenario and shown to…

Neural and Evolutionary Computing · Computer Science 2024-08-23 Frank Neumann , Carsten Witt

Model fitting is possibly the most extended problem in science. Classical approaches include the use of least-squares fitting procedures and maximum likelihood methods to estimate the value of the parameters in the model. However, in recent…

Instrumentation and Methods for Astrophysics · Physics 2022-04-12 J. Lopez-Santiago , L. Martino , J. Miguez , M. A. Vazquez

Many evolutionary algorithms (EAs) take advantage of parallel evaluation of candidates. However, if evaluation times vary significantly, many worker nodes (i.e.,\ compute clients) are idle much of the time, waiting for the next generation…

Neural and Evolutionary Computing · Computer Science 2024-01-02 Jason Liang , Hormoz Shahrzad , Risto Miikkulainen

We propose a Bayesian optimization algorithm for objective functions that are sums or integrals of expensive-to-evaluate functions, allowing noisy evaluations. These objective functions arise in multi-task Bayesian optimization for tuning…

Machine Learning · Computer Science 2018-03-26 Saul Toscano-Palmerin , Peter I. Frazier

Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. Evolutionary algorithms are used to adapt…

Artificial Intelligence · Computer Science 2016-11-17 Ajith Abraham

We consider constrained optimization problems with a nonsmooth objective function in the form of mathematical expectation. The Sample Average Approximation (SAA) is used to estimate the objective function and variable sample size strategy…

Optimization and Control · Mathematics 2022-08-09 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

Evolutionary algorithms (EAs) are heuristic algorithms inspired by natural evolution. They are often used to obtain satisficing solutions in practice. In this paper, we investigate a largely underexplored issue: the approximation…

Neural and Evolutionary Computing · Computer Science 2015-03-17 Yang Yu , Xin Yao , Zhi-Hua Zhou

A wide variety of optimization techniques, both exact and heuristic, tend to be biased samplers. This means that when attempting to find multiple uncorrelated solutions of a degenerate Boolean optimization problem a subset of the solution…

Disordered Systems and Neural Networks · Physics 2019-05-14 Andrew J. Ochoa , Darryl C. Jacob , Salvatore Mandrà , Helmut G. Katzgraber

The test bench time needed for model-based calibration can be reduced with active learning methods for test design. This paper presents an improved strategy for active output selection. This is the task of learning multiple models in the…

Machine Learning · Computer Science 2021-01-12 Adrian Prochaska , Julien Pillas , Bernard Bäker

Neural network models for audio tasks, such as automatic speech recognition (ASR) and acoustic scene classification (ASC), are susceptible to noise contamination for real-life applications. To improve audio quality, an enhancement module,…

A core feature of evolutionary algorithms is their mutation operator. Recently, much attention has been devoted to the study of mutation operators with dynamic and non-uniform mutation rates. Following up on this line of work, we propose a…

Data Structures and Algorithms · Computer Science 2018-11-22 Tobias Friedrich , Andreas Göbel , Francesco Quinzan , Markus Wagner

For deep learning-based speech enhancement (SE) systems, the training-test acoustic mismatch can cause notable performance degradation. To address the mismatch issue, numerous noise adaptation strategies have been derived. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Chi-Chang Lee , Cheng-Hung Hu , Yu-Chen Lin , Chu-Song Chen , Hsin-Min Wang , Yu Tsao

Evolutionary algorithms (EAs) are population-based metaheuristics, originally inspired by aspects of natural evolution. Modern varieties incorporate a broad mixture of search mechanisms, and tend to blend inspiration from nature with…

Neural and Evolutionary Computing · Computer Science 2018-05-29 David W. Corne , Michael A. Lones

Mitigating the detrimental effects of noisy labels on the training process has become increasingly critical, as obtaining entirely clean or human-annotated samples for large-scale pre-training tasks is often impractical. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Hao Li , Jiayang Gu , Jingkuan Song , An Zhang , Lianli Gao