English
Related papers

Related papers: (1+1)-CMA-ES with Margin for Discrete and Mixed-In…

200 papers

Computational imaging has been revolutionized by compressed sensing algorithms, which offer guaranteed uniqueness, convergence, and stability properties. Model-based deep learning methods that combine imaging physics with learned…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Aniket Pramanik , M. Bridget Zimmerman , Mathews Jacob

The concern about hidden discrimination in machine learning models is growing, as their widespread real-world applications increasingly impact human lives. Various techniques, including commonly used group fairness measures and several…

Machine Learning · Computer Science 2026-03-12 Yijun Bian

Hyperparameter optimization (HPO), formulated as black-box optimization (BBO), is recognized as essential for automation and high performance of machine learning approaches. The CMA-ES is a promising BBO approach with a high degree of…

Machine Learning · Computer Science 2020-12-15 Masahiro Nomura , Shuhei Watanabe , Youhei Akimoto , Yoshihiko Ozaki , Masaki Onishi

One of the major challenges in multivariate analysis is the estimation of population covariance matrix from sample covariance matrix (SCM). Most recent covariance matrix estimators use either shrinkage transformations or asymptotic results…

Methodology · Statistics 2019-12-10 Samruddhi Deshmukh , Amartansh Dubey

Algorithm selection is crucial in the field of optimization, as no single algorithm performs perfectly across all types of optimization problems. Finding the best algorithm among a given set of algorithms for a given problem requires a…

Neural and Evolutionary Computing · Computer Science 2025-01-27 Saba Sadeghi Ahouei , Denis Antipov , Aneta Neumann , Frank Neumann

Edge detection is crucial in image processing, but existing methods often produce overly detailed edge maps, affecting clarity. Fixed-window statistical testing faces issues like scale mismatch and computational redundancy. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Ruyu Yan , Da-Qing Zhang

Masked Autoencoders (MAEs) are an important divide in self-supervised learning (SSL) due to their independence from augmentation techniques for generating positive (and/or negative) pairs as in contrastive frameworks. Their masking and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Alin Dondera , Anuj Singh , Hadi Jamali-Rad

Bayesian Optimization (BO) is an effective method for finding the global optimum of expensive black-box functions. However, it is well known that applying BO to high-dimensional optimization problems is challenging. To address this issue, a…

Machine Learning · Statistics 2024-02-06 Lam Ngo , Huong Ha , Jeffrey Chan , Vu Nguyen , Hongyu Zhang

In this paper, we study the maximum entropy sampling problem (MESP) and its variants. MESP seeks to identify a small subset of variables that maximizes the determinant of a covariance submatrix, and is a fundamental model in optimal…

Optimization and Control · Mathematics 2026-04-14 Lingqing Shen , Fatma Kılınç-Karzan

In many real-world optimization problems, the objective function evaluation is subject to noise, and we cannot obtain the exact objective value. Evolutionary algorithms (EAs), a type of general-purpose randomized optimization algorithm,…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Chao Bian , Wu Jiang , Ke Tang

Many global optimization algorithms of the memetic variety rely on some form of stochastic search, and yet they often lack a sound probabilistic basis. Without a recourse to the powerful tools of stochastic calculus, treading the fine…

Optimization and Control · Mathematics 2024-12-17 Rajdeep Dutta , T Venkatesh Varma , Saikat Sarkar , Mariya Mamajiwala , Noor Awad , Senthilnath Jayavelu , Debasish Roy

Most real optimization problems are defined over a mixed search space where the variables are both discrete and continuous. In engineering applications, the objective function is typically calculated with a numerically costly black-box…

Optimization and Control · Mathematics 2022-05-04 Jhouben Cuesta-Ramirez , Rodolphe Le Riche , Olivier Roustant , Guillaume Perrin , Cedric Durantin , Alain Gliere

Evolutionary algorithms (EAs) are general-purpose problem solvers that usually perform an unbiased search. This is reasonable and desirable in a black-box scenario. For combinatorial optimization problems, often more knowledge about the…

Neural and Evolutionary Computing · Computer Science 2020-04-23 Vahid Roostapour , Jakob Bossek , Frank Neumann

Designing evolutionary algorithms capable of uncovering highly evolvable representations is an open challenge; such evolvability is important because it accelerates evolution and enables fast adaptation to changing circumstances. This paper…

Neural and Evolutionary Computing · Computer Science 2019-07-16 Alexander Gajewski , Jeff Clune , Kenneth O. Stanley , Joel Lehman

Complex system design problems, such as those involved in aerospace engineering, require the use of numerically costly simulation codes in order to predict the performance of the system to be designed. In this context, these codes are often…

Optimization and Control · Mathematics 2024-02-14 Loic Brevault , Mathieu Balesdent

The expectation-maximization (EM) algorithm is an iterative method for finding maximum likelihood estimates when data are incomplete or are treated as being incomplete. The EM algorithm and its variants are commonly used for parameter…

Computation · Statistics 2013-06-26 Ryan P. Browne , Sanjeena Subedi , Paul McNicholas

We introduce a novel approach for discriminative classification using evolutionary algorithms. We first propose an algorithm to optimize the total loss value using a modified 0-1 loss function in a one-dimensional space for classification.…

Neural and Evolutionary Computing · Computer Science 2018-04-27 Mohammad Reza Bonyadi , David C. Reutens

For seismic analysis in engineering structures, it is essential to consider the dynamic responses under seismic excitation, necessitating the description of seismic accelerations. Limit seismics samples lead to incomplete uncertainty…

Computational Engineering, Finance, and Science · Computer Science 2025-05-20 Shizhong Liang , Yuxiang Yang , Chen Li , Feng Wu

This work proposes the integration of two new constraint-handling approaches into the blackbox constrained multiobjective optimization algorithm DMulti-MADS, an extension of the Mesh Adaptive Direct Search (MADS) algorithm for…

Optimization and Control · Mathematics 2022-04-05 Jean Bigeon , Sébastien Le Digabel , Ludovic Salomon

We present our asynchronous implementation of the LM-CMA-ES algorithm, which is a modern evolution strategy for solving complex large-scale continuous optimization problems. Our implementation brings the best results when the number of…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Viktor Arkhipov , Maxim Buzdalov , Anatoly Shalyto