English
Related papers

Related papers: Working Principles of Binary Differential Evolutio…

200 papers

Bayesian optimization (BO) is an effective approach to optimize expensive black-box functions, that seeks to trade-off between exploitation (selecting parameters where the maximum is likely) and exploration (selecting parameters where we…

Machine Learning · Statistics 2021-10-19 Tristan Fauvel , Matthew Chalk

Residual-based adaptive strategies are widely used in scientific machine learning but remain largely heuristic. We introduce a unifying variational framework that formalizes these methods by integrating convex transformations of the…

Machine Learning · Computer Science 2025-09-29 Juan Diego Toscano , Daniel T. Chen , Vivek Oommen , Jérôme Darbon , George Em Karniadakis

With the advancement of diffusion models (DMs) and the substantially increased computational requirements, quantization emerges as a practical solution to obtain compact and efficient low-bit DMs. However, the highly discrete representation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xingyu Zheng , Xianglong Liu , Haotong Qin , Xudong Ma , Mingyuan Zhang , Haojie Hao , Jiakai Wang , Zixiang Zhao , Jinyang Guo , Michele Magno

The neural ordinary differential equation (neural ODE) model has attracted increasing attention in time series analysis for its capability to process irregular time steps, i.e., data are not observed over equally-spaced time intervals. In…

Machine Learning · Computer Science 2021-07-23 Mingyuan Bai , S. T. Boris Choy , Junping Zhang , Junbin Gao

We present a general framework to describe the evolutionary dynamics of an arbitrary number of types in finite populations based on stochastic differential equations (SDE). For large, but finite populations this allows to include…

Populations and Evolution · Quantitative Biology 2012-06-13 Arne Traulsen , Jens Christian Claussen , Christoph Hauert

An evolutionary search space can be smoothly transformed via a suitable change of basis; however, it can be difficult to determine an appropriate basis. In this paper, a method is proposed to select an optimum basis can be used to simplify…

Neural and Evolutionary Computing · Computer Science 2019-04-22 Junghwan Lee , Yong-Hyuk Kim

Binary embedding of high-dimensional data requires long codes to preserve the discriminative power of the input space. Traditional binary coding methods often suffer from very high computation and storage costs in such a scenario. To…

Machine Learning · Statistics 2014-05-14 Felix X. Yu , Sanjiv Kumar , Yunchao Gong , Shih-Fu Chang

Grey wolf optimizer (GWO) is a nature-inspired stochastic meta-heuristic of the swarm intelligence field that mimics the hunting behavior of grey wolves. Differential evolution (DE) is a popular stochastic algorithm of the evolutionary…

We propose a novel evolutionary algorithm on bit vectors which derives from the principles of information theory. The information-theoretic evolutionary algorithm (it-EA) iteratively updates a search distribution with two parameters, the…

Neural and Evolutionary Computing · Computer Science 2023-04-13 Arnaud Berny

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

Mathematical formulations of real world optimization studies frequently present characteristics such as non-linearity, discontinuity and high complexity. This class of problems may also exhibit a high number of global minimum/maximum…

This paper presents a novel Differential Evolution algorithm for protein folding optimization that is applied to a three-dimensional AB off-lattice model. The proposed algorithm includes two new mechanisms. A local search is used to improve…

Artificial Intelligence · Computer Science 2018-05-08 Borko Bošković , Janez Brest

Neuroevolution is an active and growing research field, especially in times of increasingly parallel computing architectures. Learning methods for Artificial Neural Networks (ANN) can be divided into two groups. Neuroevolution is mainly…

Neural and Evolutionary Computing · Computer Science 2011-04-11 Onay Urfalioglu , Orhan Arikan

Differential evolution (DE) is a simple but powerful evolutionary algorithm, which has been widely and successfully used in various areas. In this paper, an event-triggered impulsive control scheme (ETI) is introduced to improve the…

Neural and Evolutionary Computing · Computer Science 2015-12-25 Wei Du , Sunney Yung Sun Leung , Yang Tang , Athanasios V. Vasilakos

We present new results on the classical algorithm of variable elimination, which underlies many algorithms including for probabilistic inference. The results relate to exploiting functional dependencies, allowing one to perform inference…

Artificial Intelligence · Computer Science 2020-04-21 Adnan Darwiche

This paper presents an evolutionary algorithm with a new goal-sequence domination scheme for better decision support in multi-objective optimization. The approach allows the inclusion of advanced hard/soft priority and constraint…

Artificial Intelligence · Computer Science 2011-06-02 E. F. Khor , T. H. Lee , R. Sathikannan , K. C. Tan

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds

Variable division and optimization (D\&O) is a frequently utilized algorithm design paradigm in Evolutionary Algorithms (EAs). A D\&O EA divides a variable into partial variables and then optimize them respectively. A complicated problem is…

Neural and Evolutionary Computing · Computer Science 2021-01-22 Yi Chen , Aimin Zhou

Biases in existing datasets used to train algorithmic decision rules can raise ethical and economic concerns due to the resulting disparate treatment of different groups. We propose an algorithm for sequentially debiasing such datasets…

Machine Learning · Computer Science 2023-01-11 Yifan Yang , Yang Liu , Parinaz Naghizadeh