English
Related papers

Related papers: Adaptive Operator Selection Based on Dynamic Thomp…

200 papers

Customized static operator design has enabled widespread application of Evolutionary Algorithms (EAs), but their search effectiveness often deteriorates as evolutionary progresses. Dynamic operator configuration approaches attempt to…

Neural and Evolutionary Computing · Computer Science 2026-01-23 Rongjie Liao , Junhao Qiu , Xin Chen , Xiaoping Li

We consider the trade-off problem between exploration and exploitation under finite discounted Markov Decision Process, where the state transition matrix of the underlying environment stays unknown. We propose a double Thompson sampling…

Machine Learning · Computer Science 2022-03-01 Shuqing Shi , Xiaobin Wang , Zhiyou Yang , Fan Zhang , Hong Qu

This study presents a population-based evolutionary optimization algorithm (Adaptive Differential Evolution with Diversification Strategies or ADEDS). The algorithm developed using the sinusoidal objective function and subsequently…

Neural and Evolutionary Computing · Computer Science 2023-10-09 Sarit Maitra

We discuss a multiple-play multi-armed bandit (MAB) problem in which several arms are selected at each round. Recently, Thompson sampling (TS), a randomized algorithm with a Bayesian spirit, has attracted much attention for its empirically…

Machine Learning · Statistics 2019-03-22 Junpei Komiyama , Junya Honda , Hiroshi Nakagawa

Machine learning has been making great success in many application areas. However, for the non-expert practitioners, it is always very challenging to address a machine learning task successfully and efficiently. Finding the optimal machine…

Machine Learning · Computer Science 2025-08-08 Guanghui Zhu , Xin Fang , Feng Cheng , Lei Wang , Wenzhong Chen , Chunfeng Yuan , Yihua Huang

Adam is a widely used optimization method for training deep learning models. It computes individual adaptive learning rates for different parameters. In this paper, we propose a generalization of Adam, called Adambs, that allows us to also…

Machine Learning · Computer Science 2020-10-27 Rui Liu , Tianyi Wu , Barzan Mozafari

We present Acquisition Thompson Sampling (ATS), a novel technique for batch Bayesian Optimization (BO) based on the idea of sampling multiple acquisition functions from a stochastic process. We define this process through the dependency of…

Machine Learning · Computer Science 2019-10-18 Alessandro De Palma , Celestine Mendler-Dünner , Thomas Parnell , Andreea Anghel , Haralampos Pozidis

Conversion rate optimization means designing web interfaces such that more visitors perform a desired action (such as register or purchase) on the site. One promising approach, implemented in Sentient Ascend, is to optimize the design using…

Neural and Evolutionary Computing · Computer Science 2018-11-19 Xin Qiu , Risto Miikkulainen

Neighborhood search operators are critical to the performance of Multi-Objective Evolutionary Algorithms (MOEAs) and rely heavily on expert design. Although recent LLM-based Automated Heuristic Design (AHD) methods have made notable…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Junhao Qiu , Xin Chen , Liang Ge , Liyong Lin , Zhichao Lu , Qingfu Zhang

Now-a-days, it is important to find out solutions of Multi-Objective Optimization Problems (MOPs). Evolutionary Strategy helps to solve such real world problems efficiently and quickly. But sequential Evolutionary Algorithms (EAs) require…

Neural and Evolutionary Computing · Computer Science 2016-11-15 Md. Asadul Islam , G. M. Mashrur-E-Elahi , M. M. A. Hashem

Dynamic multiobjective optimization problems (DMOPs) feature time-varying objectives, which cause the Pareto optimal solution (POS) set to drift over time and make it difficult to maintain both convergence and diversity under limited…

Neural and Evolutionary Computing · Computer Science 2026-03-31 Jian Guan , Huolong Wu , Zhenzhong Wang , Gary G. Yen , Min Jiang

We consider a finite-horizon multi-armed bandit (MAB) problem in a Bayesian setting, for which we propose an information relaxation sampling framework. With this framework, we define an intuitive family of control policies that include…

Machine Learning · Computer Science 2021-06-17 Seungki Min , Costis Maglaras , Ciamac C. Moallemi

In this paper, a novel mutation operator of differential evolution algorithm is proposed. A new algorithm called divergence differential evolution algorithm (DDEA) is developed by combining the new mutation operator with divergence operator…

Neural and Evolutionary Computing · Computer Science 2011-08-18 Yifeng Gao , Shuhong Gong , Ge Zhao

Three Operator Splitting (TOS) (Davis & Yin, 2017) can minimize the sum of multiple convex functions effectively when an efficient gradient oracle or proximal operator is available for each term. This requirement often fails in machine…

Optimization and Control · Mathematics 2022-02-21 Alp Yurtsever , Alex Gu , Suvrit Sra

The evaluation of hyperparameters, neural architectures, or data augmentation policies becomes a critical model selection problem in advanced deep learning with a large hyperparameter search space. In this paper, we propose an efficient and…

Machine Learning · Statistics 2020-12-17 Yimin Huang , Yujun Li , Hanrong Ye , Zhenguo Li , Zhihua Zhang

Residential loads have great potential to enhance the efficiency and reliability of electricity systems via demand response (DR) programs. One major challenge in residential DR is to handle the unknown and uncertain customer behaviors.…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Xin Chen , Yutong Nie , Na Li

Thompson sampling (TS) has optimal regret and excellent empirical performance in multi-armed bandit problems. Yet, in Bayesian optimization, TS underperforms popular acquisition functions (e.g., EI, UCB). TS samples arms according to the…

Machine Learning · Statistics 2024-12-02 David Sweet

Thompson sampling is one of the most widely used algorithms for many online decision problems, due to its simplicity in implementation and superior empirical performance over other state-of-the-art methods. Despite its popularity and…

Machine Learning · Computer Science 2020-10-02 Tianyuan Jin , Pan Xu , Jieming Shi , Xiaokui Xiao , Quanquan Gu

We address the problem of online sequential decision making, i.e., balancing the trade-off between exploiting the current knowledge to maximize immediate performance and exploring the new information to gain long-term benefits using the…

Machine Learning · Computer Science 2022-09-20 Kartik Anand Pant , Amod Hegde , K. V. Srinivas

This paper proposes a novel constraint-handling mechanism named angle-based constrained dominance principle (ACDP) embedded in a decomposition-based multi-objective evolutionary algorithm (MOEA/D) to solve constrained multi-objective…

Neural and Evolutionary Computing · Computer Science 2018-02-13 Zhun Fan , Yi Fang , Wenji Li , Xinye Cai , Caimin Wei , Erik Goodman