English
Related papers

Related papers: Efficient Fireworks Algorithm Equipped with an Exp…

200 papers

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

We propose a new iteration scheme, the Cauchy-Simplex, to optimize convex problems over the probability simplex $\{w\in\mathbb{R}^n\ |\ \sum_i w_i=1\ \textrm{and}\ w_i\geq0\}$. Specifically, we map the simplex to the positive quadrant of a…

Optimization and Control · Mathematics 2025-05-22 James Chok , Geoffrey M. Vasil

We address the problem of minimizing a convex smooth function $f(x)$ over a compact polyhedral set $D$ given a stochastic zeroth-order constraint feedback model. This problem arises in safety-critical machine learning applications, such as…

Optimization and Control · Mathematics 2019-12-10 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

The minimax problems arise throughout machine learning applications, ranging from adversarial training and policy evaluation in reinforcement learning to AUROC maximization. To address the large-scale data challenges across multiple clients…

Machine Learning · Computer Science 2023-10-06 Xidong Wu , Jianhui Sun , Zhengmian Hu , Aidong Zhang , Heng Huang

Privacy is important when dealing with sensitive personal information in machine learning models, which require large data sets for training. In the energy field, access to household prosumer energy data is crucial for energy predictions to…

Machine Learning · Computer Science 2023-09-20 Viorica Chifu , Tudor Cioara , Cristian Anitiei , Cristina Pop , Ionut Anghel

Recently, numerous meta-heuristic based approaches are deliberated to reduce the computational complexities of several existing approaches that include tricky derivations, very large memory space requirement, initial value sensitivity etc.…

Neural and Evolutionary Computing · Computer Science 2020-11-23 Bryar A. Hassan

We consider a distributionally robust formulation of stochastic optimization problems arising in statistical learning, where robustness is with respect to uncertainty in the underlying data distribution. Our formulation builds on…

Optimization and Control · Mathematics 2021-06-09 Mert Gürbüzbalaban , Andrzej Ruszczyński , Landi Zhu

Several real-world optimization problems involve mixed-variable search spaces, where continuous, ordinal, and categorical decision variables coexist. However, most population-based metaheuristic algorithms are designed for either continuous…

Neural and Evolutionary Computing · Computer Science 2026-04-07 Ousmane Tom Bechir , Adán José-García , Zaineb Chelly Garcia , Vincent Sobanski , Clarisse Dhaenens

As a wide class of resource management problems in wireless communications are nonconvex and even NP-hard in many cases, finding globally optimal solutions to these problems is of little practical interest. Towards more pragmatic…

Information Theory · Computer Science 2017-04-17 Quang-Doanh Vu , Markku Juntti , Een-Kee Hong , Le-Nam Tran

We study Frank-Wolfe methods for nonconvex stochastic and finite-sum optimization problems. Frank-Wolfe methods (in the convex case) have gained tremendous recent interest in machine learning and optimization communities due to their…

Optimization and Control · Mathematics 2016-08-01 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

This study proposes an algorithm titled a statistical firefly algorithm (SFA) for truss topology optimization. In the proposed algorithm, historical results of fireflies' motions are used in hypothesis testing to limit the motions of…

Neural and Evolutionary Computing · Computer Science 2026-01-21 Nghi Huu Duong , Duy Vo , Pruettha Nanakorn

Whale Optimization Algorithm (WOA) is a nature-inspired meta-heuristic optimization algorithm, which was proposed by Mirjalili and Lewis in 2016. This algorithm has shown its ability to solve many problems. Comprehensive surveys have been…

Neural and Evolutionary Computing · Computer Science 2019-04-25 Hardi M. Mohammed , Shahla U. Umar , Tarik A. Rashid

Inference problems in graphical models are often approximated by casting them as constrained optimization problems. Message passing algorithms, such as belief propagation, have previously been suggested as methods for solving these…

Machine Learning · Computer Science 2012-06-26 Amir Globerson , Tommi S. Jaakkola

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

Machine Learning · Statistics 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-adaptive step size…

Machine Learning · Statistics 2016-08-16 Jean Lafond , Hoi-To Wai , Eric Moulines

We consider the problem of designing an allocation rule or an "online learning algorithm" for a class of bandit problems in which the set of control actions available at each time $s$ is a convex, compact subset of $\mathbb{R}^d$. Upon…

Machine Learning · Statistics 2017-03-09 Rahul Singh , Taposh Banerjee

Part I of this work [2] developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of…

Optimization and Control · Mathematics 2017-12-27 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

We consider an optimization problem over measures for emergency response to out-of-hospital cardiac arrest (OHCA), where the goal is to allocate volunteer resources across a spatial region to minimize the probability of death. The problem…

Optimization and Control · Mathematics 2025-07-15 Di Yu , Shane G. Henderson , Raghu Pasupathy

The Whale Optimization Algorithm (WOA) has shown strong optimization ability but still suffers from premature convergence and weak search diversity. To address these issues, this paper proposes an enhanced WOA variant called CICDWOA. The…

Computational Engineering, Finance, and Science · Computer Science 2026-03-24 Junhao Wei , Yanxiao Li , Seyedali Mirjalili , Dexing Yao , Yifu Zhao , Haochen Li , Xudong Ye , Zikun Li , Qingyang Xu , Baili Lu , Ngai Cheong , Dengcheng Yang , Sio-Kei Im , Yapeng Wang , Xu Yang

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

Optimization and Control · Mathematics 2020-10-05 Guanghui Lan , Zhiqiang Zhou