English
Related papers

Related papers: Evolutionary Alternating Direction Method of Multi…

200 papers

In many sequential decision-making problems, the goal is to optimize a utility function while satisfying a set of constraints on different utilities. This learning problem is formalized through Constrained Markov Decision Processes (CMDPs).…

Machine Learning · Computer Science 2020-03-05 Yonathan Efroni , Shie Mannor , Matteo Pirotta

Real-world optimization problems often involve stochastic and dynamic components. Evolutionary algorithms are particularly effective in these scenarios, as they can easily adapt to uncertain and changing environments but often uncertainty…

Neural and Evolutionary Computing · Computer Science 2024-04-10 Ishara Hewa Pathiranage , Frank Neumann , Denis Antipov , Aneta Neumann

Given a point in $m$-dimensional objective space, any $\varepsilon$-ball of a point can be partitioned into the incomparable, the dominated and dominating region. The ratio between the size of the incomparable region, and the dominated (and…

Neural and Evolutionary Computing · Computer Science 2020-06-22 Yali Wang , André Deutz , Thomas Bäck , Michael Emmerich

While globally optimal solutions to many convex programs can be computed efficiently in polynomial time, this is, in general, not possible for nonconvex optimization problems. Therefore, locally optimal approaches or other efficient…

Information Theory · Computer Science 2020-07-03 Bho Matthiesen , Christoph Hellings , Eduard A. Jorswieck , Wolfgang Utschick

This work investigates the theoretical performance of the alternating-direction method of multipliers (ADMM) as it applies to nonconvex optimization problems, and in particular, problems with nonconvex constraint sets. The alternating…

Optimization and Control · Mathematics 2022-03-16 Stuart M. Harwood

Chandrasekaran, Parrilo and Willsky (2010) proposed a convex optimization problem to characterize graphical model selection in the presence of unobserved variables. This convex optimization problem aims to estimate an inverse covariance…

Optimization and Control · Mathematics 2012-09-27 Shiqian Ma , Lingzhou Xue , Hui Zou

Saddle-point problems appear in various settings including machine learning, zero-sum stochastic games, and regression problems. We consider decomposable saddle-point problems and study an extension of the alternating direction method of…

Optimization and Control · Mathematics 2022-12-29 Mustafa O. Karabag , David Fridovich-Keil , Ufuk Topcu

The storage and computation requirements of Convolutional Neural Networks (CNNs) can be prohibitive for exploiting these models over low-power or embedded devices. This paper reduces the computational complexity of the CNNs by minimizing an…

Neural and Evolutionary Computing · Computer Science 2017-01-17 Farkhondeh Kiaee , Christian Gagné , Mahdieh Abbasi

The effectiveness of Constrained Multi-Objective Evolutionary Algorithms (CMOEAs) depends on their ability to reach the different feasible regions during evolution, by exploiting the information present in infeasible solutions, in addition…

Neural and Evolutionary Computing · Computer Science 2025-02-07 Oladayo S. Ajani , Sri Srinivasa Raju M , Anand Paul , Rammohan Mallipeddi

We consider a class of structured, nonconvex, nonsmooth optimization problems under orthogonality constraints, where the objectives combine a smooth function, a nonsmooth concave function, and a nonsmooth weakly convex function. This class…

Optimization and Control · Mathematics 2025-01-14 Ganzhao Yuan

This work proposes the integration of two new constraint-handling approaches into the blackbox constrained multiobjective optimization algorithm DMulti-MADS, an extension of the Mesh Adaptive Direct Search (MADS) algorithm for…

Optimization and Control · Mathematics 2022-04-05 Jean Bigeon , Sébastien Le Digabel , Ludovic Salomon

An integrated optimization method based on the constrained multi-objective evolutionary algorithm (MOEA) and non-intrusive polynomial chaos expansion (PCE) is proposed, which solves robust multi-objective optimization problems under…

Neural and Evolutionary Computing · Computer Science 2022-09-29 Yuji Takubo , Masahiro Kanazaki

We present a novel adaptive optimization algorithm for black-box multi-objective optimization problems with binary constraints on the foundation of Bayes optimization. Our method is based on probabilistic regression and classification…

Machine Learning · Statistics 2021-03-01 Raoul Heese , Michael Bortz

Evolutionary algorithms are bio-inspired algorithms that can easily adapt to changing environments. Recent results in the area of runtime analysis have pointed out that algorithms such as the (1+1)~EA and Global SEMO can efficiently…

Neural and Evolutionary Computing · Computer Science 2022-06-07 Vahid Roostapour , Aneta Neumann , Frank Neumann

Multi-objective optimization is central to many engineering and machine learning applications, where multiple objectives must be optimized in balance. While multi-gradient based optimization methods combine these objectives in each step,…

Optimization and Control · Mathematics 2026-05-13 Trang H. Tran , Luis Nunes Vicente

Distributed Constraint Optimization Problems (DCOPs) are a frequently used framework in which a set of independent agents choose values from their respective discrete domains to maximize their utility. Although this formulation is typically…

Multiagent Systems · Computer Science 2021-10-18 K. M. Merajul Arefin , Mashrur Rashik , Saaduddin Mahmud , Md. Mosaddek Khan

Real-world problems are often comprised of many objectives and require solutions that carefully trade-off between them. Current approaches to many-objective optimization often require challenging assumptions, like knowledge of the…

Neural and Evolutionary Computing · Computer Science 2023-07-07 Jackson Dean , Nick Cheney

The objective of this paper is to design an efficient and convergent alternating direction method of multipliers (ADMM) for finding a solution of medium accuracy to conic programming problems whose constraints consist of linear equalities,…

Optimization and Control · Mathematics 2014-12-02 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

This paper presents a novel accelerated distributed algorithm for unconstrained consensus optimization over static undirected networks. The proposed algorithm combines the benefits of acceleration from momentum, the robustness of the…

Optimization and Control · Mathematics 2024-05-15 Eduardo Sebastián , Mauro Franceschelli , Andrea Gasparri , Eduardo Montijano , Carlos Sagüés

In this paper, we aim to provide a comprehensive analysis on the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a certain…

Optimization and Control · Mathematics 2015-08-11 Deren Han , Defeng Sun , Liwei Zhang