English
Related papers

Related papers: Consensus-Based Optimization for Saddle Point Prob…

200 papers

In target tracking with mobile multi-sensor systems, sensor deployment impacts the observation capabilities and the resulting state estimation quality. Based on a partially observable Markov decision process (POMDP) formulation comprised of…

Multiagent Systems · Computer Science 2022-03-04 Tianqi Li , Lucas W. Krakow , Swaminathan Gopalswamy

Saddle point problems have been attracting people's attention in recent years. To solve large and sparse saddle point problems, Uzawa type algorithms were proposed. The main contribution of this paper is to present a new Uzawa-exact type…

Optimization and Control · Mathematics 2018-02-20 Zhitao Xu , Ting Jiang , Li Gao

Centered around solving the Online Saddle Point problem, this paper introduces the Online Convex-Concave Optimization (OCCO) framework, which involves a sequence of two-player time-varying convex-concave games. We propose the generalized…

Machine Learning · Computer Science 2023-12-18 Qing-xin Meng , Jian-wei Liu

This paper investigates a class of stochastic bilevel optimization problems where the upper-level function is nonconvex with potentially unbounded smoothness and the lower-level problem is strongly convex. These problems have significant…

Machine Learning · Computer Science 2025-01-16 Xiaochuan Gong , Jie Hao , Mingrui Liu

This paper proposes a distributed optimization algorithm with a convergence time that can be assigned in advance according to task requirements. To this end, a sliding manifold is introduced to achieve the sum of local gradients approaching…

Optimization and Control · Mathematics 2024-12-31 Renyongkang Zhang , Ge Guo , Zeng-di Zhou

This paper presents an in-depth survey and performance evaluation of the Cat Swarm Optimization (CSO) Algorithm. CSO is a robust and powerful metaheuristic swarm-based optimization approach that has received very positive feedback since its…

Neural and Evolutionary Computing · Computer Science 2020-02-03 Aram M. Ahmed , Tarik A. Rashid , Soran Ab. M. Saeed

Recently, saddle point problems have received much attention due to their powerful modeling capability for a lot of problems from diverse domains. Applications of these problems occur in many applied areas, such as robust optimization,…

Optimization and Control · Mathematics 2022-02-15 Mohammad Alkousa , Alexander Gasnikov , Pavel Dvurechensky , Abdurakhmon Sadiev , Lama Razouk

Particle swarm optimization algorithm is a stochastic meta-heuristic solving global optimization problems appreciated for its efficacity and simplicity. It consists in a swarm of particles interacting among themselves and searching the…

Probability · Mathematics 2024-09-23 Vianney Bruned , André Mas , Sylvain Wlodarczyk

In fitting data with a spline, finding the optimal placement of knots can significantly improve the quality of the fit. However, the challenging high-dimensional and non-convex optimization problem associated with completely free knot…

Computation · Statistics 2020-07-28 Soumya D. Mohanty , Ethan Fahnestock

This paper presents a new algorithm named spherical vector-based particle swarm optimization (SPSO) to deal with the problem of path planning for unmanned aerial vehicles (UAVs) in complicated environments subjected to multiple threats. A…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Manh Duong Phung , Quang Phuc Ha

This study develops a fixed-time convergent saddle point dynamical system for solving min-max problems under a relaxation of standard convexity-concavity assumption. In particular, it is shown that by leveraging the dynamical systems…

Optimization and Control · Mathematics 2022-07-28 Kunal Garg , Mayank Baranwal

In this paper we propose a primal-dual proximal extragradient algorithm to solve the generalized Dantzig selector (GDS) estimation problem, based on a new convex-concave saddle-point (SP) reformulation. Our new formulation makes it possible…

Machine Learning · Statistics 2016-06-03 Sangkyun Lee , Damian Brzyski , Malgorzata Bogdan

Swarm based optimization algorithms have demonstrated remarkable success in solving complex optimization problems. However, their widespread adoption remains sceptical due to limited transparency in how different algorithmic components…

Neural and Evolutionary Computing · Computer Science 2026-04-01 Nitin Gupta , Bapi Dutta , Anupam Yadav

This paper proposes distributed algorithms to solve robust convex optimization (RCO) when the constraints are affected by nonlinear uncertainty. We adopt a scenario approach by randomly sampling the uncertainty set. To facilitate the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Keyou You , Roberto Tempo , Pei Xie

any practical multiobjective optimization (MOO) problems include discrete decision variables and/or nonlinear model equations and exhibit disconnected or smooth but nonconvex Pareto surfaces. Scalarization methods, such as the weighted-sum…

Optimization and Control · Mathematics 2024-10-23 Ye Seol Lee , George Jackson , Amparo Galindo , Claire S. Adjiman

A central challenge to many fields of science and engineering involves minimizing non-convex error functions over continuous, high dimensional spaces. Gradient descent or quasi-Newton methods are almost ubiquitously used to perform such…

Machine Learning · Computer Science 2014-05-29 Razvan Pascanu , Yann N. Dauphin , Surya Ganguli , Yoshua Bengio

A new Adaptive Neuro Particle Swarm Optimization (ANPSO) combined with a fuzzy inference system for diagnosing disorders is presented in this paper. The main contributions of the novel proposed method can be a global search across the whole…

Neural and Evolutionary Computing · Computer Science 2019-10-31 Majid Masoumi , Mina Rajabi

In this paper we simulate an ensemble of cooperating, mobile sensing agents that implement the cyclic stochastic optimization (CSO) algorithm in an attempt to survey and track multiple targets. In the CSO algorithm proposed, each agent uses…

Machine Learning · Statistics 2021-08-04 Carsten H. Botts

This paper focuses on the decentralized optimization (minimization and saddle point) problems with objective functions that satisfy Polyak-{\L}ojasiewicz condition (PL-condition). The first part of the paper is devoted to the minimization…

Optimization and Control · Mathematics 2024-05-14 Ilya Kuruzov , Mohammad Alkousa , Fedor Stonyakin , Alexander Gasnikov

The particle swarm approach provides a low complexity solution to the optimization problem among various existing heuristic algorithms. Recent advances in the algorithm resulted in improved performance at the cost of increased computational…

Neural and Evolutionary Computing · Computer Science 2013-04-16 Muhammad Omer Bin Saeed , Muhammad Saqib Sohail , Syed Zeeshan Rizvi , Mobien Shoaib , Asrar Ul Haq Sheikh