English
Related papers

Related papers: Swarm-Based Inertial Methods for Optimization

200 papers

Semi-Infinite Programming (SIP) has emerged as a powerful framework for modeling problems with infinite constraints, however, its theoretical development in the context of nonconvex and large-scale optimization remains limited. In this…

Optimization and Control · Mathematics 2025-10-15 Cody Melcher , Zeinab Alizadeh , Lindsey Hiett , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

In this study, a stochastic power management strategy for in-wheel motor electric vehicles (IWM-EV) is proposed to reduce the energy consumption and increase the driving range by considering the unpredictable nature of the driving power…

Optimization and Control · Mathematics 2017-08-24 Mehdi Jalalmaab , Nasser Azad

The article discusses distributed gradient-descent algorithms for computing local and global minima in nonconvex optimization. For local optimization, we focus on distributed stochastic gradient descent (D-SGD)--a simple network-based…

Optimization and Control · Mathematics 2020-09-17 Brian Swenson , Soummya Kar , H. Vincent Poor , José M. F. Moura , Aaron Jaech

We study the differentially private Empirical Risk Minimization (ERM) and Stochastic Convex Optimization (SCO) problems for non-smooth convex functions. We get a (nearly) optimal bound on the excess empirical risk and excess population loss…

Machine Learning · Computer Science 2021-03-31 Janardhan Kulkarni , Yin Tat Lee , Daogao Liu

We explore a new way to handle flux boundary conditions imposed on level sets. The proposed approach is a diffuse interface version of the shifted boundary method (SBM) for continuous Galerkin discretizations of conservation laws in…

Numerical Analysis · Mathematics 2022-05-11 Dmitri Kuzmin , Jan-Phillip Bäcker

We investigate the implementation of a new stochastic Kuramoto-Vicsek-type model for global optimization of nonconvex functions on the sphere. This model belongs to the class of Consensus-Based Optimization. In fact, particles move on the…

Machine Learning · Computer Science 2021-07-29 Massimo Fornasier , Hui Huang , Lorenzo Pareschi , Philippe Sünnen

Revealing the structure and dynamics of complex networked systems from observed data is of fundamental importance to science, engineering, and society. Is it possible to develop a universal, completely data driven framework to decipher the…

Physics and Society · Physics 2018-04-04 Yu-Zhong Chen , Ying-Cheng Lai

Motion planning is a key element of robotics since it empowers a robot to navigate autonomously. Particle Swarm Optimization is a simple, yet a very powerful optimization technique which has been effectively used in many complex…

Robotics · Computer Science 2020-08-25 M. Shahab Alam , M. Usman Rafique , M. Umer Khan

Many core problems in robotics can be framed as constrained optimization problems. Often on these problems, the robotic system has uncertainty, or it would be advantageous to identify multiple high quality feasible solutions. To enable…

Robotics · Computer Science 2025-06-03 Griffin Tabor , Tucker Hermans

The convergence behaviour of first-order methods can be severely slowed down when applied to high-dimensional non-convex functions due to the presence of saddle points. If, additionally, the saddles are surrounded by large plateaus, it is…

Optimization and Control · Mathematics 2023-09-12 Nick Tsipinakis , Panos Parpas

In this paper, a novel convexification approach for Small-Signal Stability Constraint Optimal Power Flow (SSSC-OPF) has been presented that does not rely on eigenvalue analysis. The proposed methodology is based on the sufficient condition…

Optimization and Control · Mathematics 2021-09-17 Parikshit Pareek , Hung D. Nguyen

Autonomous robots operating in dynamic environments must balance global path optimality with real-time responsiveness to disturbances. This requires addressing a fundamental trade-off between computationally expensive global planning and…

Robotics · Computer Science 2026-05-05 Shreyas Raorane , Kabir Ram Puri , Anh-Quan Pham

We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main…

Optimization and Control · Mathematics 2017-02-07 Guanghui Lan , Soomin Lee , Yi Zhou

In this paper, we propose a general class of algorithms for optimizing an extensive variety of nonsmoothly penalized objective functions that satisfy certain regularity conditions. The proposed framework utilizes the…

Computation · Statistics 2011-01-24 Elizabeth D. Schifano , Robert L. Strawderman , Martin T. Wells

Swarm Intelligence is a metaheuristic optimization approach that has become very predominant over the last few decades. These algorithms are inspired by animals' physical behaviors and their evolutionary perceptions. The simplicity of these…

Neural and Evolutionary Computing · Computer Science 2019-04-23 Ahmed S. Shamsaldin , Tarik A. Rashid , Rawan A. Al-Rashid Agha , Nawzad K. Al-Salihi , Mokhtar Mohammadi

We present a unified theorem for the convergence analysis of stochastic gradient algorithms for minimizing a smooth and convex loss plus a convex regularizer. We do this by extending the unified analysis of Gorbunov, Hanzely \& Richt\'arik…

Machine Learning · Computer Science 2020-06-23 Ahmed Khaled , Othmane Sebbouh , Nicolas Loizou , Robert M. Gower , Peter Richtárik

This paper presents a scalable online algorithm to generate safe and kinematically feasible trajectories for quadrotor swarms. Existing approaches rely on linearizing Euclidean distance-based collision constraints and on axis-wise…

Robotics · Computer Science 2023-03-10 Vivek K. Adajania , Siqi Zhou , Arun Kumar Singh , Angela P. Schoellig

We use sensitivity analysis to design bounding-focused discretization (cutting-surface) methods for the global optimization of nonconvex semi-infinite programs (SIPs). We begin by formulating the optimal bounding-focused discretization of…

Optimization and Control · Mathematics 2025-06-24 Evren M. Turan , Johannes Jäschke , Rohit Kannan

Finding parameters that minimise a loss function is at the core of many machine learning methods. The Stochastic Gradient Descent algorithm is widely used and delivers state of the art results for many problems. Nonetheless, Stochastic…

Machine Learning · Computer Science 2018-09-26 Yao Zhang , Andrew M. Saxe , Madhu S. Advani , Alpha A. Lee

Numerical optimization techniques are widely used in a broad area of science and technology, from finding the minimal energy of systems in Physics or Chemistry to finding optimal routes in logistics or optimal strategies for high speed…

Neural and Evolutionary Computing · Computer Science 2025-08-20 Yury Chernyak , Ijaz Ahamed Mohammad , Nikolas Masnicak , Matej Pivoluska , Martin Plesch