English
Related papers

Related papers: Power Homotopy for Zeroth-Order Non-Convex Optimiz…

200 papers

This paper proposes a fast decentralized algorithm for solving a consensus optimization problem defined in a directed networked multi-agent system, where the local objective functions have the smooth+nonsmooth composite form, and are…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-28 Jinshan Zeng , Tao He , Mingwen Wang

Alternating-Current Optimal Power Flow (AC-OPF) is an optimization problem critical for planning and operating the power grid. The problem is traditionally formulated using only continuous variables. Typically, control devices with…

Optimization and Control · Mathematics 2021-10-15 Timothy McNamara , Amritanshu Pandey , Aayushya Agarwal , Larry Pileggi

In this paper, we focus on solving an important class of nonconvex optimization problems which includes many problems for example signal processing over a networked multi-agent system and distributed learning over networks. Motivated by…

Optimization and Control · Mathematics 2018-10-25 Ehsan Kazemi , Liqiang Wang

This paper provides a zeroth-order optimisation framework for non-smooth and possibly non-convex cost functions with matrix parameters that are real and symmetric. We provide complexity bounds on the number of iterations required to ensure…

Optimization and Control · Mathematics 2021-06-29 Alejandro I. Maass , Chris Manzie , Iman Shames , Hayato Nakada

This paper is dedicated to provide the global solutions of algebro-geometric type for all the equations of a new commuting hierarchy containing the Hunter-Saxton (HS) equation. Our main tools include the zero curvature method to derive the…

Exactly Solvable and Integrable Systems · Physics 2013-01-07 Hou Yu , Fan Engui , Zhao Peng

A commonly used technique for the higher-order PageRank problem is the power method that is computationally intractable for large-scale problems. The truncated power method proposed recently provides us with another idea to solve this…

Numerical Analysis · Mathematics 2021-05-11 Jun Huang , Gang Wu

In this study, we delve into an emerging optimization challenge involving a black-box objective function that can only be gauged via a ranking oracle-a situation frequently encountered in real-world scenarios, especially when the function…

Machine Learning · Computer Science 2024-04-16 Zhiwei Tang , Dmitry Rybin , Tsung-Hui Chang

We introduce a new framework for analyzing (Quasi-}Newton type methods applied to non-smooth optimization problems. The source of randomness comes from the evaluation of the (approximation) of the Hessian. We derive, using a variant of…

Optimization and Control · Mathematics 2025-03-05 Titus Pinta

Optimal power flow (OPF) over power transmission networks poses challenging large-scale nonlinear optimization problems, which involve a large number of quadratic equality and indefinite quadratic inequality constraints. These…

Systems and Control · Computer Science 2018-02-14 Y. Shi , H. D. Tuan , P. Apkarian , A. V. Savkin

In this paper, a novel convexification approach for Small-Signal Stability Constraint Optimal Power Flow (SSSC-OPF) has been presented that does not rely on eigenvalue analysis. The proposed methodology is based on the sufficient condition…

Optimization and Control · Mathematics 2021-09-17 Parikshit Pareek , Hung D. Nguyen

Recently, saddle point problems have received much attention due to their powerful modeling capability for a lot of problems from diverse domains. Applications of these problems occur in many applied areas, such as robust optimization,…

Optimization and Control · Mathematics 2022-02-15 Mohammad Alkousa , Alexander Gasnikov , Pavel Dvurechensky , Abdurakhmon Sadiev , Lama Razouk

Shape optimization with constraints given by partial differential equations (PDE) is a highly developed field of optimization theory. The elegant adjoint formalism allows to compute shape gradients at the computational cost of a further PDE…

Optimization and Control · Mathematics 2023-03-03 Matthias Bolten , Onur Tanil Doganay , Hanno Gottschalk , Kathrin Klamroth

This paper suggests two novel ideas to develop new proximal variable-metric methods for solving a class of composite convex optimization problems. The first idea is a new parameterization of the optimality condition which allows us to…

Optimization and Control · Mathematics 2018-12-14 Quoc Tran-Dinh , Liang Ling , Kim-Chuan Toh

Optimal power flow (OPF) is an important problem for power generation and it is in general non-convex. With the employment of renewable energy, it will be desirable if OPF can be solved very efficiently so its solution can be used in real…

Optimization and Control · Mathematics 2011-09-27 Albert Y. S. Lam , Baosen Zhang , David Tse

In this paper, we study zeroth-order algorithms for minimax optimization problems that are nonconvex in one variable and strongly-concave in the other variable. Such minimax optimization problems have attracted significant attention lately…

Machine Learning · Statistics 2022-04-06 Zhongruo Wang , Krishnakumar Balasubramanian , Shiqian Ma , Meisam Razaviyayn

In this paper we present an inexact zeroth-order method suitable for the solution nonsmooth and nonconvex stochastic composite optimization problems, in which the objective is split into a real-valued Lipschitz continuous stochastic…

Optimization and Control · Mathematics 2025-12-11 Spyridon Pougkakiotis , Dionysis Kalogerias

This paper introduces and solves the Generalized Heron-Waist Problem (GHWP), that integrates the classical Heron problem of optimal hub location and the waist problem of minimal-perimeter configuration. The GHWP seeks an optimal closed…

Optimization and Control · Mathematics 2026-03-03 Manohar Choudhary , Triloki Nath , Ram K. Pandey

This paper focuses on the problem of \emph{constrained} \emph{stochastic} optimization. A zeroth order Frank-Wolfe algorithm is proposed, which in addition to the projection-free nature of the vanilla Frank-Wolfe algorithm makes it gradient…

Optimization and Control · Mathematics 2019-02-20 Anit Kumar Sahu , Manzil Zaheer , Soummya Kar

The goal of Sparse Convex Optimization is to optimize a convex function $f$ under a sparsity constraint $s\leq s^*\gamma$, where $s^*$ is the target number of non-zero entries in a feasible solution (sparsity) and $\gamma\geq 1$ is an…

Machine Learning · Computer Science 2020-06-26 Kyriakos Axiotis , Maxim Sviridenko

We propose a fast proximal Newton-type algorithm for minimizing regularized finite sums that returns an $\epsilon$-suboptimal point in $\tilde{\mathcal{O}}(d(n + \sqrt{\kappa d})\log(\frac{1}{\epsilon}))$ FLOPS, where $n$ is number of…

Machine Learning · Computer Science 2017-08-30 Xuanqing Liu , Cho-Jui Hsieh , Jason D. Lee , Yuekai Sun