English
Related papers

Related papers: Power Homotopy for Zeroth-Order Non-Convex Optimiz…

200 papers

In this work, we focus on the study of stochastic zeroth-order (ZO) optimization which does not require first-order gradient information and uses only function evaluations. The problem of ZO optimization has emerged in many recent machine…

Machine Learning · Statistics 2020-12-22 Pranay Sharma , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Xue Lin , Pramod K. Varshney

We propose a zero-order optimization method for sequential min-max problems based on two populations of interacting particles. The systems are coupled so that one population aims to solve the inner maximization problem, while the other aims…

Optimization and Control · Mathematics 2024-07-25 Giacomo Borghi , Hui Huang , Jinniao Qiu

The massive integration of distributed energy resources changes the operational demands of the electric power distribution system, motivating optimization-based approaches. The added computational complexities of the resulting optimal power…

Optimization and Control · Mathematics 2023-07-04 Yunqi Luo , Rabayet Sadnan , Bala Krishnamoorthy , Anamika Dubey

Optimal power flow (OPF) problems are non-convex and large-scale optimization problems with important applications in power networks. This paper proposes the scheduled-asynchronous algorithm to solve a distributed semidefinite programming…

Optimization and Control · Mathematics 2017-10-10 Chin-Yao Chang , Jorge Cortes , Sonia Martinez

Some real-world problems revolve to solve the optimization problem \max_{x\in\mathcal{X}}f\left(x\right) where f\left(.\right) is a black-box function and X might be the set of non-vectorial objects (e.g., distributions) where we can only…

Machine Learning · Computer Science 2017-09-20 Trung Le , Khanh Nguyen , Tu Dinh Nguyen , Dinh Phung

We develop \emph{geometric optimisation} on the manifold of Hermitian positive definite (HPD) matrices. In particular, we consider optimising two types of cost functions: (i) geodesically convex (g-convex); and (ii) log-nonexpansive (LN).…

Functional Analysis · Mathematics 2018-06-04 Suvrit Sra , Reshad Hosseini

We introduce some new proximal quasi-Newton methods for unconstrained multiobjective optimization problems (in short, UMOP), where each objective function is the sum of a twice continuously differentiable strongly convex function and a…

Optimization and Control · Mathematics 2022-04-08 Jian-Wen Peng , Jie Ren

We introduce a hybrid high-order method for approximating the ground state of the nonlinear Gross--Pitaevskii eigenvalue problem. Optimal convergence rates are proved for the ground state approximation, as well as for the associated…

Numerical Analysis · Mathematics 2025-06-26 Moritz Hauck , Yizhou Liang

Load forecasting is a fundamental task in smart grid. Many techniques have been applied to developing load forecasting models. Due to the challenges such as the Curse of Dimensionality, overfitting, and limited computing resources,…

Machine Learning · Computer Science 2025-03-14 Pengyang Song , Han Feng , Shreyashi Shukla , Jue Wang , Tao Hong

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of $n$ local cost functions by using local information exchange is considered. This problem is an important component of many machine…

Optimization and Control · Mathematics 2022-01-11 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

Large-scale strongly nonlinear and nonconvex mixed-integer nonlinear programming (MINLP) models frequently appear in optimisation-based process synthesis, integration, intensification, and process control. However, they are usually…

Optimization and Control · Mathematics 2026-01-06 Yingjie Ma , Jie Li

We present two easy-to-implement gradient-free/zeroth-order methods to optimize a stochastic non-smooth function accessible only via a black-box. The methods are built upon efficient first-order methods in the heavy-tailed case, i.e., when…

Optimization and Control · Mathematics 2023-08-25 Nikita Kornilov , Alexander Gasnikov , Pavel Dvurechensky , Darina Dvinskikh

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan

We consider polynomial optimization problems (POP) on a semialgebraic set contained in the nonnegative orthant (every POP on a compact set can be put in this format by a simple translation of the origin). Such a POP can be converted to an…

Optimization and Control · Mathematics 2025-06-12 Ngoc Hoang Anh Mai , Victor Magron , Jean-Bernard Lasserre , Kim-Chuan Toh

In this paper, we combine the positive aspects of the Gradient Sampling (GS) and bundle methods, as the most efficient methods in nonsmooth optimization, to develop a robust method for solving unconstrained nonsmooth convex optimization…

Optimization and Control · Mathematics 2019-11-26 M. Maleknia , M. Shamsi

Fast power system state estimation (SE) solution is of paramount importance for achieving real-time decision making in power grid operations. Semidefinite programming (SDP) reformulation has been shown effective to obtain the global optimum…

Signal Processing · Electrical Eng. & Systems 2019-06-20 Yu Lan , Hao Zhu , Xiaohong Guan

Nonsmooth sparsity constrained optimization encompasses a broad spectrum of applications in machine learning. This problem is generally non-convex and NP-hard. Existing solutions to this problem exhibit several notable limitations,…

Optimization and Control · Mathematics 2023-12-18 Ganzhao Yuan

Policy gradient (PG) is widely used in reinforcement learning due to its scalability and good performance. In recent years, several variance-reduced PG methods have been proposed with a theoretical guarantee of converging to an approximate…

Machine Learning · Computer Science 2025-10-01 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Niao He , Matthias Grossglauser

We consider the optimization of pairwise objective functions, i.e., objective functions of the form $H(\mathbf{x}) = H(x_1,\ldots,x_N) = \sum_{1\leq i<j \leq N} H_{ij}(x_i,x_j)$ for $x_i$ in some continuous state spaces $\mathcal{X}_i$.…

Numerical Analysis · Mathematics 2020-12-21 Yian Chen , Yuehaw Khoo , Michael Lindsey

We consider solving high-order semidefinite programming (SDP) relaxations of nonconvex polynomial optimization problems (POPs) that often admit degenerate rank-one optimal solutions. Instead of solving the SDP alone, we propose a new…

Optimization and Control · Mathematics 2021-10-27 Heng Yang , Ling Liang , Luca Carlone , Kim-Chuan Toh