中文
相关论文

相关论文: Power Homotopy for Zeroth-Order Non-Convex Optimiz…

200 篇论文

In this work, we focus on the study of stochastic zeroth-order (ZO) optimization which does not require first-order gradient information and uses only function evaluations. The problem of ZO optimization has emerged in many recent machine…

机器学习 · 统计学 2020-12-22 Pranay Sharma , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Xue Lin , Pramod K. Varshney

We propose a zero-order optimization method for sequential min-max problems based on two populations of interacting particles. The systems are coupled so that one population aims to solve the inner maximization problem, while the other aims…

最优化与控制 · 数学 2024-07-25 Giacomo Borghi , Hui Huang , Jinniao Qiu

The massive integration of distributed energy resources changes the operational demands of the electric power distribution system, motivating optimization-based approaches. The added computational complexities of the resulting optimal power…

最优化与控制 · 数学 2023-07-04 Yunqi Luo , Rabayet Sadnan , Bala Krishnamoorthy , Anamika Dubey

Optimal power flow (OPF) problems are non-convex and large-scale optimization problems with important applications in power networks. This paper proposes the scheduled-asynchronous algorithm to solve a distributed semidefinite programming…

最优化与控制 · 数学 2017-10-10 Chin-Yao Chang , Jorge Cortes , Sonia Martinez

Some real-world problems revolve to solve the optimization problem \max_{x\in\mathcal{X}}f\left(x\right) where f\left(.\right) is a black-box function and X might be the set of non-vectorial objects (e.g., distributions) where we can only…

机器学习 · 计算机科学 2017-09-20 Trung Le , Khanh Nguyen , Tu Dinh Nguyen , Dinh Phung

We develop \emph{geometric optimisation} on the manifold of Hermitian positive definite (HPD) matrices. In particular, we consider optimising two types of cost functions: (i) geodesically convex (g-convex); and (ii) log-nonexpansive (LN).…

泛函分析 · 数学 2018-06-04 Suvrit Sra , Reshad Hosseini

We introduce some new proximal quasi-Newton methods for unconstrained multiobjective optimization problems (in short, UMOP), where each objective function is the sum of a twice continuously differentiable strongly convex function and a…

最优化与控制 · 数学 2022-04-08 Jian-Wen Peng , Jie Ren

We introduce a hybrid high-order method for approximating the ground state of the nonlinear Gross--Pitaevskii eigenvalue problem. Optimal convergence rates are proved for the ground state approximation, as well as for the associated…

数值分析 · 数学 2025-06-26 Moritz Hauck , Yizhou Liang

Load forecasting is a fundamental task in smart grid. Many techniques have been applied to developing load forecasting models. Due to the challenges such as the Curse of Dimensionality, overfitting, and limited computing resources,…

机器学习 · 计算机科学 2025-03-14 Pengyang Song , Han Feng , Shreyashi Shukla , Jue Wang , Tao Hong

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of $n$ local cost functions by using local information exchange is considered. This problem is an important component of many machine…

最优化与控制 · 数学 2022-01-11 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

Large-scale strongly nonlinear and nonconvex mixed-integer nonlinear programming (MINLP) models frequently appear in optimisation-based process synthesis, integration, intensification, and process control. However, they are usually…

最优化与控制 · 数学 2026-01-06 Yingjie Ma , Jie Li

We present two easy-to-implement gradient-free/zeroth-order methods to optimize a stochastic non-smooth function accessible only via a black-box. The methods are built upon efficient first-order methods in the heavy-tailed case, i.e., when…

最优化与控制 · 数学 2023-08-25 Nikita Kornilov , Alexander Gasnikov , Pavel Dvurechensky , Darina Dvinskikh

In this paper, we introduce a new stochastic approximation (SA) type algorithm, namely the randomized stochastic gradient (RSG) method, for solving an important class of nonlinear (possibly nonconvex) stochastic programming (SP) problems.…

最优化与控制 · 数学 2015-10-27 Saeed Ghadimi , Guanghui Lan

We consider polynomial optimization problems (POP) on a semialgebraic set contained in the nonnegative orthant (every POP on a compact set can be put in this format by a simple translation of the origin). Such a POP can be converted to an…

最优化与控制 · 数学 2025-06-12 Ngoc Hoang Anh Mai , Victor Magron , Jean-Bernard Lasserre , Kim-Chuan Toh

In this paper, we combine the positive aspects of the Gradient Sampling (GS) and bundle methods, as the most efficient methods in nonsmooth optimization, to develop a robust method for solving unconstrained nonsmooth convex optimization…

最优化与控制 · 数学 2019-11-26 M. Maleknia , M. Shamsi

Fast power system state estimation (SE) solution is of paramount importance for achieving real-time decision making in power grid operations. Semidefinite programming (SDP) reformulation has been shown effective to obtain the global optimum…

信号处理 · 电气工程与系统科学 2019-06-20 Yu Lan , Hao Zhu , Xiaohong Guan

Nonsmooth sparsity constrained optimization encompasses a broad spectrum of applications in machine learning. This problem is generally non-convex and NP-hard. Existing solutions to this problem exhibit several notable limitations,…

最优化与控制 · 数学 2023-12-18 Ganzhao Yuan

Policy gradient (PG) is widely used in reinforcement learning due to its scalability and good performance. In recent years, several variance-reduced PG methods have been proposed with a theoretical guarantee of converging to an approximate…

机器学习 · 计算机科学 2025-10-01 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Niao He , Matthias Grossglauser

We consider the optimization of pairwise objective functions, i.e., objective functions of the form $H(\mathbf{x}) = H(x_1,\ldots,x_N) = \sum_{1\leq i<j \leq N} H_{ij}(x_i,x_j)$ for $x_i$ in some continuous state spaces $\mathcal{X}_i$.…

数值分析 · 数学 2020-12-21 Yian Chen , Yuehaw Khoo , Michael Lindsey

We consider solving high-order semidefinite programming (SDP) relaxations of nonconvex polynomial optimization problems (POPs) that often admit degenerate rank-one optimal solutions. Instead of solving the SDP alone, we propose a new…

最优化与控制 · 数学 2021-10-27 Heng Yang , Ling Liang , Luca Carlone , Kim-Chuan Toh