中文
相关论文

相关论文: Multiplicative Updates for Online Convex Optimizat…

200 篇论文

We present a hybrid algorithm for optimizing a convex, smooth function over the cone of positive semidefinite matrices. Our algorithm converges to the global optimal solution and can be used to solve general large-scale semidefinite…

机器学习 · 计算机科学 2012-06-22 Soeren Laue

In this two-part paper, we propose a general algorithmic framework for the minimization of a nonconvex smooth function subject to nonconvex smooth constraints. The algorithm solves a sequence of (separable) strongly convex problems and…

多智能体系统 · 计算机科学 2016-01-18 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song

This paper investigates the problem of Online Convex-Concave Optimization, which extends Online Convex Optimization to two-player time-varying convex-concave games. The goal is to minimize the dynamic duality gap (D-DGap), a critical…

机器学习 · 计算机科学 2025-09-10 Qing-xin Meng , Xia Lei , Jian-wei Liu

This paper introduces an efficient algorithm for computing the best approximation of a given matrix onto the intersection of linear equalities, inequalities and the doubly nonnegative cone (the cone of all positive semidefinite matrices…

最优化与控制 · 数学 2018-03-20 Ying Cui , Defeng Sun , Kim-Chuan Toh

We consider Online Convex Optimization (OCO) in the setting where the costs are $m$-strongly convex and the online learner pays a switching cost for changing decisions between rounds. We show that the recently proposed Online Balanced…

机器学习 · 计算机科学 2019-04-05 Gautam Goel , Adam Wierman

This paper mainly addresses the distributed online optimization problem where the local objective functions are assumed to be convex or non-convex. First, the distributed algorithms are proposed for the convex and non-convex situations,…

最优化与控制 · 数学 2025-03-24 Yaowen Wang , Lipo Mo , Min Zuo , Yuanshi Zheng

This paper presents a Successive Convexification ($ \texttt{SCvx} $) algorithm to solve a class of non-convex optimal control problems with certain types of state constraints. Sources of non-convexity may include nonlinear dynamics and…

最优化与控制 · 数学 2017-10-23 Yuanqi Mao , Daniel Dueri , Michael Szmuk , Behçet Açıkmeşe

We incorporate future information in the form of the estimated value of future gradients in online convex optimization. This is motivated by demand response in power systems, where forecasts about the current round, e.g., the weather or the…

最优化与控制 · 数学 2020-12-14 Antoine Lesage-Landry , Iman Shames , Joshua A. Taylor

In the first part of this dissertation research, we develop a modular framework that can serve as a recipe for constructing and analyzing iterative algorithms for convex optimization. Specifically, our work casts optimization as iteratively…

最优化与控制 · 数学 2021-06-25 Jun-Kun Wang

In online convex optimization, some efficient algorithms have been designed for each of the individual classes of objective functions, e.g., convex, strongly convex, and exp-concave. However, existing regret analyses, including those of…

最优化与控制 · 数学 2024-12-13 Tomoya Kamijima , Shinji Ito

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisfy $z^2=z$, to model…

最优化与控制 · 数学 2021-12-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

This paper addresses the problem of mixed-membership estimation in networks, where the goal is to efficiently estimate the latent mixed-membership structure from the observed network. Recognizing the widespread availability and valuable…

统计理论 · 数学 2025-02-11 Jianqing Fan , Jiawei Ge , Jikai Hou

We present successive convexification, a real-time-capable solution method for nonconvex trajectory optimization, with continuous-time constraint satisfaction and guaranteed convergence, that only requires first-order information. The…

最优化与控制 · 数学 2024-04-26 Purnanand Elango , Dayou Luo , Abhinav G. Kamath , Samet Uzun , Taewan Kim , Behçet Açıkmeşe

In this paper we propose a parallel coordinate descent algorithm for solving smooth convex optimization problems with separable constraints that may arise e.g. in distributed model predictive control (MPC) for linear network systems. Our…

最优化与控制 · 数学 2014-11-19 Ion Necoara , Dragos Clipici

This work presents a unified framework that combines global approximations with locally built models to handle challenging nonconvex and nonsmooth composite optimization problems, including cases involving extended real-valued functions. We…

最优化与控制 · 数学 2026-02-19 Welington de Oliveira , Johannes O. Royset

An optimization algorithm for nonsmooth nonconvex constrained optimization problems with upper-C2 objective functions is proposed and analyzed. Upper-C2 is a weakly concave property that exists in difference of convex (DC) functions and…

最优化与控制 · 数学 2022-04-21 Jingyi Wang , Cosmin G. Petra

This work presents a new algorithm for empirical risk minimization. The algorithm bridges the gap between first- and second-order methods by computing a search direction that uses a second-order-type update in one subspace, coupled with a…

最优化与控制 · 数学 2020-06-09 Majid Jahani , Mohammadreza Nazari , Rachael Tappenden , Albert S. Berahas , Martin Takáč

Maximal Biclique Enumeration (MBE) holds critical importance in graph theory with applications extending across fields such as bioinformatics, social networks, and recommendation systems. However, its computational complexity presents…

分布式、并行与集群计算 · 计算机科学 2025-05-23 Chou-Ying Hsieh , Chia-Ming Chang , Po-Hsiu Cheng , Sy-Yen Kuo

In 2013, Cuturi [Cut13] introduced the Sinkhorn algorithm for matrix scaling as a method to compute solutions to regularized optimal transport problems. In this paper, aiming at a better convergence rate for a high accuracy solution, we…

数据结构与算法 · 计算机科学 2023-04-06 Jingbang Chen , Li Chen , Yang P. Liu , Richard Peng , Arvind Ramaswami

In the dynamic linear program (LP) problem, we are given an LP undergoing updates and we need to maintain an approximately optimal solution. Recently, significant attention (e.g., [Gupta et al. STOC'17; Arar et al. ICALP'18, Wajc STOC'20])…

数据结构与算法 · 计算机科学 2022-07-18 Sayan Bhattacharya , Peter Kiss , Thatchaphol Saranurak