中文
相关论文

相关论文: A Modular Algorithm for Non-Stationary Online Conv…

200 篇论文

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

最优化与控制 · 数学 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva

This paper presents a new framework for analyzing and designing no-regret algorithms for dynamic (possibly adversarial) systems. The proposed framework generalizes the popular online convex optimization framework and extends it to its…

机器学习 · 计算机科学 2016-08-30 Ian Gemp , Sridhar Mahadevan

This article investigates the problem of controlling linear time-invariant systems subject to time-varying and a priori unknown cost functions, state and input constraints, and exogenous disturbances. We combine the online convex…

系统与控制 · 电气工程与系统科学 2025-12-18 Marko Nonhoff , Emiliano Dall'Anese , Matthias A. Müller

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

机器学习 · 计算机科学 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

This paper investigates the convex optimization problem with general convex inequality constraints. To cope with this problem, a discrete-time algorithm, called augmented primal-dual gradient algorithm (Aug-PDG), is studied and analyzed. It…

最优化与控制 · 数学 2020-11-18 Min Meng , Xiuxian Li

The aim of this manuscript is to approach by means of first order differential equations/inclusions convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the…

最优化与控制 · 数学 2020-05-21 Sandy Bitterlich , Ernö Robert Csetnek , Gert Wanka

This article explores distributed convex optimization with globally-coupled constraints, where the objective function is a general nonsmooth convex function, the constraints include nonlinear inequalities and affine equalities, and the…

最优化与控制 · 数学 2025-03-14 Zixuan Liu , Xuyang Wu , Dandan Wang , Jie Lu

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the…

最优化与控制 · 数学 2019-06-06 Xinlei Yi , Xiuxian Li , Lihua Xie , Karl H. Johansson

Adaptive gradient algorithms such as ADAGRAD and its variants have gained popularity in the training of deep neural networks. While many works as for adaptive methods have focused on the static regret as a performance metric to achieve a…

机器学习 · 计算机科学 2022-09-07 Parvin Nazari , Esmaile Khorram

Recently, an intriguing class of non-convex optimization problems has emerged in the context of learning directed acyclic graphs (DAGs). These problems involve minimizing a given loss or score function, subject to a non-convex continuous…

机器学习 · 统计学 2023-05-30 Chang Deng , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

We propose new algorithms with provable performance for online binary optimization subject to general constraints and in dynamic settings. We consider the subset of problems in which the objective function is submodular. We propose the…

最优化与控制 · 数学 2024-05-03 Antoine Lesage-Landry , Julien Pallage

Regret minimization is treated as the golden rule in the traditional study of online learning. However, regret minimization algorithms tend to converge to the static optimum, thus being suboptimal for changing environments. To address this…

机器学习 · 计算机科学 2020-02-07 Lijun Zhang , Shiyin Lu , Tianbao Yang

Real-world multiobjective optimization problems usually involve conflicting objectives that change over time, which requires the optimization algorithms to quickly track the Pareto optimal front (POF) when the environment changes. In recent…

神经与进化计算 · 计算机科学 2021-02-25 Dejun Xu , Min Jiang , Weizhen Hu , Shaozi Li , Renhu Pan , Gary G. Yen

Bandit Convex Optimization (BCO) is a fundamental framework for modeling sequential decision-making with partial information, where the only feedback available to the player is the one-point or two-point function values. In this paper, we…

机器学习 · 计算机科学 2020-07-07 Peng Zhao , Guanghui Wang , Lijun Zhang , Zhi-Hua Zhou

In this paper we consider a distributed optimization scenario in which a set of agents has to solve a convex optimization problem with separable cost function, local constraint sets and a coupling inequality constraint. We propose a novel…

系统与控制 · 计算机科学 2018-04-25 Ivano Notarnicola , Giuseppe Notarstefano

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

机器学习 · 计算机科学 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

In the past few years, Online Convex Optimization (OCO) has received notable attention in the control literature thanks to its flexible real-time nature and powerful performance guarantees. In this paper, we propose new step-size rules and…

最优化与控制 · 数学 2023-01-18 Pedro Zattoni Scroccaro , Arman Sharifi Kolarijani , Peyman Mohajerin Esfahani

Optimization of DR-submodular functions has experienced a notable surge in significance in recent times, marking a pivotal development within the domain of non-convex optimization. Motivated by real-world scenarios, some recent works have…

机器学习 · 计算机科学 2024-01-18 Loay Mualem , Murad Tukan , Moran Fledman

This paper addresses an online convex optimization problem where the cost function at each step depends on a history of past decisions (i.e., memory), and the decision maker has access to limited predictions of future cost values within a…

最优化与控制 · 数学 2025-12-29 Zhengmiao Wang , Zhi-Wei Liu , Ming Chi , Xiaoling Wang , Housheng Su , Lintao Ye

We introduce the online stochastic Convex Programming (CP) problem, a very general version of stochastic online problems which allows arbitrary concave objectives and convex feasibility constraints. Many well-studied problems like online…

机器学习 · 计算机科学 2014-10-29 Shipra Agrawal , Nikhil R. Devanur