English
Related papers

Related papers: Fast Algorithms for Online Stochastic Convex Progr…

200 papers

This paper studies the online stochastic resource allocation problem (RAP) with chance constraints. The online RAP is a 0-1 integer linear programming problem where the resource consumption coefficients are revealed column by column along…

Optimization and Control · Mathematics 2023-03-07 Yuwei Chen , Zengde Deng , Yinzhi Zhou , Zaiyi Chen , Yujie Chen , Haoyuan Hu

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

Statistics Theory · Mathematics 2018-05-24 Pierre Gaillard , Olivier Wintenberger

In this paper, we propose two novel non-stationary first-order primal-dual algorithms to solve nonsmooth composite convex optimization problems. Unlike existing primal-dual schemes where the parameters are often fixed, our methods use…

Optimization and Control · Mathematics 2020-07-13 Quoc Tran-Dinh , Yuzixuan Zhu

In this paper, we consider the problem of stochastic optimization, where the objective function is in terms of the expectation of a (possibly non-convex) cost function that is parametrized by a random variable. While the convergence speed…

Information Theory · Computer Science 2019-10-23 Naeimeh Omidvar , An Liu , Vincent Lau , Danny H. K. Tsang , Mohammad Reza Pakravan

In this paper we propose a general framework to characterize and solve the stochastic optimization problems with multiple objectives underlying many real world learning applications. We first propose a projection based algorithm which…

Machine Learning · Computer Science 2013-07-16 Mehrdad Mahdavi , Tianbao Yang , Rong Jin

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

There has been a growing interest in studying online stochastic packing under more general correlation structures, motivated by the complex data sets and models driving modern applications. Several past works either assume correlations are…

Optimization and Control · Mathematics 2025-09-03 Sabri Cetin , Yilun Chen , David A. Goldberg

We give an algorithmic framework for minimizing general convex objectives (that are differentiable and monotone non-decreasing) over a set of covering constraints that arrive online. This substantially extends previous work on online…

Data Structures and Algorithms · Computer Science 2014-12-12 Yossi Azar , Ilan Reuven Cohen , Debmalya Panigrahi

We consider Lagrangian duality based approaches to design and analyze algorithms for online energy-efficient scheduling. First, we present a primal-dual framework. Our approach makes use of the Lagrangian weak duality and convexity to…

Data Structures and Algorithms · Computer Science 2014-08-06 Nguyen Kim Thang

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

Machine Learning · Statistics 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

Stochastic approximation techniques have been used in various contexts in data science. We propose a stochastic version of the forward-backward algorithm for minimizing the sum of two convex functions, one of which is not necessarily…

Optimization and Control · Mathematics 2016-02-26 Patrick L. Combettes , Jean-Christophe Pesquet

We study online statistical inference for the solutions of stochastic optimization problems with equality and inequality constraints. Such problems are prevalent in statistics and machine learning, encompassing constrained $M$-estimation,…

Machine Learning · Statistics 2025-12-11 Yihang Gao , Michael K. Ng , Michael W. Mahoney , Sen Na

This paper addresses the design and analysis of feedback-based online algorithms to control systems or networked systems based on performance objectives and engineering constraints that may evolve over time. The emerging time-varying convex…

Optimization and Control · Mathematics 2019-03-27 Andrey Bernstein , Emiliano Dall'Anese , Andrea Simonetto

Learning-augmented algorithms has been extensively studied recently in the computer-science community, due to the potential of using machine learning predictions in order to improve the performance of algorithms. Predictions are especially…

Data Structures and Algorithms · Computer Science 2024-06-07 Elena Grigorescu , Young-San Lin , Maoyuan Song

By time discretization of a second-order primal-dual dynamical system with damping $\alpha/t$ where an inertial construction in the sense of Nesterov is needed only for the primal variable, we propose a fast primal-dual algorithm for a…

Optimization and Control · Mathematics 2022-06-06 Xin He , Rong Hu , Ya-Ping Fang

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

Making use of predictions is a crucial, but under-explored, area of online algorithms. This paper studies a class of online optimization problems where we have external noisy predictions available. We propose a stochastic prediction error…

Machine Learning · Computer Science 2015-04-28 Niangjun Chen , Anish Agarwal , Adam Wierman , Siddharth Barman , Lachlan L. H. Andrew

Stochastic optimization finds a wide range of applications in operations research and management science. However, existing stochastic optimization techniques usually require the information of random samples (e.g., demands in the…

Optimization and Control · Mathematics 2019-04-18 Xi Chen , Qihang Lin , Zizhuo Wang

The knapsack problem is one of the classical problems in combinatorial optimization: Given a set of items, each specified by its size and profit, the goal is to find a maximum profit packing into a knapsack of bounded capacity. In the…

Data Structures and Algorithms · Computer Science 2020-12-02 Susanne Albers , Arindam Khan , Leon Ladewig