English
Related papers

Related papers: Worst Case Competitive Analysis of Online Algorith…

200 papers

We study Smoothed Online Convex Optimization, a version of online convex optimization where the learner incurs a penalty for changing her actions between rounds. Given a $\Omega(\sqrt{d})$ lower bound on the competitive ratio of any online…

Machine Learning · Computer Science 2018-07-10 Niangjun Chen , Gautam Goel , Adam Wierman

In this paper we consider a class of optimization problems with a strongly convex objective function and the feasible set given by an intersection of a simple convex set with a set given by a number of linear equality and inequality…

Optimization and Control · Mathematics 2016-05-11 Alexey Chernov , Pavel Dvurechensky , Alexander Gasnikov

Quadratic constrained quadratic programming problems often occur in various fields such as engineering practice, management science, and network communication. This article mainly studies a non convex quadratic programming problem with…

Optimization and Control · Mathematics 2023-12-29 Bo Zhang , YueLin Gao , Xia Liu , XiaoLi Huang

This article presents a simplification of Zadimoghaddam's algorithm for the edge-weighted online bipartite matching problem, under the online primal dual framework. In doing so, we obtain an improved competitive ratio of $0.514$. We first…

Data Structures and Algorithms · Computer Science 2019-10-09 Zhiyi Huang

Within the context of stochastic probing with commitment, we consider the online stochastic matching problem; that is, the one sided online bipartite matching problem where edges adjacent to an online node must be probed to determine if…

Data Structures and Algorithms · Computer Science 2021-01-07 Allan Borodin , Calum MacRury , Akash Rakheja

Recently, several universal methods have been proposed for online convex optimization, and attain minimax rates for multiple types of convex functions simultaneously. However, they need to design and optimize one surrogate loss for each…

Machine Learning · Computer Science 2024-11-21 Lijun Zhang , Yibo Wang , Guanghui Wang , Jinfeng Yi , Tianbao Yang

We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that…

Machine Learning · Computer Science 2026-01-06 Hao Ma , Melanie Zeilinger , Michael Muehlebach

Online bipartite matching and its variants are among the most fundamental problems in the online algorithms literature. Karp, Vazirani, and Vazirani (STOC 1990) introduced an elegant algorithm for the unweighted problem that achieves an…

Data Structures and Algorithms · Computer Science 2024-06-05 Matthew Fahrbach , Zhiyi Huang , Runzhou Tao , Morteza Zadimoghaddam

In this paper we propose a model-based approach to the design of online optimization algorithms, with the goal of improving the tracking of the solution trajectory (trajectories) w.r.t. state-of-the-art methods. We focus first on quadratic…

Optimization and Control · Mathematics 2023-07-24 Nicola Bastianello , Ruggero Carli , Sandro Zampieri

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

Optimization of convex functions under stochastic zeroth-order feedback has been a major and challenging question in online learning. In this work, we consider the problem of optimizing second-order smooth and strongly convex functions…

Machine Learning · Computer Science 2024-07-01 Qian Yu , Yining Wang , Baihe Huang , Qi Lei , Jason D. Lee

We propose first order algorithms for convex optimization problems where the feasible set is described by a large number of convex inequalities that is to be explored by subgradient projections. The first algorithm is an adaptation of a…

Optimization and Control · Mathematics 2015-06-30 C. H. Jeffrey Pang

We introduce a new rounding technique designed for online optimization problems, which is related to contention resolution schemes, a technique initially introduced in the context of submodular function maximization. Our rounding technique,…

Data Structures and Algorithms · Computer Science 2015-10-15 Moran Feldman , Ola Svensson , Rico Zenklusen

In search problems, a mobile searcher seeks to locate a target that hides in some unknown position of the environment. Such problems are typically considered to be of an on-line nature, in that the input is unknown to the searcher, and the…

Data Structures and Algorithms · Computer Science 2018-10-19 Spyros Angelopoulos , Christoph Dürr , Shendan Jin

We present a hybrid algorithm for optimizing a convex, smooth function over the cone of positive semidefinite matrices. Our algorithm converges to the global optimal solution and can be used to solve general large-scale semidefinite…

Machine Learning · Computer Science 2012-06-22 Soeren Laue

Algorithmic decision-making in societal contexts, such as retail pricing, loan administration, recommendations on online platforms, etc., can be framed as stochastic optimization under bandit feedback, which typically requires…

Machine Learning · Computer Science 2024-10-22 Jad Salem , Swati Gupta , Vijay Kamble

In this paper we analyze several new methods for solving nonconvex optimization problems with the objective function formed as a sum of two terms: one is nonconvex and smooth, and another is convex but simple and its structure is known.…

Optimization and Control · Mathematics 2014-06-25 A. Patrascu , I. Necoara

In the last several years, the intimate connection between convex optimization and learning problems, in both statistical and sequential frameworks, has shifted the focus of algorithmic machine learning to examine this interplay. In…

Machine Learning · Computer Science 2014-07-23 Mehrdad Mahdavi

Online optimisation revolves around new data being introduced into a problem while it is still being solved; think of deep learning as more training samples become available. We adapt the idea to dynamic inverse problems such as video…

Optimization and Control · Mathematics 2021-01-06 Tuomo Valkonen

Machine Learning models incorporating multiple layered learning networks have been seen to provide effective models for various classification problems. The resulting optimization problem to solve for the optimal vector minimizing the…

Optimization and Control · Mathematics 2018-07-03 Vyacheslav Kungurtsev , Tomas Pevny