English
Related papers

Related papers: MetaGrad: Multiple Learning Rates in Online Learni…

200 papers

We consider online optimization with binary decision variables and convex loss functions. We design a new algorithm, binary online gradient descent (bOGD) and bound its expected dynamic regret. We provide a regret bound that holds for any…

Optimization and Control · Mathematics 2022-01-21 Antoine Lesage-Landry , Joshua A. Taylor , Duncan S. Callaway

We introduce a technique for tuning the learning rate scale factor of any base optimization algorithm and schedule automatically, which we call \textsc{mechanic}. Our method provides a practical realization of recent theoretical reductions…

Machine Learning · Computer Science 2023-06-05 Ashok Cutkosky , Aaron Defazio , Harsh Mehta

Hoffman's classical result gives a bound on the distance of a point from a convex and compact polytope in terms of the magnitude of violation of the constraints. Recently, several results showed that Hoffman's bound can be used to derive…

Machine Learning · Computer Science 2019-02-19 Dan Garber

We develop a novel family of algorithms for the online learning setting with regret against any data sequence bounded by the empirical Rademacher complexity of that sequence. To develop a general theory of when this type of adaptive regret…

Machine Learning · Computer Science 2017-04-14 Dylan J. Foster , Alexander Rakhlin , Karthik Sridharan

We consider online learning with linear models, where the algorithm predicts on sequentially revealed instances (feature vectors), and is compared against the best linear function (comparator) in hindsight. Popular algorithms in this…

Machine Learning · Computer Science 2019-02-21 Michał Kempka , Wojciech Kotłowski , Manfred K. Warmuth

We study online meta-learning with bandit feedback, with the goal of improving performance across multiple tasks if they are similar according to some natural similarity measure. As the first to target the adversarial online-within-online…

Machine Learning · Computer Science 2023-11-02 Mikhail Khodak , Ilya Osadchiy , Keegan Harris , Maria-Florina Balcan , Kfir Y. Levy , Ron Meir , Zhiwei Steven Wu

The performance of online convex optimization algorithms in a dynamic environment is often expressed in terms of the dynamic regret, which measures the decision maker's performance against a sequence of time-varying comparators. In the…

Machine Learning · Computer Science 2022-02-28 Nima Eshraghi , Ben Liang

We analyze the meta-learning of the initialization and step-size of learning algorithms for piecewise-Lipschitz functions, a non-convex setting with applications to both machine learning and algorithms. Starting from recent regret bounds…

Machine Learning · Computer Science 2021-08-20 Maria-Florina Balcan , Mikhail Khodak , Dravyansh Sharma , Ameet Talwalkar

We study Online Convex Optimization in the unbounded setting where neither predictions nor gradient are constrained. The goal is to simultaneously adapt to both the sequence of gradients and the comparator. We first develop parameter-free…

Machine Learning · Computer Science 2020-08-11 Zakaria Mhammedi , Wouter M. Koolen

We develop new approaches in multi-class settings for constructing proper scoring rules and hinge-like losses and establishing corresponding regret bounds with respect to the zero-one or cost-weighted classification loss. Our construction…

Statistics Theory · Mathematics 2021-05-18 Zhiqiang Tan , Xinwei Zhang

Projection-free online learning has drawn increasing interest due to its efficiency in solving high-dimensional problems with complicated constraints. However, most existing projection-free online methods focus on minimizing the static…

Machine Learning · Computer Science 2023-05-22 Yibo Wang , Wenhao Yang , Wei Jiang , Shiyin Lu , Bing Wang , Haihong Tang , Yuanyu Wan , Lijun Zhang

This paper establishes minimax rates for online regression with arbitrary classes of functions and general losses. We show that below a certain threshold for the complexity of the function class, the minimax rates depend on both the…

Machine Learning · Statistics 2015-01-28 Alexander Rakhlin , Karthik Sridharan

In this paper, we revisit the online non-monotone continuous DR-submodular maximization problem over a down-closed convex set, which finds wide real-world applications in the domain of machine learning, economics, and operations research.…

Machine Learning · Computer Science 2022-08-17 Qixin Zhang , Zengde Deng , Zaiyi Chen , Kuangqi Zhou , Haoyuan Hu , Yu Yang

A new algorithm for regret minimization in online convex optimization is described. The regret of the algorithm after $T$ time periods is $O(\sqrt{T \log T})$ - which is the minimum possible up to a logarithmic term. In addition, the new…

Machine Learning · Computer Science 2023-07-24 Elad Hazan , Nimrod Megiddo

The goal of a learner in standard online learning is to maintain an average loss close to the loss of the best-performing single function in some class. In many real-world problems, such as rating or ranking items, there is no single best…

Machine Learning · Computer Science 2013-03-18 Edward Moroshko , Koby Crammer

Optimization theory has been widely studied in academia and finds a large variety of applications in industry. The different optimization models in their discrete and/or continuous settings have catered to a rich source of research…

Quantum Physics · Physics 2026-03-16 Debbie Lim , Joao F. Doriguello , Patrick Rebentrost

Machine learning problems with multiple objective functions appear either in learning with multiple criteria where learning has to make a trade-off between multiple performance metrics such as fairness, safety and accuracy; or, in…

Machine Learning · Computer Science 2024-03-20 Heshan Fernando , Han Shen , Miao Liu , Subhajit Chaudhury , Keerthiram Murugesan , Tianyi Chen

Algorithms for online learning typically require one or more boundedness assumptions: that the domain is bounded, that the losses are Lipschitz, or both. In this paper, we develop a new setting for online learning with unbounded domains and…

Machine Learning · Computer Science 2023-07-18 Andrew Jacobsen , Ashok Cutkosky

In this paper, we present new stochastic methods for solving two important classes of nonconvex optimization problems. We first introduce a randomized accelerated proximal gradient (RapGrad) method for solving a class of nonconvex…

Optimization and Control · Mathematics 2019-08-20 Guanghui Lan , Yu Yang

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a stochastic gradient of its own objective function in the previous time, and can communicate with its neighbors via a…

Optimization and Control · Mathematics 2024-01-29 Yuchen Yang , Kaihong Lu , Long Wang