English
Related papers

Related papers: A generalised log-determinant regularizer for onli…

200 papers

We revisit the problem of \textit{online linear optimization} in case the set of feasible actions is accessible through an approximated linear optimization oracle with a factor $\alpha$ multiplicative approximation guarantee. This setting…

Machine Learning · Computer Science 2017-09-12 Dan Garber

Robust optimization is a common framework in optimization under uncertainty when the problem parameters are not known, but it is rather known that the parameters belong to some given uncertainty set. In the robust optimization framework the…

Optimization and Control · Mathematics 2014-02-27 Aharon Ben-Tal , Elad Hazan , Tomer Koren , Shie Mannor

Calculation of the log-normalizer is a major computational obstacle in applications of log-linear models with large output spaces. The problem of fast normalizer computation has therefore attracted significant attention in the theoretical…

Machine Learning · Statistics 2015-06-19 Jacob Andreas , Maxim Rabinovich , Dan Klein , Michael I. Jordan

Data-driven predictive control (DDPC) has been recently proposed as an effective alternative to traditional model-predictive control (MPC) for its unique features of being time-efficient and unbiased with respect to the oracle solution.…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Valentina Breschi , Alessandro Chiuso , Simone Formentin

In many online learning problems we are interested in predicting local information about some universe of items. For example, we may want to know whether two items are in the same cluster rather than computing an assignment of items to…

Machine Learning · Computer Science 2014-03-24 Paul Christiano

This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assuming strong convexity, precise results for the tracking…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

A matrix optimization problem over an uncertain linear system on finite horizon (abbreviated as MOPUL) is studied, in which the uncertain transition matrix is regarded as a decision variable. This problem is in general NP-hard. By using the…

Optimization and Control · Mathematics 2023-10-31 Jintao Xu , Shu-Cherng Fang , Wenxun Xing

Semidefinite programs (SDP) are one of the most versatile frameworks in numerical optimization, serving as generalizations of many conic programs and as relaxations of NP-hard combinatorial problems. Their main drawback is their…

Optimization and Control · Mathematics 2022-02-28 Biel Roig-Solvas , Mario Sznaier

We propose Okapi, a simple, efficient, and general method for robust semi-supervised learning based on online statistical matching. Our method uses a nearest-neighbours-based matching procedure to generate cross-domain views for a…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Myles Bartlett , Sara Romiti , Viktoriia Sharmanska , Novi Quadrianto

In this paper, we develop a unified framework for analyzing the tracking error and dynamic regret of inexact online optimization methods under a variety of settings. Specifically, we leverage the quadratic constraint approach from control…

Optimization and Control · Mathematics 2023-03-03 Usman Syed , Emiliano Dall'Anese , Bin Hu

Many problems in statistics and machine learning can be formulated as model selection problems, where the goal is to choose an optimal parsimonious model among a set of candidate models. It is typical to conduct model selection by…

Methodology · Statistics 2024-04-29 Qingyuan Zhang , Hien Duy Nguyen

This paper presents the generalized optimal sub-pattern assignment (GOSPA) metric on the space of finite sets of targets. Compared to the well-established optimal sub-pattern assignment (OSPA) metric, GOSPA is unnormalized as a function of…

Systems and Control · Computer Science 2018-09-13 Abu Sajana Rahmathullah , Ángel F. García-Fernández , Lennart Svensson

This paper studies the problem of maximizing the sum of traces of matrix quadratic forms on a product of Stiefel manifolds. This orthogonal trace-sum maximization (OTSM) problem generalizes many interesting problems such as generalized…

Optimization and Control · Mathematics 2021-02-09 Joong-Ho Won , Hua Zhou , Kenneth Lange

The partially observable Markov decision process (POMDP) provides a principled general framework for planning under uncertainty, but solving POMDPs optimally is computationally intractable, due to the "curse of dimensionality" and the…

Artificial Intelligence · Computer Science 2017-09-20 Nan Ye , Adhiraj Somani , David Hsu , Wee Sun Lee

We resolve the fundamental problem of online decoding with general $n^{th}$ order ergodic Markov chain models. Specifically, we provide deterministic and randomized algorithms whose performance is close to that of the optimal offline…

Machine Learning · Computer Science 2019-05-31 Vikas K. Garg , Tamar Pichkhadze

A distributed model predictive control scheme is developed for tracking piecewise constant references where the terminal set is reconfigured online, whereas the terminal controller is computed offline. Unlike many standard existing schemes,…

Systems and Control · Electrical Eng. & Systems 2022-07-20 Ahmed Aboudonia , Goran Banjac , Annika Eichler , John Lygeros

The efficiency of modern optimization methods, coupled with increasing computational resources, has led to the possibility of real-time optimization algorithms acting in safety critical roles. There is a considerable body of mathematical…

Systems and Control · Computer Science 2014-09-03 Timothy Wang , Romain Jobredeaux , Marc Pantel , Pierre-Loic Garoche , Eric Feron , Didier Henrion

One specific subset of quantum algorithms is Grovers Ordered Search Problem (OSP), the quantum counterpart of the classical binary search algorithm, which utilizes oracle functions to produce a specified value within an ordered database.…

Quantum Physics · Physics 2017-01-24 Jupinder Parmar , Saarim Rahman , Jesse Thiara

Online learning algorithms are fast, memory-efficient, easy to implement, and applicable to many prediction problems, including classification, regression, and ranking. Several online algorithms were proposed in the past few decades, some…

Machine Learning · Computer Science 2015-07-03 Francesco Orabona , Koby Crammer , Nicolò Cesa-Bianchi

A new approach to solving a large class of factorable nonlinear programming (NLP) problems to global optimality is presented in this paper. Unlike the traditional strategy of partitioning the decision-variable space employed in many…

Optimization and Control · Mathematics 2015-04-28 Gene A. Bunin