English
Related papers

Related papers: A generalised log-determinant regularizer for onli…

200 papers

It is well-known that by adding integrality constraints to the semidefinite programming (SDP) relaxation of the max-cut problem, the resulting integer semidefinite program is an exact formulation of the problem. In this paper we show…

Optimization and Control · Mathematics 2023-11-09 Frank de Meijer , Renata Sotirov

In this paper, we analyze the problem of online convex optimization in different settings, including different feedback types (full-information/semi-bandit/bandit/etc) in either stochastic or non-stochastic setting and different notions of…

Machine Learning · Computer Science 2026-02-23 Mohammad Pedramfar , Vaneet Aggarwal

Partially observable Markov decision processes (POMDPs) are a natural model for planning problems where effects of actions are nondeterministic and the state of the world is not completely observable. It is difficult to solve POMDPs…

Artificial Intelligence · Computer Science 2009-09-25 N. L. Zhang , W. Liu

We give an algorithmic framework for minimizing general convex objectives (that are differentiable and monotone non-decreasing) over a set of covering constraints that arrive online. This substantially extends previous work on online…

Data Structures and Algorithms · Computer Science 2014-12-12 Yossi Azar , Ilan Reuven Cohen , Debmalya Panigrahi

We consider the problem of computing a positive definite $p \times p$ inverse covariance matrix aka precision matrix $\theta=(\theta_{ij})$ which optimizes a regularized Gaussian maximum likelihood problem, with the elastic-net regularizer…

Statistics Theory · Mathematics 2015-09-02 Yves F. Atchadé , Rahul Mazumder , Jie Chen

Generalised planning (GP) refers to the task of synthesising programs that solve families of related planning problems. We introduce a novel, yet simple method for GP: given a set of training problems, for each problem, compute an optimal…

Artificial Intelligence · Computer Science 2025-11-17 Dillon Z. Chen , Till Hofmann , Toryn Q. Klassen , Sheila A. McIlraith

We develop a practical approach to semidefinite programming (SDP) that includes the von Neumann entropy, or an appropriate variant, as a regularization term. In particular we solve the dual of the regularized program, demonstrating how a…

Optimization and Control · Mathematics 2023-03-23 Michael Lindsey

Semidefinite programming (SDP) is a powerful framework from convex optimization that has striking potential for data science applications. This paper develops a provably correct randomized algorithm for solving large, weakly constrained SDP…

Optimization and Control · Mathematics 2021-03-26 Alp Yurtsever , Joel A. Tropp , Olivier Fercoq , Madeleine Udell , Volkan Cevher

We study the generalized linear bandit (GLB) problem, a contextual multi-armed bandit framework that extends the classical linear model by incorporating a non-linear link function, thereby modeling a broad class of reward distributions such…

Machine Learning · Computer Science 2025-10-31 Yu-Jie Zhang , Sheng-An Xu , Peng Zhao , Masashi Sugiyama

We study the generalization performance of online learning algorithms trained on samples coming from a dependent source of data. We show that the generalization error of any stable online algorithm concentrates around its regret--an easily…

Machine Learning · Statistics 2012-06-08 Alekh Agarwal , John C. Duchi

Contextual online decision-making problems with constraints appear in a wide range of real-world applications, such as adaptive experimental design under safety constraints, personalized recommendation with resource limits, and dynamic…

Machine Learning · Statistics 2025-05-23 Haichen Hu , David Simchi-Levi , Navid Azizan

We propose a new framework for reasoning about generalization in deep learning. The core idea is to couple the Real World, where optimizers take stochastic gradient steps on the empirical loss, to an Ideal World, where optimizers take steps…

Machine Learning · Computer Science 2021-02-22 Preetum Nakkiran , Behnam Neyshabur , Hanie Sedghi

Planning under partial observability is an essential capability of autonomous robots. The Partially Observable Markov Decision Process (POMDP) provides a powerful framework for planning under partial observability problems, capturing the…

Robotics · Computer Science 2026-03-11 Marcus Hoerger , Muhammad Sudrajat , Hanna Kurniawati

This paper studies the problem of deterministic rank-one matrix completion. It is known that the simplest semidefinite programming relaxation, involving minimization of the nuclear norm, does not in general return the solution for this…

Numerical Analysis · Mathematics 2018-01-03 Augustin Cosse , Laurent Demanet

As application demands for online convex optimization accelerate, the need for designing new methods that simultaneously cover a large class of convex functions and impose the lowest possible regret is highly rising. Known online…

Machine Learning · Computer Science 2019-06-04 Saeed Masoudian , Ali Arabzadeh , Mahdi Jafari Siavoshani , Milad Jalal , Alireza Amouzad

A regularized optimization problem over a large unstructured graph is studied, where the regularization term is tied to the graph geometry. Typical regularization examples include the total variation and the Laplacian regularizations over…

Optimization and Control · Mathematics 2017-12-20 Adil Salim , Pascal Bianchi , Walid Hachem

In the online matching on the line problem, the task is to match a set of requests $R$ online to a given set of servers $S$. The distance metric between any two points in $R\,\cup\, S$ is a line metric and the objective for the online…

Data Structures and Algorithms · Computer Science 2017-12-20 Antonios Antoniadis , Carsten Fischer , Andreas Tönnis

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

Partially Observable Markov Decision Processes (POMDPs) provide a rich framework for sequential decision-making under uncertainty in stochastic domains. However, solving a POMDP is often intractable except for small problems due to their…

Artificial Intelligence · Computer Science 2014-01-16 Stéphane Ross , Joelle Pineau , Sébastien Paquet , Brahim Chaib-draa

This paper studies the problem of finding an $(1+\epsilon)$-approximate solution to positive semidefinite programs. These are semidefinite programs in which all matrices in the constraints and objective are positive semidefinite and all…

Data Structures and Algorithms · Computer Science 2016-02-23 Richard Peng , Kanat Tangwongsan , Peng Zhang