English
Related papers

Related papers: Online learning with exponential weights in metric…

200 papers

Algorithm designers typically assume that the input data is correct, and then proceed to find "optimal" or "sub-optimal" solutions using this input data. However this assumption of correct data does not always hold in practice, especially…

Machine Learning · Computer Science 2015-10-13 Hal Daumé , Samir Khuller , Manish Purohit , Gregory Sanders

We study the problem of predicting the results of computations that are too expensive to run, via the observation of the results of smaller computations. We model this as an online learning problem with delayed feedback, where the length of…

Machine Learning · Computer Science 2016-09-08 Scott Garrabrant , Nate Soares , Jessica Taylor

Several practical applications of reinforcement learning involve an agent learning from past data without the possibility of further exploration. Often these applications require us to 1) identify a near optimal policy or to 2) estimate the…

Machine Learning · Computer Science 2021-06-22 Andrea Zanette

The emerging field of learning-augmented online algorithms uses ML techniques to predict future input parameters and thereby improve the performance of online algorithms. Since these parameters are, in general, real-valued functions, a…

Machine Learning · Computer Science 2022-05-26 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

In this paper, we demonstrate how to learn the objective function of a decision-maker while only observing the problem input data and the decision-maker's corresponding decisions over multiple rounds. We present exact algorithms for this…

Optimization and Control · Mathematics 2020-03-31 Andreas Bärmann , Alexander Martin , Sebastian Pokutta , Oskar Schneider

Machine Learning is becoming more prevalent in science and engineering, but many approaches do not provide meaningful uncertainty estimates and predictions may also violate known physical knowledge. We propose a Bayesian framework to embed…

Machine Learning · Computer Science 2026-04-29 Matthew Marsh , Benoît Chachuat , Antonio del Rio Chanona

We present a novel method for convex unconstrained optimization that, without any modifications, ensures: (i) accelerated convergence rate for smooth objectives, (ii) standard convergence rate in the general (non-smooth) setting, and (iii)…

Machine Learning · Computer Science 2018-09-11 Kfir Y. Levy , Alp Yurtsever , Volkan Cevher

Many machine learning algorithms are based on the assumption that training examples are drawn independently. However, this assumption does not hold anymore when learning from a networked sample where two or more training examples may share…

Machine Learning · Computer Science 2017-02-21 Yuyi Wang , Jan Ramon , Zheng-Chu Guo

In this paper, an online learning algorithm is proposed as sequential stochastic approximation of a regularization path converging to the regression function in reproducing kernel Hilbert spaces (RKHSs). We show that it is possible to…

Probability · Mathematics 2013-01-23 Pierre Tarrès , Yuan Yao

Binary Neural Networks (BiNNs), which employ single-bit precision weights, have emerged as a promising solution to reduce memory usage and power consumption while maintaining competitive performance in large-scale systems. However, training…

Quantum Physics · Physics 2025-11-18 Luca Nepote , Alix Lhéritier , Nicolas Bondoux , Marios Kountouris , Maurizio Filippone

We consider the viability of a modularised mechanistic online machine learning framework to learn signals in low-frequency financial time series data. The framework is proved on daily sampled closing time-series data from JSE equity…

Statistical Finance · Quantitative Finance 2021-01-11 Joel da Costa , Tim Gebbie

Anomaly detection is an important task in many real world applications such as fraud detection, suspicious activity detection, health care monitoring etc. In this paper, we tackle this problem from supervised learning perspective in online…

Machine Learning · Computer Science 2015-08-28 Chandresh Kumar Maurya , Durga Toshniwal , Gopalan Vijendran Venkoparao

Online enrichment is the extension of a reduced solution space based on the solution of the reduced model. Procedures for online enrichment were published for many localized model order reduction techniques. We show that residual based…

Numerical Analysis · Mathematics 2018-07-31 Andreas Buhr

In this work, we upper bound the generalization error of batch learning algorithms trained on samples drawn from a mixing stochastic process (i.e., a dependent data source) both in expectation and with high probability. Unlike previous…

Machine Learning · Computer Science 2025-02-20 Sagnik Chatterjee , Manuj Mukherjee , Alhad Sethi

Inverse optimization is a powerful paradigm for learning preferences and restrictions that explain the behavior of a decision maker, based on a set of external signal and the corresponding decision pairs. However, most inverse optimization…

Machine Learning · Computer Science 2018-11-05 Chaosheng Dong , Yiran Chen , Bo Zeng

We study Online Convex Optimization in the unbounded setting where neither predictions nor gradient are constrained. The goal is to simultaneously adapt to both the sequence of gradients and the comparator. We first develop parameter-free…

Machine Learning · Computer Science 2020-08-11 Zakaria Mhammedi , Wouter M. Koolen

We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a…

Machine Learning · Computer Science 2021-04-21 Alfonso Lobos , Paul Grigas , Zheng Wen

The goal of metric learning is to learn a function that maps samples to a lower-dimensional space where similar samples lie closer than dissimilar ones. Particularly, deep metric learning utilizes neural networks to learn such a mapping.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jenny Seidenschwarz , Ismail Elezi , Laura Leal-Taixé

This paper studies online algorithms augmented with multiple machine-learned predictions. While online algorithms augmented with a single prediction have been extensively studied in recent years, the literature for the multiple predictions…

Machine Learning · Computer Science 2022-07-14 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

Networked data, in which every training example involves two objects and may share some common objects with others, is used in many machine learning tasks such as learning to rank and link prediction. A challenge of learning from networked…

Machine Learning · Computer Science 2017-11-23 Yuanhong Wang , Yuyi Wang , Xingwu Liu , Juhua Pu