English
Related papers

Related papers: Learning the Experts for Online Sequence Predictio…

200 papers

We study a theoretical and algorithmic framework for structured prediction in the online learning setting. The problem of structured prediction, i.e. estimating function where the output space lacks a vectorial structure, is well studied in…

Machine Learning · Computer Science 2024-06-19 Pierre Boudart , Alessandro Rudi , Pierre Gaillard

We develop an online learning method for prediction, which is important in problems with large and/or streaming data sets. We formulate the learning approach using a covariance-fitting methodology, and show that the resulting predictor has…

Machine Learning · Computer Science 2017-03-16 Dave Zachariah , Petre Stoica , Thomas B. Schön

In the online learning with experts problem, an algorithm must make a prediction about an outcome on each of $T$ days (or times), given a set of $n$ experts who make predictions on each day (or time). The algorithm is given feedback on the…

Data Structures and Algorithms · Computer Science 2023-03-06 David P. Woodruff , Fred Zhang , Samson Zhou

We consider the problem of estimating piecewise regular functions in an online setting, i.e., the data arrive sequentially and at any round our task is to predict the value of the true function at the next revealed point using the available…

Statistics Theory · Mathematics 2022-04-01 Sabyasachi Chatterjee , Subhajit Goswami

In this paper, we investigate the framework of Online Convex Optimization (OCO) for online learning. OCO offers a very powerful online learning framework for many applications. In this context, we study a specific framework of OCO called…

Machine Learning · Computer Science 2022-11-01 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

We propose a novel sequence prediction method for sequential data capturing node traversals in graphs. Our method builds on a statistical modelling framework that combines multiple higher-order network models into a single multi-order…

Machine Learning · Computer Science 2023-10-25 Christoph Gote , Giona Casiraghi , Frank Schweitzer , Ingo Scholtes

Online learning methods yield sequential regret bounds under minimal assumptions and provide in-expectation risk bounds for statistical learning. However, despite the apparent advantage of online guarantees over their statistical…

Machine Learning · Computer Science 2023-08-16 Dirk van der Hoeven , Nikita Zhivotovskiy , Nicolò Cesa-Bianchi

Bin packing is a classic optimization problem with a wide range of applications, from load balancing to supply chain management. In this work, we study the online variant of the problem, in which a sequence of items of various sizes must be…

Data Structures and Algorithms · Computer Science 2024-04-18 Spyros Angelopoulos , Shahin Kamali , Kimia Shadkami

Predicting future frames in natural video sequences is a new challenge that is receiving increasing attention in the computer vision community. However, existing models suffer from severe loss of temporal information when the predicted…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Junyan Wang , Bingzhang Hu , Yang Long , Yu Guan

We study online classification when the learner has access to predictions about future examples. We design an online learner whose expected regret is never worse than the worst-case regret, gracefully improves with the quality of the…

Machine Learning · Computer Science 2024-05-24 Vinod Raman , Ambuj Tewari

Clinical event sequences consist of thousands of clinical events that represent records of patient care in time. Developing accurate prediction models for such sequences is of a great importance for defining representations of a patient…

Machine Learning · Computer Science 2021-04-07 Jeong Min Lee , Milos Hauskrecht

One of the goals of learning algorithms is to complement and reduce the burden on human decision makers. The expert deferral setting wherein an algorithm can either predict on its own or defer the decision to a downstream expert helps…

Machine Learning · Computer Science 2022-07-21 Mohammad-Amin Charusaie , Hussein Mozannar , David Sontag , Samira Samadi

In this thesis, we develop various techniques for working with sets in machine learning. Each input or output is not an image or a sequence, but a set: an unordered collection of multiple objects, each object described by a feature vector.…

Machine Learning · Computer Science 2021-03-09 Yan Zhang

In online interval scheduling, the input is an online sequence of intervals, and the goal is to accept a maximum number of non-overlapping intervals. In the more general disjoint path allocation problem, the input is a sequence of requests,…

Data Structures and Algorithms · Computer Science 2025-01-24 Joan Boyar , Lene M. Favrholdt , Shahin Kamali , Kim S. Larsen

Conformal prediction is a framework for uncertainty quantification that constructs prediction sets for previously unseen data, guaranteeing coverage of the true label with a specified probability. However, the efficiency of these prediction…

Machine Learning · Computer Science 2026-01-06 Erfan Hajihashemi , Yanning Shen

A growing line of work shows how learned predictions can be used to break through worst-case barriers to improve the running time of an algorithm. However, incorporating predictions into data structures with strong theoretical guarantees…

Data Structures and Algorithms · Computer Science 2023-06-21 Samuel McCauley , Benjamin Moseley , Aidin Niaparast , Shikha Singh

Given a sequence of independent random variables with a common continuous distribution, we consider the online decision problem where one seeks to minimize the expected value of the time that is needed to complete the selection of a…

Probability · Mathematics 2016-09-05 Alessandro Arlotto , Elchanan Mossel , J. Michael Steele

Designing online algorithms with machine learning predictions is a recent technique beyond the worst-case paradigm for various practically relevant online problems (scheduling, caching, clustering, ski rental, etc.). While most previous…

Data Structures and Algorithms · Computer Science 2023-12-25 Enikő Kevi , Kim-Thang Nguyen

With the developments in machine learning, there has been a surge in interest and results focused on algorithms utilizing predictions, not least in online algorithms where most new results incorporate the prediction aspect for concrete…

Data Structures and Algorithms · Computer Science 2026-02-02 Magnus Berg , Joan Boyar , Lene M. Favrholdt , Kim S. Larsen

We consider the problem of estimating the number of distinct elements in a large data set (or, equivalently, the support size of the distribution induced by the data set) from a random sample of its elements. The problem occurs in many…

Machine Learning · Computer Science 2021-06-17 Talya Eden , Piotr Indyk , Shyam Narayanan , Ronitt Rubinfeld , Sandeep Silwal , Tal Wagner