English
Related papers

Related papers: Knowing When to Stop Matters: A Unified Algorithm …

200 papers

This paper studies the general problem of operating energy storage under uncertainty. Two fundamental sources of uncertainty are considered, namely the uncertainty in the unexpected fluctuation of the net demand process and the uncertainty…

Optimization and Control · Mathematics 2016-11-17 Junjie Qin , Yinlam Chow , Jiyan Yang , Ram Rajagopal

The burgeoning field of algorithms with predictions studies the problem of using possibly imperfect machine learning predictions to improve online algorithm performance. While nearly all existing algorithms in this framework make no…

Machine Learning · Computer Science 2024-06-05 Bo Sun , Jerry Huang , Nicolas Christianson , Mohammad Hajiesmaili , Adam Wierman , Raouf Boutaba

We present online prediction methods for time series that let us explicitly handle nonstationary artifacts (e.g. trend and seasonality) present in most real time series. Specifically, we show that applying appropriate transformations to…

Machine Learning · Statistics 2018-08-28 Christopher Xie , Avleen Bijral , Juan Lavista Ferres

We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a…

Machine Learning · Computer Science 2021-04-21 Alfonso Lobos , Paul Grigas , Zheng Wen

We consider the problem of learning from revealed preferences in an online setting. In our framework, each period a consumer buys an optimal bundle of goods from a merchant according to her (linear) utility function and current prices,…

Data Structures and Algorithms · Computer Science 2014-12-02 Kareem Amin , Rachel Cummings , Lili Dworkin , Michael Kearns , Aaron Roth

We present an algorithm, based on the Differential Dynamic Programming framework, to handle trajectory optimization problems in which the horizon is determined online rather than fixed a priori. This algorithm exhibits exact one-step…

Robotics · Computer Science 2021-11-18 Kyle Stachowicz , Evangelos A. Theodorou

Prediction markets rely on liquidity to convert trades into informative prices, yet existing mechanisms fix liquidity ex ante. This restriction enforces a static trade-off between price responsiveness and worst-case loss despite inherently…

Computer Science and Game Theory · Computer Science 2026-05-12 Enrique Nueve , Bao Nguyen , Rafael Frongillo , Bo Waggoner

This work addresses the classic machine learning problem of online prediction with expert advice. We consider the finite-horizon version of this zero-sum, two-person game. Using verification arguments from optimal control theory, we view…

Machine Learning · Computer Science 2020-06-30 Vladimir A. Kobzar , Robert V. Kohn , Zhilei Wang

This paper studies an open question in the warehouse problem where a merchant trading a commodity tries to find an optimal inventory-trading policy to decide on purchase and sale quantities during a fixed time horizon in order to maximize…

Data Structures and Algorithms · Computer Science 2023-02-24 Ishan Bansal , Oktay Günlük

Decision-makers often have access to machine-learned predictions about future demand that can help guide online resource allocation decisions. However, such predictions may be inaccurate. We develop a framework for online resource…

Data Structures and Algorithms · Computer Science 2026-05-19 Negin Golrezaei , Patrick Jaillet , Zijie Zhou

We introduce and study a family of online metric problems with long-term constraints. In these problems, an online player makes decisions $\mathbf{x}_t$ in a metric space $(X,d)$ to simultaneously minimize their hitting cost…

Data Structures and Algorithms · Computer Science 2024-07-15 Adam Lechowicz , Nicolas Christianson , Bo Sun , Noman Bashir , Mohammad Hajiesmaili , Adam Wierman , Prashant Shenoy

We study the problem of predicting the results of computations that are too expensive to run, via the observation of the results of smaller computations. We model this as an online learning problem with delayed feedback, where the length of…

Machine Learning · Computer Science 2016-09-08 Scott Garrabrant , Nate Soares , Jessica Taylor

A wide range of sustainability and grid-integration strategies depend on workload shifting, which aligns the timing of energy consumption with external signals such as grid curtailment events, carbon intensity, or time-of-use electricity…

Data Structures and Algorithms · Computer Science 2025-10-01 Ezra Johnson , Adam Lechowicz , Mohammad Hajiesmaili

We study a general model on reusable resource allocation under model uncertainty. A heterogeneous population of customers arrive at the decision maker's (DM's) platform sequentially. Upon observing a customer's type, the DM selects an…

Optimization and Control · Mathematics 2022-12-07 Xilin Zhang , Wang Chi Cheung

We define an online learning and optimization problem with discrete and irreversible decisions contributing toward a coverage target. In each period, a decision-maker selects facilities to open, receives information on the success of each…

Machine Learning · Computer Science 2026-03-06 Alexandre Jacquillat , Michael Lingzhi Li

We revisit the online dynamic acknowledgment problem. In the problem, a sequence of requests arrive over time to be acknowledged, and all outstanding requests can be satisfied simultaneously by one acknowledgement. The goal of the problem…

Data Structures and Algorithms · Computer Science 2023-05-30 Sungjin Im , Benjamin Moseley , Chenyang Xu , Ruilong Zhang

Online learning is the process of answering a sequence of questions based on the correct answers to the previous questions. It is studied in many research areas such as game theory, information theory and machine learning. There are two…

Machine Learning · Computer Science 2019-03-27 Ankit Sharma , Late C. A. Murthy

This paper presents an online intention prediction framework for estimating the goal state of autonomous systems in real time, even when intention is time-varying, and system dynamics or objectives include unknown parameters. The problem is…

Robotics · Computer Science 2026-04-13 Tianyu Zhou , Zihao Liang , Zehui Lu , Shaoshuai Mou

In order for an e-commerce platform to maximize its revenue, it must recommend customers items they are most likely to purchase. However, the company often has business constraints on these items, such as the number of each item in stock.…

Optimization and Control · Mathematics 2019-11-19 Andrea Boskovic , Qinyi Chen , Dominik Kufel , Zijie Zhou

In the complex landscape of traditional futures trading, where vast data and variables like real-time Limit Order Books (LOB) complicate price predictions, we introduce the FutureQuant Transformer model, leveraging attention mechanisms to…

Trading and Market Microstructure · Quantitative Finance 2025-05-12 Wenhao Guo , Yuda Wang , Zeqiao Huang , Changjiang Zhang , Shumin ma