English
Related papers

Related papers: Higher-Order Equilibrium Tracking for EM-Compressi…

200 papers

We present a learning-augmented online algorithm for the preemptive FIFO buffer management problem, where packets arrive online to a finite-capacity buffer, must be transmitted in FIFO order, and the algorithm may preemptively discard…

Data Structures and Algorithms · Computer Science 2026-04-30 Wen-Han Hsieh , Ya-Chun Liang

We study online conformal prediction for non-stationary data streams subject to unknown distribution drift. While most prior work studied this problem under adversarial settings and/or assessed performance in terms of gaps of time-averaged…

Statistics Theory · Mathematics 2026-03-06 Jiadong Liang , Zhimei Ren , Yuxin Chen

Model predictive control is a powerful framework for enabling optimal control of constrained systems. However, for systems that are described by high-dimensional state spaces this framework can be too computationally demanding for real-time…

Systems and Control · Electrical Eng. & Systems 2020-08-24 Joseph Lorenzetti , Marco Pavone

The Expectation-Maximization (EM) algorithm is routinely used for the maximum likelihood estimation in the latent class analysis. However, the EM algorithm comes with no guarantees of reaching the global optimum. We study the geometry of…

In this paper, we address tracking of a time-varying parameter with unknown dynamics. We formalize the problem as an instance of online optimization in a dynamic setting. Using online gradient descent, we propose a method that sequentially…

Machine Learning · Computer Science 2016-03-17 Aryan Mokhtari , Shahin Shahrampour , Ali Jadbabaie , Alejandro Ribeiro

The predict-then-optimize paradigm bridges online learning and contextual optimization in dynamic environments. Previous works have investigated the sequential updating of predictors using feedback from downstream decisions to minimize…

Optimization and Control · Mathematics 2025-11-26 Zhuojun Xie , Adam Abdin , Yiping Fang

With the fast development of big data, learning the optimal decision rule by recursively updating it and making online decisions has been easier than before. We study the online statistical inference of model parameters in a contextual…

Machine Learning · Statistics 2026-01-22 Xiangyu Chang , Xi Chen , Zehua Lai , He Li , Zhihong Liu , Yichen Zhang

Many statistical estimators are defined as the fixed point of a data-dependent operator, with estimators based on minimizing a cost function being an important special case. The limiting performance of such estimators depends on the…

Machine Learning · Computer Science 2022-03-22 Nhat Ho , Koulik Khamaru , Raaz Dwivedi , Martin J. Wainwright , Michael I. Jordan , Bin Yu

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

Statistics Theory · Mathematics 2018-05-24 Pierre Gaillard , Olivier Wintenberger

Modern networked systems are increasingly reconfigurable, enabling demand-aware infrastructures whose resources can be adjusted according to the workload they currently serve. Such dynamic adjustments can be exploited to improve network…

Data Structures and Algorithms · Computer Science 2019-04-12 Monika Henzinger , Stefan Neumann , Stefan Schmid

Researchers often face data fusion problems, where multiple data sources are available, each capturing a distinct subset of variables. While problem formulations typically take the data as given, in practice, data acquisition can be an…

Machine Learning · Computer Science 2021-11-02 Shantanu Gupta , Zachary C. Lipton , David Childers

Higher-order tensors arise frequently in applications such as neuroimaging, recommendation system, social network analysis, and psychological studies. We consider the problem of low-rank tensor estimation from possibly incomplete,…

Machine Learning · Statistics 2020-12-15 Chanwoo Lee , Miaoyan Wang

We provide novel theoretical results regarding local optima of regularized $M$-estimators, allowing for nonconvexity in both loss and penalty functions. Under restricted strong convexity on the loss and suitable regularity conditions on the…

Statistics Theory · Mathematics 2015-01-05 Po-Ling Loh , Martin J. Wainwright

Online learning in arbitrary, and possibly adversarial, environments has been extensively studied in sequential decision-making, and it is closely connected to equilibrium computation in game theory. Most existing online learning algorithms…

Machine Learning · Computer Science 2026-03-20 Mingyang Liu , Yongshan Chen , Zhiyuan Fan , Gabriele Farina , Asuman Ozdaglar , Kaiqing Zhang

We incorporate future information in the form of the estimated value of future gradients in online convex optimization. This is motivated by demand response in power systems, where forecasts about the current round, e.g., the weather or the…

Optimization and Control · Mathematics 2020-12-14 Antoine Lesage-Landry , Iman Shames , Joshua A. Taylor

Propagating state distributions through a generic, uncertain nonlinear dynamical model is known to be intractable and usually begets numerical or analytical approximations. We introduce a method for state prediction, called the…

Robotics · Computer Science 2024-02-02 Hardik Parwana , Dimitra Panagou

We consider a general online stochastic optimization problem with multiple budget constraints over a horizon of finite time periods. In each time period, a reward function and multiple cost functions are revealed, and the decision maker…

Machine Learning · Computer Science 2022-07-26 Jiashuo Jiang , Xiaocheng Li , Jiawei Zhang

We develop a reduction-based framework for online learning with delayed feedback that recovers and improves upon existing results for both first-order and bandit convex optimization. Our approach introduces a continuous-time model under…

Machine Learning · Computer Science 2026-02-04 Alexander Ryabchenko , Idan Attias , Daniel M. Roy

We present and mathematically analyze an online adjoint algorithm for the optimization of partial differential equations (PDEs). Traditional adjoint algorithms would typically solve a new adjoint PDE at each optimization iteration, which…

Optimization and Control · Mathematics 2022-01-27 Justin Sirignano , Konstantinos Spiliopoulos

Online decision making aims to learn the optimal decision rule by making personalized decisions and updating the decision rule recursively. It has become easier than before with the help of big data, but new challenges also come along.…

Machine Learning · Statistics 2020-10-16 Haoyu Chen , Wenbin Lu , Rui Song