English
Related papers

Related papers: Dynamic Regret Analysis for Online Tracking of Tim…

200 papers

Machine learning models are essential tools in various domains, but their performance can degrade over time due to changes in data distribution or other factors. On one hand, detecting and addressing such degradations is crucial for…

Machine Learning · Computer Science 2023-09-28 Florian Heinrichs

The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Aren Karapetyan , Anastasios Tsiamis , Efe C. Balta , Andrea Iannelli , John Lygeros

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that leverage regret…

Machine Learning · Computer Science 2023-02-16 Aadyot Bhatnagar , Huan Wang , Caiming Xiong , Yu Bai

We introduce algorithms for online, full-information prediction that are competitive with contextual tree experts of unknown complexity, in both probabilistic and adversarial settings. We show that by incorporating a probabilistic framework…

Machine Learning · Computer Science 2018-05-23 Vidya Muthukumar , Mitas Ray , Anant Sahai , Peter L. Bartlett

Non-stationary online learning has drawn much attention in recent years. In particular, dynamic regret and adaptive regret are proposed as two principled performance measures for online convex optimization in non-stationary environments. To…

Machine Learning · Computer Science 2025-09-10 Peng Zhao , Yan-Feng Xie , Lijun Zhang , Zhi-Hua Zhou

In this paper, we consider the problem of prediction with expert advice in dynamic environments. We choose tracking regret as the performance metric and develop two adaptive and efficient algorithms with data-dependent tracking regret…

Machine Learning · Computer Science 2020-02-11 Shiyin Lu , Lijun Zhang

Change points in real-world systems mark significant regime shifts in system dynamics, possibly triggered by exogenous or endogenous factors. These points define regimes for the time evolution of the system and are crucial for understanding…

Machine Learning · Statistics 2025-09-30 Ioanna-Yvonni Tsaknaki , Fabrizio Lillo , Piero Mazzarisi

In the problem of online learning for changing environments, data are sequentially received one after another over time, and their distribution assumptions may vary frequently. Although existing methods demonstrate the effectiveness of…

Machine Learning · Computer Science 2023-07-18 Chen Zhao , Feng Mi , Xintao Wu , Kai Jiang , Latifur Khan , Christan Grant , Feng Chen

This paper is concerned with the estimation of time-varying networks for high-dimensional nonstationary time series. Two types of dynamic behaviors are considered: structural breaks (i.e., abrupt change points) and smooth changes. To…

Statistics Theory · Mathematics 2020-02-19 Mengyu Xu , Xiaohui Chen , Wei Biao Wu

Given the growing number of available tools for modeling dynamic networks, the choice of a suitable model becomes central. The goal of this survey is to provide an overview of tie-oriented dynamic network models. The survey is focused on…

Social and Information Networks · Computer Science 2022-01-05 Cornelius Fritz , Michael Lebacher , Göran Kauermann

Temporal networks are an important type of network whose topological structure changes over time. Compared with methods on static networks, temporal network embedding (TNE) methods are facing three challenges: 1) it cannot describe the…

Social and Information Networks · Computer Science 2022-12-14 Shanfan Zhang , Zhan Bu

In this paper, we develop a novel virtual-queue-based online algorithm for online convex optimization (OCO) problems with long-term and time-varying constraints and conduct a performance analysis with respect to the dynamic regret and…

Optimization and Control · Mathematics 2021-11-16 Qingsong Liu , Wenfei Wu , Longbo Huang , Zhixuan Fang

We consider prediction with expert advice when the loss vectors are assumed to lie in a set described by the sum of atomic norm balls. We derive a regret bound for a general version of the online mirror descent (OMD) algorithm that uses a…

Machine Learning · Computer Science 2017-11-15 Siddharth Barman , Aditya Gopalan , Aadirupa Saha

Inferring network topology from dynamical observations is a fundamental problem pervading research on complex systems. Here, we present a simple, direct method to infer the structural connection topology of a network, given an observation…

Chaotic Dynamics · Physics 2015-05-19 Srinivas Gorur Shandilya , Marc Timme

We consider the classic problem of online convex optimisation. Whereas the notion of static regret is relevant for stationary problems, the notion of switching regret is more appropriate for non-stationary problems. A switching regret is…

Machine Learning · Computer Science 2025-03-07 Stephen Pasteris , Chris Hicks , Vasilios Mavroudis , Mark Herbster

Estimating the unknown causal dependencies among graph-connected time series plays an important role in many applications, such as sensor network analysis, signal processing over cyber-physical systems, and finance engineering. Inference of…

Signal Processing · Electrical Eng. & Systems 2021-04-02 Rohan Money , Joshin Krishnan , Baltasar Beferull-Lozano

The discovery of spatio-temporal dependencies within urban road networks that cause Recurrent Congestion (RC) patterns is crucial for numerous real-world applications, including urban planning and scheduling of public transportation…

Machine Learning · Computer Science 2021-07-21 Nicolas Tempelmeier , Udo Feuerhake , Oskar Wage , Elena Demidova

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

In this paper, online convex optimization is applied to the problem of controlling linear dynamical systems. An algorithm similar to online gradient descent, which can handle time-varying and unknown cost functions, is proposed. Then,…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

Complex systems are commonly modeled using nonlinear dynamical systems. These models are often high-dimensional and chaotic. An important goal in studying physical systems through the lens of mathematical models is to determine when the…

Computational Geometry · Computer Science 2014-03-25 Jesse Berwald , Marian Gidea , Mikael Vejdemo-Johansson