English
Related papers

Related papers: Tracking Drift: Variation-Aware Entropy Scheduling…

200 papers

We consider the traffic assignment problem in nonatomic routing games where the players' cost functions may be subject to random fluctuations (e.g., weather disturbances, perturbations in the underlying network, etc.). We tackle this…

Computer Science and Game Theory · Computer Science 2022-01-11 Dong Quan Vu , Kimon Antonakopoulos , Panayotis Mertikopoulos

Safe navigation of drones in the presence of adversarial physical attacks from multiple pursuers is a challenging task. This paper proposes a novel approach, asynchronous multi-stage deep reinforcement learning (AMS-DRL), to train…

Robotics · Computer Science 2024-02-22 Jiaping Xiao , Mir Feroskhan

Underactuated systems like sea vessels have degrees of motion that are insufficiently matched by a set of independent actuation forces. In addition, the underlying trajectory-tracking control problems grow in complexity in order to decide…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Mohammed Abouheaf , Wail Gueaieb , Md. Suruz Miah , Davide Spinello

Conventional wisdom holds that large-batch training is fundamentally incompatible with Reinforcement Learning (RL) - beyond a modest threshold, increasing batch sizes typically yields diminishing returns or performance degradation due to…

Machine Learning · Statistics 2026-05-22 Jongchan Park

Class-incremental learning of deep networks sequentially increases the number of classes to be classified. During training, the network has only access to data of one task at a time, where each task contains several classes. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Lu Yu , Bartłomiej Twardowski , Xialei Liu , Luis Herranz , Kai Wang , Yongmei Cheng , Shangling Jui , Joost van de Weijer

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

Machine Learning · Computer Science 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Existing drift detection methods focus on designing sensitive test statistics. They treat the detection threshold as a fixed hyperparameter, set once to balance false alarms and late detections, and applied uniformly across all datasets and…

Machine Learning · Computer Science 2025-11-14 Pengqian Lu , Jie Lu , Anjin Liu , En Yu , Guangquan Zhang

In big data era, the data continuously generated and its distribution may keep changes overtime. These challenges in online stream of data are known as concept drift. In this paper, we proposed the Adaptive Convolutional ELM method…

Artificial Intelligence · Computer Science 2016-10-10 Arif Budiman , Mohamad Ivan Fanany , Chan Basaruddin

Online Reinforcement Learning (RL) is typically framed as the process of minimizing cumulative regret (CR) through interactions with an unknown environment. However, real-world RL applications usually involve a sequence of tasks, and the…

Machine Learning · Statistics 2024-10-28 Ziping Xu , Kelly W. Zhang , Susan A. Murphy

Existing trajectory prediction methods exhibit significant performance degradation under distribution shifts during test time. Although test-time training techniques have been explored to enable adaptation, current approaches rely on an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yuning Wang , Pu Zhang , Yuan He , Ke Wang , Jianru Xue

Continual learning aims to acquire new tasks while preserving performance on previously learned ones, but most methods struggle with catastrophic forgetting. Existing approaches typically treat all layers uniformly, often trading stability…

Machine Learning · Computer Science 2025-12-29 Hengyi Wu , Zhenyi Wang , Heng Huang

Deep artificial neural networks famously struggle to learn from non-stationary streams of data. Without dedicated mitigation strategies, continual learning is associated with continuous forgetting of previous tasks and a progressive loss of…

Neurons and Cognition · Quantitative Biology 2025-12-29 Suzanne van der Veldt , Gido M. van de Ven , Sanne Moorman , Guillaume Etter

In applied machine learning, concept drift, which is either gradual or abrupt changes in data distribution, can significantly reduce model performance. Typical detection methods,such as statistical tests or reconstruction-based models,are…

Machine Learning · Computer Science 2025-08-12 N Harshit , K Mounvik

To imitate the ability of keeping learning of human, continual learning which can learn from a never-ending data stream has attracted more interests recently. In all settings, the online class incremental learning (OCIL), where incoming…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Guoqiang Liang , Zhaojie Chen , Zhaoqiang Chen , Shiyu Ji , Yanning Zhang

Concept drift refers to a change in the data distribution affecting the data stream of future samples. Consequently, learning models operating on the data stream might become obsolete, and need costly and difficult adjustments such as…

Machine Learning · Computer Science 2023-09-20 André Artelt , Kleanthis Malialis , Christos Panayiotou , Marios Polycarpou , Barbara Hammer

Emergency control, typically such as under-voltage load shedding (UVLS), is broadly used to grapple with low voltage and voltage instability issues in practical power systems under contingencies. However, existing emergency control schemes…

Systems and Control · Electrical Eng. & Systems 2021-02-26 Ying Zhang , Meng Yue , Jianhui Wang

Trajectory estimation of maneuvering objects is applied in numerous tasks like navigation, path planning and visual tracking. Many previous works get impressive results in the strictly controlled condition with accurate prior statistics and…

Information Theory · Computer Science 2020-07-02 Weipeng Li , Xiaogang Yang , Ruitao Lu , Jiwei Fan , Tao Zhang , Chuan He

Urban time series data forecasting featuring significant contributions to sustainable development is widely studied as an essential task of the smart city. However, with the dramatic and rapid changes in the world environment, the…

Machine Learning · Computer Science 2023-11-27 Zekun Cai , Renhe Jiang , Xinyu Yang , Zhaonan Wang , Diansheng Guo , Hiroki Kobayashi , Xuan Song , Ryosuke Shibasaki

Concept drift and extreme verification latency pose significant challenges in data stream learning, particularly when dealing with recurring concept changes in dynamic environments. This work introduces a novel method based on the Growing…

Machine Learning · Computer Science 2025-04-11 Maria Arostegi , Miren Nekane Bilbao , Jesus L. Lobo , Javier Del Ser

Maximum Entropy (MaxEnt) reinforcement learning is a powerful learning paradigm which seeks to maximize return under entropy regularization. However, action entropy does not necessarily coincide with state entropy, e.g., when multiple…

Machine Learning · Computer Science 2021-07-27 Nir Baram , Guy Tennenholtz , Shie Mannor