English
Related papers

Related papers: Tracking Drift: Variation-Aware Entropy Scheduling…

200 papers

Reinforcement learning (RL) has enabled complex reasoning abilities in large language models (LLMs). However, most RL algorithms suffer from performance saturation, preventing continued gains as RL training scales. This problem can be…

Machine Learning · Computer Science 2026-05-12 Bolian Li , Yifan Wang , Yi Ding , Anamika Lochab , Ananth Grama , Ruqi Zhang

When deep learning models are sequentially trained on new data, they tend to abruptly lose performance on previously learned tasks, a critical failure known as catastrophic forgetting. This challenge severely limits the deployment of AI in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Paraskevi-Antonia Theofilou , Anuhya Thota , Stefanos Kollias , Mamatha Thota

The optimal operation of transportation systems is often susceptible to unexpected disruptions. Many established control strategies reliant on mathematical models can struggle with real-world disruptions, leading to significant divergence…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Linghang Sun , Michail A. Makridis , Alexander Genser , Cristian Axenie , Margherita Grossi , Anastasios Kouvelas

Despite rapid progress in Vision-Language-Action (VLA) models for robotic control, instruction drift remains a persistent failure mode in long-horizon tasks. This paper reconceptualizes this phenomenon, positing that instruction drift is…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Mingsheng Shang

Simplicity is a critical inductive bias for designing data-driven controllers, especially when robustness is important. Despite the impressive results of deep reinforcement learning in complex control tasks, it is prone to capturing…

Machine Learning · Computer Science 2025-05-09 Bang You , Chenxu Wang , Huaping Liu

Click-through rate (CTR) prediction is of great importance in recommendation systems and online advertising platforms. When served in industrial scenarios, the user-generated data observed by the CTR model typically arrives as a stream.…

Information Retrieval · Computer Science 2023-04-19 Congcong Liu , Fei Teng , Xiwei Zhao , Zhangang Lin , Jinghe Hu , Jingping Shao

We present a novel approach for test-time adaptation via online self-training, consisting of two components. First, we introduce a statistical framework that detects distribution shifts in the classifier's entropy values obtained on a…

Machine Learning · Computer Science 2025-01-07 Yarin Bar , Shalev Shaer , Yaniv Romano

Green buildings (GBs) with renewable energy and building energy management systems (BEMS) enable efficient energy use and support sustainable development. Electric vehicles (EVs), as flexible storage resources, enhance system flexibility…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Chi Liu , Zhezhuang Xu , Jiawei Zhou , Yazhou Yuan , Kai Ma , Meng Yuan

The last decade has seen a surge of interest in adaptive learning algorithms for data stream classification, with applications ranging from predicting ozone level peaks, learning stock market indicators, to detecting computer security…

Machine Learning · Statistics 2018-08-13 Ali Pesaranghader , Herna Viktor , Eric Paquet

There exists a large body of work on online drift detection with the goal of dynamically finding and maintaining changes in data streams. In this paper, we adopt a query-based approach to drift detection. Our approach relies on {\em a drift…

Data Structures and Algorithms · Computer Science 2016-05-16 Sofia Kleisarchaki , Sihem Amer-Yahia , Ahlame Douzal-Chouakria , Vassilis Christophides

Recent deep reinforcement learning (DRL) successes rely on end-to-end learning from fixed-size observational inputs (e.g. image, state-variables). However, many challenging and interesting problems in decision making involve observations or…

Machine Learning · Computer Science 2022-06-08 Vince Jankovics , Michael Garcia Ortiz , Eduardo Alonso

An online resource scheduling framework is proposed for minimizing the sum of weighted task latency for all the Internet of things (IoT) users, by optimizing offloading decision, transmission power and resource allocation in the large-scale…

Machine Learning · Computer Science 2020-04-16 Feibo Jiang , Kezhi Wang , Li Dong , Cunhua Pan , Kun Yang

By reinterpreting a robust discriminative classifier as Energy-based Model (EBM), we offer a new take on the dynamics of adversarial training (AT). Our analysis of the energy landscape during AT reveals that untargeted attacks generate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Mujtaba Hussain Mirza , Maria Rosaria Briglia , Senad Beadini , Iacopo Masi

Data-driven predictive analytics are in use today across a number of industrial applications, but further integration is hindered by the requirement of similarity among model training and test data distributions. This paper addresses the…

Machine Learning · Computer Science 2017-10-20 Yunwen Xu , Rui Xu , Weizhong Yan , Paul Ardis

In this paper we introduce a Non-Stationary Fuzzy Time Series (NSFTS) method with time varying parameters adapted from the distribution of the data. In this approach, we employ Non-Stationary Fuzzy Sets, in which perturbation functions are…

In this paper, the design of an optimal trajectory for an energy-constrained drone operating in dynamic network environments is studied. In the considered model, a drone base station (DBS) is dispatched to provide uplink connectivity to…

Machine Learning · Computer Science 2020-05-27 Ye Hu , Mingzhe Chen , Walid Saad , H. Vincent Poor , Shuguang Cui

Natural Evolution Strategies (NES) is a promising framework for black-box continuous optimization problems. NES optimizes the parameters of a probability distribution based on the estimated natural gradient, and one of the key parameters…

Neural and Evolutionary Computing · Computer Science 2022-02-08 Masahiro Nomura , Isao Ono

Reinforcement learning (RL) often exhibits high variance across training runs, leading to unreliable performance and posing a major challenge to deployment in real-world domains. In this work, we address the challenge of cross-run policy…

Machine Learning · Computer Science 2026-05-22 Marcel Hussing , Liv G. d'Aliberti , Claas Voelcker , Benjamin Eysenbach , Eric Eaton

Global physical event detection has traditionally relied on dense coverage of physical sensors around the world; while this is an expensive undertaking, there have not been alternatives until recently. The ubiquity of social networks and…

Machine Learning · Computer Science 2019-12-16 Abhijit Suprem , Calton Pu

Reinforcement Learning with Verifiable Reward (RLVR) has proven effective for training reasoning-oriented large language models, but existing methods largely assume high-resource settings with abundant training data. In low-resource…

Machine Learning · Computer Science 2026-04-21 Zhanyu Liu , Qingguo Hu , Ante Wang , Chenqing Liu , Zhishang Xiang , Hui Li , Delai Qiu , Jinsong Su