中文
相关论文

相关论文: Stress-Aware Learning under KL Drift via Trust-Dec…

200 篇论文

Spiking Neural Networks (SNNs) have emerged as a promising approach for energy-efficient and biologically plausible computation. However, due to limitations in existing training methods and inherent model constraints, SNNs often exhibit a…

人工智能 · 计算机科学 2025-05-19 Tianqing Zhang , Zixin Zhu , Kairong Yu , Hongwei Wang

LLMs are increasingly used as long-running conversational agents, yet every major benchmark evaluating their memory treats user information as static facts to be stored and retrieved. That's the wrong model. People change their minds, and…

计算与语言 · 计算机科学 2026-03-26 Praveen Kumar Myakala , Manan Agrawal , Rahul Manche

We address the problem of simultaneously learning and control in an online receding horizon control setting. We consider the control of an unknown linear dynamical system with general cost functions and affine constraints on the control…

最优化与控制 · 数学 2022-11-02 Deepan Muthirayan , Jianjun Yuan , Pramod P. Khargonekar

We introduce and study knowledge drift (KD), a complex form of drift that occurs in hierarchical classification. Under KD the vocabulary of concepts, their individual distributions, and the is-a relations between them can all change over…

机器学习 · 计算机科学 2021-03-30 Andrea Bontempelli , Fausto Giunchiglia , Andrea Passerini , Stefano Teso

Continual learning (CL) is concerned with learning multiple tasks sequentially without forgetting previously learned tasks. Despite substantial empirical advances over recent years, the theoretical development of CL remains in its infancy.…

机器学习 · 计算机科学 2026-04-27 Liangzu Peng , Uday Kiran Reddy Tadipatri , Ziqing Xu , Eric Eaton , René Vidal

Distributed intelligence in industrial networks increasingly integrates sensing, communication, and computation across heterogeneous and resource constrained devices. Federated learning (FL) enables collaborative model training in such…

人工智能 · 计算机科学 2026-03-27 Paul Shepherd , Tasos Dagiuklas , Bugra Alkan , Jonathan Rodriguez

Models trained with offline data often suffer from continual distribution shifts and expensive labeling in changing environments. This calls for a new online learning paradigm where the learner can continually adapt to changing environments…

机器学习 · 计算机科学 2022-03-22 Shiji Zhou , Han Zhao , Shanghang Zhang , Lianzhe Wang , Heng Chang , Zhi Wang , Wenwu Zhu

When deep learning models are sequentially trained on new data, they tend to abruptly lose performance on previously learned tasks, a critical failure known as catastrophic forgetting. This challenge severely limits the deployment of AI in…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Paraskevi-Antonia Theofilou , Anuhya Thota , Stefanos Kollias , Mamatha Thota

Continual learning aims to acquire new tasks while preserving performance on previously learned ones, but most methods struggle with catastrophic forgetting. Existing approaches typically treat all layers uniformly, often trading stability…

机器学习 · 计算机科学 2025-12-29 Hengyi Wu , Zhenyi Wang , Heng Huang

Reinforcement learning with verifiable rewards (RLVR) has become a standard approach for improving reasoning in language models, yet models trained with RLVR often suffer from diversity collapse: while single-sample accuracy improves,…

机器学习 · 计算机科学 2026-05-05 Marc Dymetman

Working with a non-stationary stream of data requires for the analysis system to evolve its model (the parameters as well as the structure) over time. In particular, concept drifts can occur, which makes it necessary to forget knowledge…

人工智能 · 计算机科学 2021-01-08 Clément Leroy , Eric Anquetil , Nathalie Girard

Recently there has been a surge of interest in understanding implicit regularization properties of iterative gradient-based optimization algorithms. In this paper, we study the statistical guarantees on the excess risk achieved by…

机器学习 · 统计学 2020-08-28 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

Many existing two-phase kernel-based hypothesis transfer learning algorithms employ the same kernel regularization across phases and rely on the known smoothness of functions to obtain optimality. Therefore, they fail to adapt to the…

机器学习 · 统计学 2024-02-26 Haotian Lin , Matthew Reimherr

Sequential change-point detection when the distribution parameters are unknown is a fundamental problem in statistics and machine learning. When the post-change parameters are unknown, we consider a set of detection procedures based on…

统计理论 · 数学 2017-12-06 Yang Cao , Liyan Xie , Yao Xie , Huan Xu

This work theoretically studies a ubiquitous reinforcement learning policy for controlling the canonical model of continuous-time stochastic linear-quadratic systems. We show that randomized certainty equivalent policy addresses the…

机器学习 · 计算机科学 2022-08-23 Mohamad Kazem Shirani Faradonbeh

We study continuity and robustness properties of infinite-horizon average expected cost problems with respect to (controlled) transition kernels, and applications of these results to the problem of robustness of control policies designed…

系统与控制 · 电气工程与系统科学 2020-12-22 Ali Devran Kara , Maxim Raginsky , Serdar Yuksel

This paper proposes model-free imitation learning named Entropy-Regularized Imitation Learning (ERIL) that minimizes the reverse Kullback-Leibler (KL) divergence. ERIL combines forward and inverse reinforcement learning (RL) under the…

机器学习 · 计算机科学 2022-06-01 Eiji Uchibe , Kenji Doya

This paper studies the convergence of the mirror descent algorithm for finite horizon stochastic control problems with measure-valued control processes. The control objective involves a convex regularisation function, denoted as $h$, with…

最优化与控制 · 数学 2025-08-22 Bekzhan Kerimkulov , David Šiška , Łukasz Szpruch , Yufei Zhang

We present a lightweight and interpretable decision framework for dynamic edge server selection in latency-critical applications that explicitly accounts for tail risk and switching stability. Each candidate server is characterised by…

分布式、并行与集群计算 · 计算机科学 2026-04-24 Mohan Liyanage , Arnova Abdullah , Eldiyar Zhantileuov , Rolf Schuster

We describe a primal-dual framework for the design and analysis of online convex optimization algorithms for {\em drifting regret}. Existing literature shows (nearly) optimal drifting regret bounds only for the $\ell_2$ and the…

机器学习 · 计算机科学 2013-09-24 Suman K Bera , Anamitra R Choudhury , Syamantak Das , Sambuddha Roy , Jayram S. Thatchachar