English
Related papers

Related papers: Representation Stability in a Minimal Continual Le…

200 papers

Machine learning is now ubiquitous in societal decision-making, for example in evaluating job candidates or loan applications, and it is increasingly important to take into account how classified agents will react to the learning…

Machine Learning · Computer Science 2025-08-08 Dravyansh Sharma , Alec Sun

Continual learning involves learning from a stream of data without repetition of data points, a scenario that is inherently complex due to distributional shift across tasks. We propose a query-only attention mechanism that discards keys and…

Machine Learning · Computer Science 2025-11-04 Gautham Bekal , Ashish Pujari , Scott David Kelly

This paper proposes a novel perspective on learning, positing it as the pursuit of dynamical invariants -- data combinations that remain constant or exhibit minimal change over time as a system evolves. This concept is underpinned by both…

Artificial Intelligence · Computer Science 2024-01-22 Alex Ushveridze

Despite its rise as a prominent solution to the data inefficiency of today's machine learning models, self-supervised learning has yet to be studied from a purely multi-agent perspective. In this work, we propose that aligning internal…

Artificial Intelligence · Computer Science 2022-09-23 Julius Taylor , Eleni Nisioti , Clément Moulin-Frier

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We…

Multiagent Systems · Computer Science 2018-08-02 Aditya Grover , Maruan Al-Shedivat , Jayesh K. Gupta , Yura Burda , Harrison Edwards

Representations are internal models of the environment that can provide guidance to a behaving agent, even in the absence of sensory information. It is not clear how representations are developed and whether or not they are necessary or…

Neurons and Cognition · Quantitative Biology 2013-08-07 Lars Marstaller , Arend Hintze , Christoph Adami

Continual Reinforcement Learning (CRL) aims to develop lifelong learning agents to continuously acquire knowledge across diverse tasks while mitigating catastrophic forgetting. This requires efficiently managing the stability-plasticity…

Machine Learning · Computer Science 2026-02-02 Yuxuan Li , Qijun He , Mingqi Yuan , Wen-Tse Chen , Jeff Schneider , Jiayu Chen

We introduce a lifelong imitation learning framework that enables continual policy refinement across sequential tasks under realistic memory and data constraints. Our approach departs from conventional experience replay by operating…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Fanqi Yu , Matteo Tiezzi , Tommaso Apicella , Cigdem Beyan , Vittorio Murino

Traditional energy-based learning models associate a single energy metric to each configuration of variables involved in the underlying optimization process. Such models associate the lowest energy state to the optimal configuration of…

Machine Learning · Computer Science 2020-04-10 Oindrila Chatterjee , Shantanu Chakrabartty

Researchers working within knowledge-in-pieces traditions have often employed observational approaches to investigate micro-processes of learning. There is growing evidence from this line of work that students' intuitive thinking about…

Physics Education · Physics 2010-08-20 Brian W. Frank

A reinforcement learning (RL) control policy could fail in a new/perturbed environment that is different from the training environment, due to the presence of dynamic variations. For controlling systems with continuous state and action…

Robotics · Computer Science 2022-08-31 Y. Cheng , P. Zhao , F. Wang , D. J. Block , N. Hovakimyan

Test-time adaptation aims to adapt to realistic environments in an online manner by learning during test time. Entropy minimization has emerged as a principal strategy for test-time adaptation due to its efficiency and adaptability.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jisu Han , Jaemin Na , Wonjun Hwang

Recent studies have made notable progress in video representation learning by transferring image-pretrained models to video tasks, typically with complex temporal modules and video fine-tuning. However, fine-tuning heavy modules may…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Yang Liu , Qianqian Xu , Peisong Wen , Siran Dai , Xilin Zhao , Qingming Huang

While modern deep networks have demonstrated remarkable versatility, their training dynamics remain poorly understood--often driven more by empirical tweaks than architectural insight. This paper investigates how internal structural choices…

Machine Learning · Computer Science 2025-08-26 Saleh Nikooroo , Thomas Engel

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning…

We consider a broad class of stochastic imitation dynamics over networks, encompassing several well known learning models such as the replicator dynamics. In the considered models, players have no global information about the game…

Systems and Control · Computer Science 2021-03-02 Lorenzo Zino , Giacomo Como , Fabio Fagnani

Problem definition: Supply chains are constantly evolving networks. Reinforcement learning is increasingly proposed as a solution to provide optimal control of these networks. Academic/practical: However, learning in continuously varying…

Systems and Control · Electrical Eng. & Systems 2023-12-27 Wan Wang , Haiyan Wang , Adam J. Sobey

Most of the works on planning and learning, e.g., planning by (model based) reinforcement learning, are based on two main assumptions: (i) the set of states of the planning domain is fixed; (ii) the mapping between the observations from the…

Artificial Intelligence · Computer Science 2018-11-27 Luciano Serafini , Paolo Traverso

The design and analysis of optimal control policies for dynamical systems can be complicated by nonlinear dependence in the state variables. Koopman operators have been used to simplify the analysis of dynamical systems by mapping the flow…

Dynamical Systems · Mathematics 2019-08-07 Craig Bakker , Steven Rosenthal , Kathleen E. Nowak