English
Related papers

Related papers: Lifelong Learning from Event-based Data

200 papers

We introduce a novel continual learning method based on multifidelity deep neural networks. This method learns the correlation between the output of previously trained models and the desired output of the model on the current training…

Numerical Analysis · Mathematics 2024-07-01 Amanda Howard , Yucheng Fu , Panos Stinis

Given the recent success of Deep Learning applied to a variety of single tasks, it is natural to consider more human-realistic settings. Perhaps the most difficult of these settings is that of continual lifelong learning, where the model…

Machine Learning · Computer Science 2018-12-21 Matthew Riemer , Tim Klinger , Djallel Bouneffouf , Michele Franceschini

A long-term goal of language agents is to learn and improve through their own experience, ultimately outperforming humans in complex, real-world tasks. However, training agents from experience data with reinforcement learning remains…

Simultaneous localization and mapping (SLAM) with implicit neural representations has received extensive attention due to the expressive representation power and the innovative paradigm of continual learning. However, deploying such a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Baicheng Li , Zike Yan , Dong Wu , Hanqing Jiang , Hongbin Zha

In lifelong learning systems based on artificial neural networks, one of the biggest obstacles is the inability to retain old knowledge as new information is encountered. This phenomenon is known as catastrophic forgetting. In this paper,…

Machine Learning · Computer Science 2022-08-16 Alexander Ororbia , Ankur Mali , Daniel Kifer , C. Lee Giles

Dynamic Data selection aims to accelerate training by prioritizing informative samples during online training. However, existing methods typically rely on task-specific handcrafted metrics or static/snapshot-based criteria to estimate…

Machine Learning · Computer Science 2026-05-14 Suorong Yang , Fangjian Su , Hai Gan , Ziqi Ye , Jie Li , Baile Xu , Furao Shen , Soujanya Poria

Continual Learning requires the model to learn from a stream of dynamic, non-stationary data without forgetting previous knowledge. Several approaches have been developed in the literature to tackle the Continual Learning challenge. Among…

Machine Learning · Computer Science 2022-11-30 Gabriele Merlin , Vincenzo Lomonaco , Andrea Cossu , Antonio Carta , Davide Bacciu

Learning by observation can be of key importance whenever agents sharing similar features want to learn from each other. This paper presents an agent architecture that enables software agents to learn by direct observation of the actions…

Artificial Intelligence · Computer Science 2014-02-05 Paulo Roberto Costa , Luís Miguel Botelho

Continual learning aims to learn continuously from a stream of tasks and data in an online-learning fashion, being capable of exploiting what was learned previously to improve current and future tasks while still being able to perform well…

Machine Learning · Computer Science 2020-07-31 Quang Pham , Doyen Sahoo , Chenghao Liu , Steven C. H Hoi

As Large Language Models (LLMs) evolve from text-completion tools into fully fledged agents operating in dynamic environments, they must address the challenge of continually learning and retaining long-term knowledge. Many biological…

Artificial Intelligence · Computer Science 2025-02-12 Mathis Pink , Qinyuan Wu , Vy Ai Vo , Javier Turek , Jianing Mu , Alexander Huth , Mariya Toneva

Event cameras provide a number of benefits over traditional cameras, such as the ability to track incredibly fast motions, high dynamic range, and low power consumption. However, their application into computer vision problems, many of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Alex Zihao Zhu , Ziyun Wang , Kaung Khant , Kostas Daniilidis

Despite recent advances, memory-augmented deep neural networks are still limited when it comes to life-long and one-shot learning, especially in remembering rare events. We present a large-scale life-long memory module for use in deep…

Machine Learning · Computer Science 2017-03-10 Łukasz Kaiser , Ofir Nachum , Aurko Roy , Samy Bengio

In this paper, we introduce variational semantic memory into meta-learning to acquire long-term knowledge for few-shot learning. The variational semantic memory accrues and stores semantic information for the probabilistic inference of…

Machine Learning · Computer Science 2021-07-16 Xiantong Zhen , Yingjun Du , Huan Xiong , Qiang Qiu , Cees G. M. Snoek , Ling Shao

In model-based reinforcement learning, the agent interleaves between model learning and planning. These two components are inextricably intertwined. If the model is not able to provide sensible long-term prediction, the executed planner…

Machine Learning · Statistics 2019-03-19 Nan Rosemary Ke , Amanpreet Singh , Ahmed Touati , Anirudh Goyal , Yoshua Bengio , Devi Parikh , Dhruv Batra

Supervised Continual learning involves updating a deep neural network (DNN) from an ever-growing stream of labeled data. While most work has focused on overcoming catastrophic forgetting, one of the major motivations behind continual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Md Yousuf Harun , Jhair Gallardo , Tyler L. Hayes , Christopher Kanan

Online few-shot learning describes a setting where models are trained and evaluated on a stream of data while learning emerging classes. While prior work in this setting has achieved very promising performance on instance classification…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Mayank Lunayach , James Smith , Zsolt Kira

Continual learning refers to a dynamical framework in which a model receives a stream of non-stationary data over time and must adapt to new data while preserving previously acquired knowledge. Unluckily, neural networks fail to meet these…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Umberto Cappellazzo , Daniele Falavigna , Alessio Brutti

In this paper, a lifelong learning problem is studied for an Internet of Things (IoT) system. In the considered model, each IoT device aims to balance its information freshness and energy consumption tradeoff by controlling its…

Networking and Internet Architecture · Computer Science 2021-03-30 Zhenzhen Gong , Qimei Cui , Christina Chaccour , Bo Zhou , Mingzhe Chen , Walid Saad

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Adapting a Reinforcement Learning (RL) agent to an unseen environment is a difficult task due to typical over-fitting on the training environment. RL agents are often capable of solving environments very close to the trained environment,…

Artificial Intelligence · Computer Science 2022-07-04 Olivier Moulin , Vincent Francois-Lavet , Paul Elbers , Mark Hoogendoorn