English
Related papers

Related papers: Design Principles for Lifelong Learning AI Acceler…

200 papers

To cope with real-world dynamics, an intelligent system needs to incrementally acquire, update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as continual learning, provides a foundation for AI systems to…

Machine Learning · Computer Science 2024-02-07 Liyuan Wang , Xingxing Zhang , Hang Su , Jun Zhu

Despite groundbreaking progress in reinforcement learning for robotics, gameplay, and other complex domains, major challenges remain in applying reinforcement learning to the evolving, open-world problems often found in critical application…

Lifelong learning is a long-standing aim for artificial agents that act in dynamic environments, in which an agent needs to accumulate knowledge incrementally without forgetting previously learned representations. We investigate methods for…

Machine Learning · Computer Science 2021-11-17 Vadym Gryshchuk , Cornelius Weber , Chu Kiong Loo , Stefan Wermter

Continual learning is essential for all real-world applications, as frozen pre-trained models cannot effectively deal with non-stationary data distributions. The purpose of this study is to review the state-of-the-art methods that allow…

Machine Learning · Computer Science 2022-02-28 Khadija Shaheen , Muhammad Abdullah Hanif , Osman Hasan , Muhammad Shafique

Lifelong learning or continual learning is the problem of training an AI agent continuously while also preventing it from forgetting its previously acquired knowledge. Streaming lifelong learning is a challenging setting of lifelong…

Machine Learning · Computer Science 2024-02-20 Soumya Banerjee , Vinay K. Verma , Avideep Mukherjee , Deepak Gupta , Vinay P. Namboodiri , Piyush Rai

The increasing attention on Artificial Intelligence (AI) regulation has led to the definition of a set of ethical principles grouped into the Sustainable AI framework. In this article, we identify Continual Learning, an active area of AI…

Artificial Intelligence · Computer Science 2021-11-19 Andrea Cossu , Marta Ziosi , Vincenzo Lomonaco

Computing systems form the backbone of many aspects of our life, hence they are becoming as vital as water, electricity, and road infrastructures for our society. Yet, engineering long running computing systems that achieve their goals in…

Software Engineering · Computer Science 2021-08-20 Danny Weyns , Thomas Bäck , Renè Vidal , Xin Yao , Ahmed Nabil Belbachir

Lifelong learning can be viewed as a continuous transfer learning procedure over consecutive tasks, where learning a given task depends on accumulated knowledge --- the so-called knowledge base. Most published work on lifelong learning…

Machine Learning · Statistics 2018-10-30 Changjian Shui , Ihsen Hedhli , Christian Gagné

Continual learning--the ability to acquire, retain, and refine knowledge over time--has always been fundamental to intelligence, both human and artificial. Historically, different AI paradigms have acknowledged this need, albeit with…

Machine Learning · Computer Science 2025-06-05 Jack Bell , Luigi Quarantiello , Eric Nuertey Coleman , Lanpei Li , Malio Li , Mauro Madeddu , Elia Piccoli , Vincenzo Lomonaco

Artificial Intelligence (AI) is a fast-growing research and development (R&D) discipline which is attracting increasing attention because of its promises to bring vast benefits for consumers and businesses, with considerable benefits…

Artificial Intelligence · Computer Science 2022-05-10 Zhenghua Chen , Min Wu , Alvin Chan , Xiaoli Li , Yew-Soon Ong

The rapid advancement of artificial intelligence (AI) technologies has led to an increasing deployment of AI models on edge and terminal devices, driven by the proliferation of the Internet of Things (IoT) and the need for real-time data…

Artificial Intelligence · Computer Science 2025-03-18 Xubin Wang , Zhiqing Tang , Jianxiong Guo , Tianhui Meng , Chenhao Wang , Tian Wang , Weijia Jia

This paper introduces a new lifelong learning solution where a single model is trained for a sequence of tasks. The main challenge that vision systems face in this context is catastrophic forgetting: as they tend to adapt to the most…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Amal Rannen Triki , Rahaf Aljundi , Mathew B. Blaschko , Tinne Tuytelaars

With the wide spread use of AI-driven systems in the edge (a.k.a edge intelligence systems), such as autonomous driving vehicles, wearable biotech devices, intelligent manufacturing, etc., such systems are becoming very critical for our…

Software Engineering · Computer Science 2022-05-20 Aftab Hussain

As the CMOS technology pushes to the nanoscale, aging effects and process variations have become increasingly pronounced, posing significant reliability challenges for AI accelerators. Traditional guardband-based design approaches, which…

Hardware Architecture · Computer Science 2026-01-21 Meng Li , Tong Xie , Zuodong Zhang , Runsheng Wang

In this paper, a lifelong learning problem is studied for an Internet of Things (IoT) system. In the considered model, each IoT device aims to balance its information freshness and energy consumption tradeoff by controlling its…

Networking and Internet Architecture · Computer Science 2021-03-30 Zhenzhen Gong , Qimei Cui , Christina Chaccour , Bo Zhou , Mingzhe Chen , Walid Saad

Artificial intelligence (AI) technologies have dramatically advanced in recent years, resulting in revolutionary changes in people's lives. Empowered by edge computing, AI workloads are migrating from centralized cloud architectures to…

Hardware Architecture · Computer Science 2021-03-31 Cong Hao , Jordan Dotzel , Jinjun Xiong , Luca Benini , Zhiru Zhang , Deming Chen

Policy gradient methods have shown success in learning control policies for high-dimensional dynamical systems. Their biggest downside is the amount of exploration they require before yielding high-performing policies. In a lifelong…

Machine Learning · Computer Science 2020-10-23 Jorge A. Mendez , Boyu Wang , Eric Eaton

The creation of machine learning algorithms for intelligent agents capable of continuous, lifelong learning is a critical objective for algorithms being deployed on real-life systems in dynamic environments. Here we present an algorithm…

Machine Learning · Computer Science 2020-01-28 Andrew Brna , Ryan Brown , Patrick Connolly , Stephen Simons , Renee Shimizu , Mario Aguilar-Simon

Continual learning (CL) is a particular machine learning paradigm where the data distribution and learning objective changes through time, or where all the training data and objective criteria are never available at once. The evolution of…

Machine Learning · Computer Science 2019-11-25 Timothée Lesort , Vincenzo Lomonaco , Andrei Stoian , Davide Maltoni , David Filliat , Natalia Díaz-Rodríguez

The exponential growth of Internet-connected devices has presented challenges to traditional centralized computing systems due to latency and bandwidth limitations. Edge computing has evolved to address these difficulties by bringing…