中文
相关论文

相关论文: Continual Learning on the Edge with TensorFlow Lit…

200 篇论文

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

计算机视觉与模式识别 · 计算机科学 2021-10-20 Matthias De Lange , Tinne Tuytelaars

Machine Learning and Data Mining (MLDM) algorithms are becoming increasingly important in analyzing large volume of data generated by simulations, experiments and mobile devices. With increasing data volume, distributed memory systems (such…

分布式、并行与集群计算 · 计算机科学 2017-08-21 Abhinav Vishnu , Charles Siegel , Jeffrey Daily

Deep learning has been popularized by its recent successes on challenging artificial intelligence problems. One of the reasons for its dominance is also an ongoing challenge: the need for immense amounts of computational power. Hardware…

机器学习 · 计算机科学 2016-11-17 Robert Adolf , Saketh Rama , Brandon Reagen , Gu-Yeon Wei , David Brooks

This article surveys Cognitive Edge Computing as a practical and methodical pathway for deploying reasoning-capable Large Language Models (LLMs) and autonomous AI agents on resource-constrained devices at the network edge. We present a…

机器学习 · 计算机科学 2025-11-10 Xubin Wang , Qing Li , Weijia Jia

Modern mobile applications are benefiting significantly from the advancement in deep learning, e.g., implementing real-time image recognition and conversational system. Given a trained deep learning model, applications usually need to…

性能 · 计算机科学 2019-03-01 Tian Guo

Federated Learning (FL) has become a viable technique for realizing privacy-enhancing distributed deep learning on the network edge. Heterogeneous hardware, unreliable client devices, and energy constraints often characterize edge computing…

机器学习 · 计算机科学 2024-11-05 Herbert Woisetschläger , Alexander Erben , Ruben Mayer , Shiqiang Wang , Hans-Arno Jacobsen

Deep learning is a promising tool to determine the physical model that describes our universe. To handle the considerable computational cost of this problem, we present CosmoFlow: a highly scalable deep learning application built on top of…

Machine learning (ML) is expected to play a major role in 5G edge computing. Various studies have demonstrated that ML is highly suitable for optimizing edge computing systems as rapid mobility and application-induced changes occur at the…

机器学习 · 计算机科学 2021-11-16 Amir Hossein Estiri , Muthucumaru Maheswaran

Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. To overcome this problem, we present a novel approach based on task-conditioned hypernetworks, i.e., networks that generate…

机器学习 · 计算机科学 2022-04-12 Johannes von Oswald , Christian Henning , Benjamin F. Grewe , João Sacramento

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

计算与语言 · 计算机科学 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

TensorFlow is a popular emerging open-source programming framework supporting the execution of distributed applications on heterogeneous hardware. While TensorFlow has been initially designed for developing Machine Learning (ML)…

分布式、并行与集群计算 · 计算机科学 2020-03-03 Steven W. D. Chien , Stefano Markidis , Vyacheslav Olshevsky , Yaroslav Bulatov , Erwin Laure , Jeffrey S. Vetter

The proliferation of AI models in everyday devices has highlighted a critical challenge: prediction errors that degrade user experience. While existing solutions focus on error detection, they rarely provide efficient correction mechanisms,…

Training modern deep learning models requires large amounts of computation, often provided by GPUs. Scaling computation from one GPU to many can enable much faster training and research progress but entails two complications. First, the…

机器学习 · 计算机科学 2018-02-22 Alexander Sergeev , Mike Del Balso

Locally caching contents at the network edge constitutes one of the most disruptive approaches in $5$G wireless networks. Reaping the benefits of edge caching hinges on solving a myriad of challenges such as how, what and when to…

信息论 · 计算机科学 2015-09-30 Ejder Baştuğ , Mehdi Bennis , Mérouane Debbah

Rapid development of large-scale pre-training has resulted in foundation models that can act as effective feature extractors on a variety of downstream tasks and domains. Motivated by this, we study the efficacy of pre-trained vision models…

Recently, along with the rapid development of mobile communication technology, edge computing theory and techniques have been attracting more and more attentions from global researchers and engineers, which can significantly bridge the…

网络与互联网体系结构 · 计算机科学 2019-12-23 Xiaofei Wang , Yiwen Han , Chenyang Wang , Qiyang Zhao , Xu Chen , Min Chen

As machine learning (ML) has seen increasing adoption in safety-critical domains (e.g., autonomous vehicles), the reliability of ML systems has also grown in importance. While prior studies have proposed techniques to enable efficient…

分布式、并行与集群计算 · 计算机科学 2020-04-07 Zitao Chen , Niranjhana Narayanan , Bo Fang , Guanpeng Li , Karthik Pattabiraman , Nathan DeBardeleben

Continuously learning new classes without catastrophic forgetting is a challenging problem for on-device environmental sound classification given the restrictions on computation resources (e.g., model size, running memory). To address this…

声音 · 计算机科学 2022-07-19 Yang Xiao , Xubo Liu , James King , Arshdeep Singh , Eng Siong Chng , Mark D. Plumbley , Wenwu Wang

Online continual learning, the process of training models on streaming data, has gained increasing attention in recent years. However, a critical aspect often overlooked is the label delay, where new data may not be labeled due to slow and…

机器学习 · 计算机科学 2024-04-29 Botos Csaba , Wenxuan Zhang , Matthias Müller , Ser-Nam Lim , Mohamed Elhoseiny , Philip Torr , Adel Bibi

A common challenge in continual learning (CL) is catastrophic forgetting, where the performance on old tasks drops after new, additional tasks are learned. In this paper, we propose a novel framework called ReCL to slow down forgetting in…

机器学习 · 计算机科学 2025-03-04 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel