English
Related papers

Related papers: TinyReptile: TinyML with Federated Meta-Learning

200 papers

With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Li Chou , Zichang Liu , Zhuang Wang , Anshumali Shrivastava

Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant…

Machine Learning · Computer Science 2023-03-29 Chaoqun You , Kun Guo , Gang Feng , Peng Yang , Tony Q. S. Quek

With the emergence of Artificial Intelligence (AI), new attention has been given to implement AI algorithms on resource constrained tiny devices to expand the application domain of IoT. Multimodal Learning has recently become very popular…

Machine Learning · Computer Science 2022-04-20 Hasib-Al Rashid , Pretom Roy Ovi , Carl Busart , Aryya Gangopadhyay , Tinoosh Mohsenin

Federated learning (FL) is a popular framework for training an AI model using distributed mobile data in a wireless network. It features data parallelism by distributing the learning task to multiple edge devices while attempting to…

Machine Learning · Computer Science 2022-02-08 Dingzhu Wen , Ki-Jun Jeon , Kaibin Huang

Tiny Machine Learning (TinyML) enables efficient, lowcost, and privacy preserving machine learning inference directly on microcontroller units (MCUs) connected to sensors. Optimizing models for these constrained environments is crucial.…

Machine Learning · Computer Science 2024-09-18 Riya Samanta , Bidyut Saha , Soumya K. Ghosh , Ram Babu Roy

On-device learning enables edge devices to continually adapt the AI models to new data, which requires a small memory footprint to fit the tight memory constraint of edge devices. Existing work solves this problem by reducing the number of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Han Cai , Chuang Gan , Ligeng Zhu , Song Han

Tiny machine learning (TinyML) promises to revolutionize fields such as healthcare, environmental monitoring, and industrial maintenance by running machine learning models on low-power embedded systems. However, the complex optimizations…

Neural and Evolutionary Computing · Computer Science 2025-02-19 Emil Njor , Colby Banbury , Xenofon Fafoutis

With an increasing number of smart devices like internet of things (IoT) devices deployed in the field, offloadingtraining of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts toimprove users'…

Machine Learning · Computer Science 2023-07-19 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel

In recent years, there has been a significant interest in developing machine learning algorithms on embedded systems. This is particularly relevant for bare metal devices in Internet of Things, Robotics, and Industrial applications that…

Machine Learning · Computer Science 2025-01-07 Matteo Carnelos , Francesco Pasti , Nicola Bellotto

We study few-shot Natural Language Understanding (NLU) tasks with Large Language Models (LLMs) in federated learning (FL) scenarios. It is a challenging task due to limited labeled data and communication capacities in FL, especially with…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-27 Jingang Jiang , Xiangyang Liu , Chenyou Fan

Tiny machine learning (TinyML) in IoT systems exploits MCUs as edge devices for data processing. However, traditional TinyML methods can only perform inference, limited to static environments or classes. Real case scenarios usually work in…

Machine Learning · Computer Science 2022-09-02 Alessandro Avi , Andrea Albanese , Davide Brunelli

Federated learning is used for decentralized training of machine learning models on a large number (millions) of edge mobile devices. It is challenging because mobile devices often have limited communication bandwidth and local computation…

Machine Learning · Computer Science 2021-11-09 Hakim Sidahmed , Zheng Xu , Ankush Garg , Yuan Cao , Mingqing Chen

This book offers a hands-on introduction to building and understanding federated learning (FL) systems. FL enables multiple devices -- such as smartphones, sensors, or local computers -- to collaboratively train machine learning (ML)…

Machine Learning · Computer Science 2025-06-11 A. Jung

The increasing size of data generated by smartphones and IoT devices motivated the development of Federated Learning (FL), a framework for on-device collaborative training of machine learning models. First efforts in FL focused on learning…

Machine Learning · Computer Science 2022-11-08 Othmane Marfoq , Giovanni Neglia , Aurélien Bellet , Laetitia Kameni , Richard Vidal

Tiny Machine Learning (TML) is a new research area whose goal is to design machine and deep learning techniques able to operate in Embedded Systems and IoT units, hence satisfying the severe technological constraints on memory, computation,…

Machine Learning · Computer Science 2021-08-02 Simone Disabato , Manuel Roveri

Federated meta-learning (FML) has emerged as a promising paradigm to cope with the data limitation and heterogeneity challenges in today's edge learning arena. However, its performance is often limited by slow convergence and corresponding…

Machine Learning · Computer Science 2021-11-12 Sheng Yue , Ju Ren , Jiang Xin , Deyu Zhang , Yaoxue Zhang , Weihua Zhuang

Smartphones, autonomous vehicles, and the Internet-of-things (IoT) devices are considered the primary data source for a distributed network. Due to a revolutionary breakthrough in internet availability and continuous improvement of the IoT…

Machine Learning · Computer Science 2021-01-12 Ahmed Imteaj , M. Hadi Amini

Small-scale farming communities are disproportionately affected by water scarcity, erratic climate patterns, and a lack of access to advanced, affordable agricultural technologies. To address these challenges, this paper presents a novel,…

Machine Learning · Computer Science 2026-01-21 Kamogelo Taueatsoala , Caitlyn Daniels , Angelina J. Ramsunar , Petrus Bronkhorst , Absalom E. Ezugwu

Various IoT applications demand resource-constrained machine learning mechanisms for different applications such as pervasive healthcare, activity monitoring, speech recognition, real-time computer vision, etc. This necessitates us to…

Machine Learning · Computer Science 2020-11-09 Gautham Krishna Gudur , Bala Shyamala Balaji , Satheesh K. Perepu

The explosive growth of smart devices (e.g., mobile phones, vehicles, drones) with sensing, communication, and computation capabilities gives rise to an unprecedented amount of data. The generated massive data together with the rapid…

Networking and Internet Architecture · Computer Science 2023-10-10 Yong Zhou , Yuanming Shi , Haibo Zhou , Jingjing Wang , Liqun Fu , Yang Yang