English
Related papers

Related papers: ScaDLES: Scalable Deep Learning over Streaming dat…

200 papers

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

In today's era of Internet of Things (IoT), where massive amounts of data are produced by IoT and other devices, edge computing has emerged as a prominent paradigm for low-latency data processing. However, applications may have diverse…

Networking and Internet Architecture · Computer Science 2021-07-19 Md Washik Al Azad , Susmit Shannigrahi , Nicholas Stergiou , Francisco R. Ortega , Spyridon Mastorakis

In this letter, we propose an energy-efficient split learning (SL) framework for fine-tuning large language models (LLMs) using geo-distributed personal data at the network edge, where LLMs are split and alternately across massive mobile…

Machine Learning · Computer Science 2025-01-15 Zuguang Li , Shaohua Wu , Liang Li , Songge Zhang

Internet of Things (IoT) is considered as the enabling platform for a variety of promising applications, such as smart transportation and smart city, where massive devices are interconnected for data collection and processing. These IoT…

Networking and Internet Architecture · Computer Science 2021-03-22 Laha Ale , Ning Zhang , Xiaojie Fang , Xianfu Chen , Shaohua Wu , Longzhuang Li

As learning models continue to grow in size, enabling on-device local training of these models has emerged as a critical challenge in federated learning. A popular solution is sub-model training, where the server only distributes randomly…

Machine Learning · Computer Science 2025-11-11 Yuyang Deng , Fuli Qiao , Mehrdad Mahdavi

With huge amounts of training data, deep learning has made great breakthroughs in many artificial intelligence (AI) applications. However, such large-scale data sets present computational challenges, requiring training to be distributed on…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-01 Shaohuai Shi , Qiang Wang , Xiaowen Chu , Bo Li

Split Computing (SC), where a Deep Neural Network (DNN) is intelligently split with a part of it deployed on an edge device and the rest on a remote server is emerging as a promising approach. It allows the power of DNNs to be leveraged for…

Machine Learning · Computer Science 2024-07-09 Luigi Capogrosso , Enrico Fraccaroli , Samarjit Chakraborty , Franco Fummi , Marco Cristani

In 5G and Beyond networks, Artificial Intelligence applications are expected to be increasingly ubiquitous. This necessitates a paradigm shift from the current cloud-centric model training approach to the Edge Computing based collaborative…

Networking and Internet Architecture · Computer Science 2020-06-02 Wei Yang Bryan Lim , Jer Shyuan Ng , Zehui Xiong , Dusit Niyato , Cyril Leung , Chunyan Miao , Qiang Yang

Federated learning (FL) is a privacy-preserving distributed machine learning technique that trains models while keeping all the original data generated on devices locally. Since devices may be resource constrained, offloading can be used to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-18 Rehmat Ullah , Di Wu , Paul Harvey , Peter Kilpatrick , Ivor Spence , Blesson Varghese

Generative conversational interfaces powered by large language models (LLMs) typically stream output token-by-token at a rate determined by computational budget, often neglecting actual human reading speeds and the cognitive load associated…

Human-Computer Interaction · Computer Science 2025-07-25 Chang Xiao , Brenda Yang

Federated learning (FL) has provided a new methodology for coordinating a group of clients to train a machine learning model collaboratively, bringing an efficient paradigm in edge intelligence. Despite its promise, FL faces several…

Machine Learning · Computer Science 2025-03-07 Ziruo Hao , Zhenhua Cui , Tao Yang , Bo Hu , Xiaofeng Wu , Hui Feng

Applications that generate huge amounts of data in the form of fast streams are becoming increasingly prevalent, being therefore necessary to learn in an online manner. These conditions usually impose memory and processing time…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Jesus L. Lobo , Javier Del Ser , Albert Bifet , Nikola Kasabov

Edge computing has emerged as a popular paradigm for supporting mobile and IoT applications with low latency or high bandwidth needs. The attractiveness of edge computing has been further enhanced due to the recent availability of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-30 Qianlin Liang , Prashant Shenoy , David Irwin

As deep neural networks (DNNs) are being applied to a wide range of edge intelligent applications, it is critical for edge inference platforms to have both high-throughput and low-latency at the same time. Such edge platforms with multiple…

Machine Learning · Computer Science 2023-05-03 Ziyang Zhang , Huan Li , Yang Zhao , Changyao Lin , Jie Liu

Decentralized learning enables edge users to collaboratively train models by exchanging information via device-to-device communication, yet prior works have been limited to wireless networks with fixed topologies and reliable workers. In…

Information Theory · Computer Science 2022-02-03 Eunjeong Jeong , Matteo Zecchin , Marios Kountouris

Peer-to-peer deep learning algorithms are enabling distributed edge devices to collaboratively train deep neural networks without exchanging raw training data or relying on a central server. Peer-to-Peer Learning (P2PL) and other algorithms…

Machine Learning · Computer Science 2023-12-22 Srinivasa Pranav , José M. F. Moura

The world needs diverse and unbiased data to train deep learning models. Currently data comes from a variety of sources that are unmoderated to a large extent. The outcomes of training neural networks with unverified data yields biased…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-27 Vaibhav Mathur , Karanbir Chahal

We design and implement a distributed multinode synchronous SGD algorithm, without altering hyper parameters, or compressing data, or altering algorithmic behavior. We perform a detailed analysis of scaling, and identify optimal design…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-02 Dipankar Das , Sasikanth Avancha , Dheevatsa Mudigere , Karthikeyan Vaidynathan , Srinivas Sridharan , Dhiraj Kalamkar , Bharat Kaul , Pradeep Dubey

Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-05 Yuanli Wang , Lei Huang

Owing to the large volume of sensed data from the enormous number of IoT devices in operation today, centralized machine learning algorithms operating on such data incur an unbearable training time, and thus cannot satisfy the requirements…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Shashank Jere , Qiang Fan , Bodong Shang , Lianjun Li , Lingjia Liu