English
Related papers

Related papers: Enabling All In-Edge Deep Learning: A Literature R…

200 papers

With mobile, IoT and sensor devices becoming pervasive in our life and recent advances in Edge Computational Intelligence (e.g., Edge AI/ML), it became evident that the traditional methods for training AI/ML models are becoming obsolete,…

Machine Learning · Computer Science 2023-06-21 Ahmed M. Abdelmoniem

The success of deep neural networks (DNNs) is heavily dependent on computational resources. While DNNs are often employed on cloud servers, there is a growing need to operate DNNs on edge devices. Edge devices are typically limited in their…

Machine Learning · Computer Science 2022-06-08 May Malka , Erez Farhan , Hai Morgenstern , Nir Shlezinger

Amidst the robust impetus from artificial intelligence (AI) and big data, edge intelligence (EI) has emerged as a nascent computing paradigm, synthesizing AI with edge computing (EC) to become an exemplary solution for unleashing the full…

Networking and Internet Architecture · Computer Science 2024-11-05 Xiaofei Wang , Yunfeng Zhao , Chao Qiu , Qinghua Hu , Victor C. M. Leung

On-device large language models (LLMs), referring to running LLMs on edge devices, have raised considerable interest since they are more cost-effective, latency-efficient, and privacy-preserving compared with the cloud paradigm.…

Networking and Internet Architecture · Computer Science 2025-03-21 Guanqiao Qu , Qiyuan Chen , Wei Wei , Zheng Lin , Xianhao Chen , Kaibin Huang

The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making purposes. However,…

Machine Learning · Computer Science 2021-04-07 Mingzhe Chen , Deniz Gündüz , Kaibin Huang , Walid Saad , Mehdi Bennis , Aneta Vulgarakis Feljan , H. Vincent Poor

As edge devices become more capable and pervasive in wireless networks, there is growing interest in leveraging their collective compute power for distributed learning. However, optimizing learning at the network edge entails unique…

Machine Learning · Computer Science 2025-04-14 Thomas Tsouparopoulos , Iordanis Koutsopoulos

Edge-AI, the convergence of edge computing and artificial intelligence (AI), has become a promising paradigm that enables the deployment of advanced AI models at the network edge, close to users. In Edge-AI, federated continual learning…

Machine Learning · Computer Science 2024-11-22 Zi Wang , Fei Wu , Feng Yu , Yurui Zhou , Jia Hu , Geyong Min

There is a growing demand to deploy computation-intensive deep learning (DL) models on resource-constrained mobile devices for real-time intelligent applications. Equipped with a variety of processing units such as CPUs, GPUs, and NPUs, the…

Machine Learning · Computer Science 2024-05-06 Sicong Liu , Wentao Zhou , Zimu Zhou , Bin Guo , Minfan Wang , Cheng Fang , Zheng Lin , Zhiwen Yu

The ubiquitous use of IoT and machine learning applications is creating large amounts of data that require accurate and real-time processing. Although edge-based smart data processing can be enabled by deploying pretrained models, the…

Machine Learning · Computer Science 2021-09-15 Yinghan Long , Indranil Chakraborty , Gopalakrishnan Srinivasan , Kaushik Roy

Resource-constrained Edge Devices (EDs), e.g., IoT sensors and microcontroller units, are expected to make intelligent decisions using Deep Learning (DL) inference at the edge of the network. Toward this end, there is a significant research…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Ghina Al-Atat , Andrea Fresa , Adarsh Prasad Behera , Vishnu Narayanan Moothedath , James Gross , Jaya Prakash Champati

Deep learning (DL) along with never-ending advancements in computational processing and cloud technologies have bestowed us powerful analyzing tools and techniques in the past decade and enabled us to use and apply them in various fields of…

Machine Learning · Computer Science 2023-02-23 Farzan Shenavarmasouleh , Farid Ghareh Mohammadi , Khaled M. Rasheed , Hamid R. Arabnia

Pervasive mobile AI applications primarily employ one of the two learning paradigms: cloud-based learning (with powerful large models) or on-device learning (with lightweight small models). Despite their own advantages, neither paradigm can…

Machine Learning · Computer Science 2023-11-21 Yan Zhuang , Zhenzhe Zheng , Yunfeng Shao , Bingshuai Li , Fan Wu , Guihai Chen

Edge computing has emerged as a popular paradigm for supporting mobile and IoT applications with low latency or high bandwidth needs. The attractiveness of edge computing has been further enhanced due to the recent availability of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-30 Qianlin Liang , Prashant Shenoy , David Irwin

Deep learning (DL) has achieved great success in many applications, but it has been less well analyzed from the theoretical perspective. The unexplainable success of black-box DL models has raised questions among scientists and promoted the…

Robotics · Computer Science 2023-08-25 Huu-Thiet Nguyen , Chien Chern Cheah , Kar-Ann Toh

Edge-cloud collaborative computing (ECCC) has emerged as a pivotal paradigm for addressing the computational demands of modern intelligent applications, integrating cloud resources with edge devices to enable efficient, low-latency…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-19 Jing Liu , Yao Du , Kun Yang , Jiaqi Wu , Yan Wang , Xiping Hu , Zehua Wang , Yang Liu , Peng Sun , Azzedine Boukerche , Victor C. M. Leung

Distributed deep learning (DL) has become prevalent in recent years to reduce training time by leveraging multiple computing devices (e.g., GPUs/TPUs) due to larger models and datasets. However, system scalability is limited by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-04 Zhenheng Tang , Shaohuai Shi , Wei Wang , Bo Li , Xiaowen Chu

Large language models (LLMs), which have shown remarkable capabilities, are revolutionizing AI development and potentially shaping our future. However, given their multimodality, the status quo cloud-based deployment faces some critical…

Machine Learning · Computer Science 2025-06-05 Zheng Lin , Guanqiao Qu , Qiyuan Chen , Xianhao Chen , Zhe Chen , Kaibin Huang

Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to prolonged latency, high bandwidth cost, and privacy concerns.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Mingjin Zhang , Jiannong Cao , Xiaoming Shen , Zeyang Cui

In recent years, the integration of artificial intelligence (AI) and cloud computing has emerged as a promising avenue for addressing the growing computational demands of AI applications. This paper presents a comprehensive study of…

Machine Learning · Computer Science 2023-04-28 Neelesh Mungoli

Edge computing offers an additional layer of compute infrastructure closer to the data source before raw data from privacy-sensitive and performance-critical applications is transferred to a cloud data center. Deep Neural Networks (DNNs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-17 Francis McNamee , Schahram Dustadar , Peter Kilpatrick , Weisong Shi , Ivor Spence , Blesson Varghese