English
Related papers

Related papers: Ultra-Low-Latency Edge Inference for Distributed S…

200 papers

Edge computing is an emerging paradigm to enable low-latency applications, like mobile augmented reality, because it takes the computation on processing devices that are closer to the users. On the other hand, the need for highly scalable…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-21 Claudio Cicconetti , Marco Conti , Andrea Passarella

Future 5G cellular networks supporting ultra-reliable, low-latency communications (URLLC) could employ random access communication to reduce the overhead compared to scheduled access techniques used in 4G networks. We consider a wireless…

Information Theory · Computer Science 2018-06-06 Derya Malak , Howard Huang , Jeffrey G. Andrews

Provenance embedding algorithms are well known for tracking the footprints of information flow in wireless networks. Recently, low-latency provenance embedding algorithms have received traction in vehicular networks owing to strict…

Information Theory · Computer Science 2022-04-04 Suraj Sajeev , Manish Bansal , Sriraam S , J. Harshan , Huzur Saran , Yih-Chun Hu

Ultra-low latency supported by the fifth generation (5G) give impetus to the prosperity of many wireless network applications, such as autonomous driving, robotics, telepresence, virtual reality and so on. Ultra-low latency is not achieved…

Networking and Internet Architecture · Computer Science 2021-07-09 Xin Fan , Yan Huo

The growing demand for on-device large language model (LLM) inference highlights the need for efficient mobile edge computing (MEC) solutions, especially in resource-constrained settings. Speculative decoding offers a promising solution by…

Machine Learning · Computer Science 2025-12-01 Jungyeon Koh , Hyun Jong Yang

Sixth-generation (6G) wireless networks evolve from connecting devices to connecting intelligence. The focus turns to Goal-Oriented Communications, where the effectiveness of communication is assessed through task-level objectives over…

Networking and Internet Architecture · Computer Science 2026-03-16 Lorenzo Mario Amorosa , Zhan Gao , Tony Chahoud , Yiqun Wu , Lukas Eller , Marco Skocaj , Roberto Verdone

This paper introduces a novel framework for proactive cross-domain resource orchestration in 6G RAN-Edge networks, featuring large language model (LLM)-augmented agents. The system comprises specialized RAN (energy efficiency) and Edge…

Networking and Internet Architecture · Computer Science 2025-10-01 Hatim Chergui , Miguel Catalan Cid , Pouria Sayyad Khodashenas , Daniel Camps Mur , Christos Verikoukis

Integrated sensing, communication, and computation (ISCC) has been regarded as a prospective technology for the next-generation wireless network, supporting humancentric intelligent applications. However, the delay sensitivity of these…

Signal Processing · Electrical Eng. & Systems 2025-05-06 Weiwei Chen , Yinghui He , Guanding Yu , Jianfeng Wang , Haiyan Luo

The fifth generation (5G) of wireless systems holds the promise of supporting a wide range of services with different communication requirements. Ultra-reliable low-latency communications (URLLC) is a generic service that enables…

Signal Processing · Electrical Eng. & Systems 2018-03-14 Hamidreza Shariatmadari , Sassan Iraji , Riku Jantti , Petar Popovski , Zexian Li , Mikko A. Uusitalo

The distributed inference (DI) framework has gained traction as a technique for real-time applications empowered by cutting-edge deep machine learning (ML) on resource-constrained Internet of things (IoT) devices. In DI, computational tasks…

Machine Learning · Computer Science 2021-12-20 Sohei Itahara , Takayuki Nishio , Yusuke Koda , Koji Yamamoto

Federated learning (FL) has emerged as a widely adopted paradigm for enabling edge learning with distributed data while ensuring data privacy. However, the traditional FL with deep neural networks trained via backpropagation can hardly meet…

Machine Learning · Computer Science 2025-11-05 Jierui Zhang , Jianhao Huang , Kaibin Huang

Future autonomous systems require wireless connectivity able to support extremely stringent requirements on both latency and reliability. In this paper, we leverage recent developments in the field of finite-blocklength information theory…

Information Theory · Computer Science 2016-11-29 Johan Östman , Giuseppe Durisi , Erik G. Ström , Jingya Li , Henrik Sahlin , Gianluigi Liva

Next-generation wireless networks (6G) face a critical uplink challenge arising from stringent device-side resource constraints and the growing demand for intelligence services. This article introduces InferCom, an inference-driven…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Chunmei Xu , Zhi Ding , Yi Ma , Rahim Tafazolli , Peiying Zhu

The next-generation of wireless networks will enable many machine learning (ML) tools and applications to efficiently analyze various types of data collected by edge devices for inference, autonomy, and decision making purposes. However,…

Machine Learning · Computer Science 2021-04-07 Mingzhe Chen , Deniz Gündüz , Kaibin Huang , Walid Saad , Mehdi Bennis , Aneta Vulgarakis Feljan , H. Vincent Poor

Decentralized LLM inference distributes computation among heterogeneous nodes across the internet, offering a performant and cost-efficient solution, alternative to traditional centralized inference. However, the low cross-node network…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-06 Jiu Chen , Shuangyan Yang , Xu Xiong , Hexiao Duan , Xinran Zhang , Jie Ren , Dong Li

To receive the highest possible data rate or/and the most reliable connection, the User Equipment (UE) may want to choose between different networks. However, current LTE and LTE-Advanced mobile networks do not supply the UE with an…

Networking and Internet Architecture · Computer Science 2018-03-02 Robert Falkenberg , Karsten Heimann , Christian Wietfeld

Artificial intelligence (AI) technologies, and particularly deep learning systems, are traditionally the domain of large-scale cloud servers, which have access to high computational and energy resources. Nonetheless, in Internet-of-Things…

Signal Processing · Electrical Eng. & Systems 2022-07-26 Nir Shlezinger , Ivan V. Bajic

The proliferation of IoT devices in smart cities challenges 6G networks with conflicting energy-latency requirements across heterogeneous slices. Existing approaches struggle with the energy-latency trade-off, particularly for massive scale…

Networking and Internet Architecture · Computer Science 2025-11-07 Amine Abouaomar , Badr Ben Elallid , Nabil Benamar

A distinctive function of sixth-generation (6G) networks is the integration of distributed sensing and edge artificial intelligence (AI) to enable intelligent perception of the physical world. This resultant platform, termed integrated…

Numerical Analysis · Mathematics 2025-09-17 Zhanwei Wang , Mingyao Cui , Huiling Yang , Qunsong Zeng , Min Sheng , Kaibin Huang

Hybrid Language Models (HLMs) combine the low-latency efficiency of Small Language Models (SLMs) on edge devices with the high accuracy of Large Language Models (LLMs) on centralized servers. Unlike traditional end-to-end LLM inference,…

Machine Learning · Computer Science 2025-07-02 Faranaksadat Solat , Joohyung Lee , Mohamed Seif , Dusit Niyato , H. Vincent Poor