English
Related papers

Related papers: Energy-Efficient Distributed Learning Algorithms f…

200 papers

Large models (LMs) have immense potential in Internet of Things (IoT) systems, enabling applications such as intelligent voice assistants, predictive maintenance, and healthcare monitoring. However, training LMs on edge servers raises data…

Machine Learning · Computer Science 2025-01-30 Zuguang Li , Wen Wu , Shaohua Wu , Qiaohua Lin , Yaping Sun , Hui Wang

This paper introduces a noise-aware distributed Quantum Approximate Optimization Algorithm (QAOA) tailored for execution on near-term quantum hardware. Leveraging a distributed framework, we address the limitations of current Noisy…

Quantum Physics · Physics 2024-08-12 Kuan-Cheng Chen , Xiatian Xu , Felix Burt , Chen-Yu Liu , Shang Yu , Kin K Leung

Distributed algorithms, particularly Diffusion Least Mean Square, are widely favored for their reliability, robustness, and fast convergence in various industries. However, limited observability of the target can compromise the integrity of…

Signal Processing · Electrical Eng. & Systems 2023-10-18 Mahdi Shamsi , Farokh Marvasti

Large Language Models (LLMs) are scaling rapidly, creating significant challenges for collaborative server client distributed training, particularly in terms of communication efficiency and computational overheads. To address these…

Machine Learning · Computer Science 2025-10-08 Yurun Song , Zhuoyi Yang , Ian G. Harris , Sangeetha Abdu Jyothi

Semantic communication, recognized as a promising technology for future intelligent applications, has received widespread research attention. Despite the potential of semantic communication to enhance transmission reliability, especially in…

Information Theory · Computer Science 2023-12-05 Lingyi Wang , Wei Wu , Fuhui Zhou , Zhaohui Yang , Zhijin Qin

Low-bit quantization of network weights and activations can drastically reduce the memory footprint, complexity, energy consumption and latency of Deep Neural Networks (DNNs). However, low-bit quantization can also cause a considerable drop…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Ghouthi Boukli Hacene , Lukas Mauch , Stefan Uhlich , Fabien Cardinaux

Quantum computers are a highly promising tool for efficiently simulating quantum many-body systems. The preparation of their eigenstates is of particular interest and can be addressed, e.g., by quantum phase estimation algorithms. The…

Quantum Physics · Physics 2025-08-28 Xiaoyu Liu , Benjamin F. Schiffer , Jordi Tura

This paper proposes a distributed alternating mixed discrete-continuous (DAMDC) algorithm to approach the oracle algorithm based on the diffusion strategy for parameter and spectrum estimation over sensor networks. A least mean squares…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-12 R. C. de Lamare

Resource management in Internet of Things (IoT) systems is a major challenge due to the massive scale and heterogeneity of the IoT system. For instance, most IoT applications require timely delivery of collected information, which is a key…

Information Theory · Computer Science 2021-01-05 Taehyeun Park , Walid Saad , Bo Zhou

Due to the pervasive diffusion of personal mobile and IoT devices, many "smart environments" (e.g., smart cities and smart factories) will be, generators of huge amounts of data. Currently, analysis of this data is typically achieved…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-24 Lorenzo Valerio , Marco Conti , Andrea Passarella

Many science and engineering applications involve solving a linear least-squares system formed from some field measurements. In the distributed cyber-physical systems (CPS), often each sensor node used for measurement only knows partial…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-23 Lei Shi , Liang Zhao , Wen-Zhan Song , Goutham Kamath , Yuan Wu , Xuefeng Liu

Edge machine learning can deliver low-latency and private artificial intelligent (AI) services for mobile devices by leveraging computation and storage resources at the network edge. This paper presents an energy-efficient edge processing…

Information Theory · Computer Science 2020-03-03 Kai Yang , Yuanming Shi , Wei Yu , Zhi Ding

Beyond 5G and 6G networks are expected to support new and challenging use cases and applications that depend on a certain level of Quality of Service (QoS) to operate smoothly. Predicting the QoS in a timely manner is of high importance,…

Networking and Internet Architecture · Computer Science 2025-02-19 Nikolaos Koursioumpas , Lina Magoula , Ioannis Stavrakakis , Nancy Alonistioti , M. A. Gutierrez-Estevez , Ramin Khalili

Diffusion models have demonstrated remarkable capabilities in image synthesis and related generative tasks. Nevertheless, their practicality for real-world applications is constrained by substantial computational costs and latency issues.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yefei He , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

Federated learning is a distributed framework according to which a model is trained over a set of devices, while keeping data localized. This framework faces several systems-oriented challenges which include (i) communication bottleneck…

Machine Learning · Computer Science 2020-06-09 Amirhossein Reisizadeh , Aryan Mokhtari , Hamed Hassani , Ali Jadbabaie , Ramtin Pedarsani

This paper proposes a novel distributed reduced--rank scheme and an adaptive algorithm for distributed estimation in wireless sensor networks. The proposed distributed scheme is based on a transformation that performs dimensionality…

Information Theory · Computer Science 2014-11-06 S. Xu , R. C. de Lamare , H. V. Poor

A distributed adaptive algorithm is proposed to solve a node-specific parameter estimation problem where nodes are interested in estimating parameters of local interest and parameters of global interest to the whole network. To address the…

Systems and Control · Computer Science 2014-07-02 Nikola Bogdanović , Jorge Plata-Chaves , Kostas Berberidis

In this work, we consider a remote monitoring scenario in which multiple sensors share a wireless channel to deliver their status updates to a process monitor via an access point (AP). Moreover, we consider that the sensors randomly arrive…

Networking and Internet Architecture · Computer Science 2022-02-21 Yash Deshpande , Onur Ayan , Wolfgang Kellerer

We investigate the performance of distributed least-mean square (LMS) algorithms for parameter estimation over sensor networks where the regression data of each node are corrupted by white measurement noise. Under this condition, we show…

Systems and Control · Computer Science 2016-11-18 Reza Abdolee , Benoit Champagne

Analog signals processed in digital hardware are quantized into a discrete bit-constrained representation. Quantization is typically carried out using analog-to-digital converters (ADCs), operating in a serial scalar manner. In some…

Information Theory · Computer Science 2019-10-22 Alejandro Cohen , Nir Shlezinger , Salman Salamatian , Yonina C. Eldar , Muriel Médard