English
Related papers

Related papers: Energy-Efficient Distributed Learning Algorithms f…

200 papers

Decentralized strategies are of interest for learning from large-scale data over networks. This paper studies learning over a network of geographically distributed nodes/agents subject to quantization. Each node possesses a private local…

Systems and Control · Electrical Eng. & Systems 2025-01-13 Mohammadreza Doostmohammadian , Muhammad I. Qureshi , Mohammad Hossein Khalesi , Hamid R. Rabiee , Usman A. Khan

Motivated by the need for distributed learning and optimization algorithms with low communication cost, we study communication efficient algorithms for distributed mean estimation. Unlike previous works, we make no probabilistic assumptions…

Machine Learning · Computer Science 2017-09-26 Ananda Theertha Suresh , Felix X. Yu , Sanjiv Kumar , H. Brendan McMahan

We investigate resource allocation scheme to reduce the energy consumption of federated learning (FL) in the integrated fog-cloud computing enabled Internet-of-things (IoT) networks. In the envisioned system, IoT devices are connected with…

Signal Processing · Electrical Eng. & Systems 2021-07-09 Mohammed S. Al-Abiad , Md. Zoheb Hassan , Md. Jahangir Hossain

Distributed architectures are gaining prominence in quantum machine learning as a means to overcome hardware limitations and enable scalable quantum information processing. In this context, we analyze the design and performance of…

Quantum Physics · Physics 2026-02-13 Marta Gili , Eliana Fiorelli , Ane Blázquez-García , Gian Luca Giorgi , Roberta Zambrini

Federated Learning (FL) allows devices to train a global machine learning model without sharing data. In the context of wireless networks, the inherently unreliable nature of the transmission channel introduces delays and errors that…

Networking and Internet Architecture · Computer Science 2024-08-05 Renan R. de Oliveira , Kleber V. Cardoso , Antonio Oliveira-Jr

The use of deep learning (DL) on Internet of Things (IoT) and mobile devices offers numerous advantages over cloud-based processing. However, such devices face substantial energy constraints to prolong battery-life, or may even operate…

Machine Learning · Computer Science 2025-05-20 Josh Millar , Hamed Haddadi , Anil Madhavapeddy

We consider distributed optimization over orthogonal collision channels in spatial random access networks. Users are spatially distributed and each user is in the interference range of a few other users. Each user is allowed to transmit…

Networking and Internet Architecture · Computer Science 2016-10-26 Kobi Cohen , Angelia Nedich , R. Srikant

In this paper, we investigate a distributed learning scheme for a broad class of stochastic optimization problems and games that arise in signal processing and wireless communications. The proposed algorithm relies on the method of matrix…

Information Theory · Computer Science 2017-04-05 Panayotis Mertikopoulos , E. Veronica Belmega , Romain Negrel , Luca Sanguinetti

Federated Learning (FL) allows collaborative training among multiple devices without data sharing, thus enabling privacy-sensitive applications on mobile or Internet of Things (IoT) devices, such as mobile health and asset tracking.…

Machine Learning · Computer Science 2025-06-10 Phung Lai , Xiaopeng Jiang , Hai Phan , Cristian Borcea , Khang Tran , An Chen , Vijaya Datta Mayyuri , Ruoming Jin

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

Optimization and Control · Mathematics 2017-11-22 Xuanyu Cao , K. J. Ray Liu

In recent years, long-term evolution (LTE) and 5G NR (5th Generation New Radio) technologies have showed great potential to utilize Machine Learning (ML) algorithms in optimizing their operations, both thanks to the availability of…

Networking and Internet Architecture · Computer Science 2021-10-18 Pedro Enrique Iturria Rivera , Melike Erol-Kantarci

Minimizing energy consumption of low-power wireless nodes is a persistent challenge from the constrained Internet of Things (IoT). In this paper, we start from the observation that constrained IoT devices have largely different hardware…

Networking and Internet Architecture · Computer Science 2025-08-14 Michel Rottleuthner , Thomas C. Schmidt , Matthias Wählisch

Improving the efficiency of inference in Large Language Models (LLMs) is a critical area of research. Post-training Quantization (PTQ) is a popular technique, but it often faces challenges at low-bit levels, particularly in downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Wenjin Ke , Zhe Li , Dong Li , Lu Tian , Emad Barsoum

Distributed consensus has been widely studied for sensor network applications. Whereas the asymptotic convergence rate has been extensively explored in prior work, other important and practical issues, including energy efficiency and link…

Networking and Internet Architecture · Computer Science 2013-04-10 Lei Chen , Jeff Frolik

In this paper we study the distributed average consensus problem in multi-agent systems with directed communication links that are subject to quantized information flow. Specifically, we present and analyze a distributed averaging algorithm…

Systems and Control · Electrical Eng. & Systems 2021-03-10 Apostolos I. Rikos , Christoforos N. Hadjicostis , Karl H. Johansson

There have been significant issues given the IoT, with heterogeneity of billions of devices and with a large amount of data. This paper proposed an innovative design of the Internet of Things (IoT) Environment Intrusion Detection System (or…

Artificial Intelligence · Computer Science 2024-06-19 Nadia Ansar , Mohammad Sadique Ansari , Mohammad Sharique , Aamina Khatoon , Md Abdul Malik , Md Munir Siddiqui

In this letter, we propose an energy-efficient split learning (SL) framework for fine-tuning large language models (LLMs) using geo-distributed personal data at the network edge, where LLMs are split and alternately across massive mobile…

Machine Learning · Computer Science 2025-01-15 Zuguang Li , Shaohua Wu , Liang Li , Songge Zhang

Communication-efficient distributed training algorithms have received considerable interest recently due to their benefits for training Large Language Models (LLMs) in bandwidth-constrained settings, such as across datacenters and over the…

Machine Learning · Computer Science 2025-11-07 Amir Sarfi , Benjamin Thérien , Joel Lidin , Eugene Belilovsky

Due to its efficiency and ease to implement, stochastic gradient descent (SGD) has been widely used in machine learning. In particular, SGD is one of the most popular optimization methods for distributed learning. Recently, quantized SGD…

Machine Learning · Computer Science 2019-01-11 Shen-Yi Zhao , Hao Gao , Wu-Jun Li

In this paper, we investigate the age-of-information (AoI) of a power domain non-orthogonal multiple access (NOMA) network, where multiple internet-of-things (IoT) devices transmit to a common gateway in a grant-free random fashion. More…

Signal Processing · Electrical Eng. & Systems 2025-02-10 Felippe Moraes Pereira , Jamil de Araujo Farhat , João Luiz Rebelatto , Glauber Brante , Richard Demo Souza