English
Related papers

Related papers: Energy-Efficient Distributed Learning Algorithms f…

200 papers

A novel framework is proposed for integrating reconfigurable intelligent surfaces (RIS) in unmanned aerial vehicle (UAV) enabled wireless networks, where an RIS is deployed for enhancing the service quality of the UAV. Non-orthogonal…

Signal Processing · Electrical Eng. & Systems 2020-10-07 Xiao Liu , Yuanwei Liu , Yue Chen

Gradient quantization is an emerging technique in reducing communication costs in distributed learning. Existing gradient quantization algorithms often rely on engineering heuristics or empirical observations, lacking a systematic approach…

Machine Learning · Computer Science 2021-08-02 Guangfeng Yan , Shao-Lun Huang , Tian Lan , Linqi Song

Recently, large language models (LLMs) have shown surprising performance in task-specific workloads as well as general tasks with the given prompts. However, to achieve unprecedented performance, recent LLMs use billions to trillions of…

Machine Learning · Computer Science 2024-06-21 Geonhwa Jeong , Po-An Tsai , Stephen W. Keckler , Tushar Krishna

In wireless Internet of things (IoT), the sensors usually have limited bandwidth and power resources. Therefore, in a distributed setup, each sensor should compress and quantize the sensed observations before transmitting them to a fusion…

Signal Processing · Electrical Eng. & Systems 2022-03-21 Mostafa Hussien , Kim Khoa Nguyen , Mohamed Cheriet

This paper addresses the problem of distributed learning under communication constraints, motivated by distributed signal processing in wireless sensor networks and data mining with distributed databases. After formalizing a general model…

Machine Learning · Computer Science 2016-11-15 Joel B. Predd , Sanjeev R. Kulkarni , H. Vincent Poor

With the increasing number and enhanced capabilities of IoT devices in smart buildings, these devices are evolving beyond basic data collection and control to actively participate in deep learning tasks. Federated Learning (FL), as a…

Machine Learning · Computer Science 2025-04-15 Heqiang Wang , Xiang Liu , Yucheng Liu , Jia Zhou , Weihong Yang , Xiaoxiong Zhong

This paper studies the problem of distributed weighted least-squares (WLS) estimation for an interconnected linear measurement network with additive noise. Two types of measurements are considered: self measurements for individual nodes,…

Systems and Control · Electrical Eng. & Systems 2020-02-27 Qiqi Yang , Zhaorong Zhang , Minyue Fu

We design a low complexity decentralized learning algorithm to train a recently proposed large neural network in distributed processing nodes (workers). We assume the communication network between the workers is synchronized and can be…

Machine Learning · Computer Science 2020-09-30 Xinyue Liang , Alireza M. Javid , Mikael Skoglund , Saikat Chatterjee

Contextual Artificial Intelligence (AI) based on emerging Transformer models is predicted to drive the next technology revolution in interactive wearable devices such as new-generation smart glasses. By coupling numerous sensors with small,…

Hardware Architecture · Computer Science 2025-03-27 Severin Bochem , Victor J. B. Jung , Arpan Prasad , Francesco Conti , Luca Benini

The rapid advancement of quantum computing has pushed classical designs into the quantum domain, breaking physical boundaries for computing-intensive and data-hungry applications. Given its immense potential, quantum-based computing systems…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-14 Anthony D'Onofrio , Amir Hossain , Lesther Santana , Naseem Machlovi , Samuel Stein , Jinwei Liu , Ang Li , Ying Mao

Modern quantum machine learning (QML) methods involve the variational optimization of parameterized quantum circuits on training datasets, followed by predictions on testing datasets. Most state-of-the-art QML algorithms currently lack…

Machine Learning · Computer Science 2024-11-08 Ruhan Wang , Ye Wang , Jing Liu , Toshiaki Koike-Akino

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This…

Optimization and Control · Mathematics 2023-08-01 Roula Nassif , Stefan Vlaski , Marco Carpentiero , Vincenzo Matta , Marc Antonini , Ali H. Sayed

The rise of digital and mobile communications has recently made the world more connected and networked, resulting in an unprecedented volume of data flowing between sources, data centers, or processes. While these data may be processed in a…

Machine Learning · Statistics 2018-09-21 Ibrahim El Khalil Harrane , Rémi Flamary , Cédric Richard

Adaptive algorithms based on in-network processing over networks are useful for online parameter estimation of historical data (e.g., noise covariance) in predictive control and machine learning areas. This paper focuses on the distributed…

Optimization and Control · Mathematics 2020-04-01 Jiahong Li , Nan Ma , Fang Deng

In this paper we focus on the distributed quantized average consensus problem in open multi-agent systems consisting of dynamic directed communication links among active nodes. We propose three communication-efficient distributed algorithms…

Systems and Control · Electrical Eng. & Systems 2026-03-10 Jiaqi Hu , Karl H. Johansson , Apostolos I. Rikos

This work develops robust diffusion recursive least squares algorithms to mitigate the performance degradation often experienced in networks of agents in the presence of impulsive noise. The first algorithm minimizes an exponentially…

Machine Learning · Computer Science 2019-02-05 Y. Yu , H. Zhao , R. C. de Lamare , Y. Zakharov , L. Lu

We present a comprehensive study on applying machine learning to detect distributed Denial of service (DDoS) attacks using large-scale Internet of Things (IoT) systems. While prior works and existing DDoS attacks have largely focused on…

Cryptography and Security · Computer Science 2023-02-17 Arvin Hekmati , Nishant Jethwa , Eugenio Grippo , Bhaskar Krishnamachari

Quantum Approximate Optimization Algorithms (QAOA) promise efficient solutions to classically intractable combinatorial optimization problems by harnessing shallow-depth quantum circuits. Yet, their performance and scalability often hinge…

Quantum Physics · Physics 2025-05-02 Kuan-Cheng Chen , Hiromichi Matsuyama , Wei-Hao Huang

In the Internet-of-Things (IoT) systems, there are plenty of informative data provided by a massive number of IoT devices (e.g., sensors). Learning a function from such data is of great interest in machine learning tasks for IoT systems.…

Machine Learning · Computer Science 2020-11-19 Jeongmin Chae , Songnam Hong

Distributed quantum computing (DQC) connects many small quantum processors into a single logical machine, offering a practical route to scalable quantum computation. However, most existing DQC paradigms are structure-agnostic. Circuit…

Quantum Physics · Physics 2026-03-10 Yuwen Huang , Xiaojun Lin , Bin Luo , John C. S. Lui