English
Related papers

Related papers: Energy-efficient Decentralized Learning via Graph …

200 papers

Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information such as…

Machine Learning · Computer Science 2017-10-31 Jianqiao Wangni , Jialei Wang , Ji Liu , Tong Zhang

We provide the optimal receive combining strategy for federated learning in multiple-input multiple-output (MIMO) systems. Our proposed algorithm allows the clients to perform individual gradient sparsification which greatly improves…

Information Theory · Computer Science 2022-05-19 Ema Becirovic , Zheng Chen , Erik G. Larsson

In this paper, we discuss how to design the graph topology to reduce the communication complexity of certain algorithms for decentralized optimization. Our goal is to minimize the total communication needed to achieve a prescribed accuracy.…

Optimization and Control · Mathematics 2016-12-06 Yat-Tin Chow , Wei Shi , Tianyu Wu , Wotao Yin

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

Machine Learning · Computer Science 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

This note discusses an essentially decentralized interior point method, which is well suited for optimization problems arising in energy networks. Advantages of the proposed method are guaranteed and fast local convergence also for problems…

Optimization and Control · Mathematics 2023-07-07 Alexander Engelmann , Michael Kaupmann , Timm Faulwasser

This paper proposes energy-efficient coordinated beamforming strategies for multi-cell multi-user multiple-input single-output system. We consider a practical power consumption model, where part of the consumed power depends on the base…

Information Theory · Computer Science 2017-10-03 Oskari Tervo , Antti Tölli , Markku Juntti , Le-Nam Tran

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the…

Machine Learning · Statistics 2023-08-23 Xingyue Pu , Tianyue Cao , Xiaoyun Zhang , Xiaowen Dong , Siheng Chen

The reliable operation of large-scale electric power networks is increasingly challenging, particularly with the integration of stochastic renewable generation. In this work, we address the problem of minimizing network transients by…

Systems and Control · Electrical Eng. & Systems 2026-05-29 Gerald Ogbonna , David Bindel , Lindsay C. Anderson

The problem of decentralized multi-robot target tracking asks for jointly selecting actions, e.g., motion primitives, for the robots to maximize target tracking performance with local communications. One major challenge for practical…

In this work, a heterogeneous set of wireless devices sharing a common access point collaborates to perform a set of tasks. Using the Map-Reduce distributed computing framework, the tasks are optimally distributed amongst the nodes with the…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Antoine Paris , Hamed Mirghasemi , Ivan Stupia , Luc Vandendorpe

Decentralized learning algorithms empower interconnected devices to share data and computational resources to collaboratively train a machine learning model without the aid of a central coordinator. In the case of heterogeneous data…

Machine Learning · Computer Science 2023-01-16 Matteo Zecchin , Marios Kountouris , David Gesbert

In this paper, the problem of energy efficient transmission and computation resource allocation for federated learning (FL) over wireless communication networks is investigated. In the considered model, each user exploits limited local…

Information Theory · Computer Science 2020-11-19 Zhaohui Yang , Mingzhe Chen , Walid Saad , Choong Seon Hong , Mohammad Shikh-Bahaei

We consider a decentralized convex unconstrained optimization problem, where the cost function can be decomposed into a sum of strongly convex and smooth functions, associated with individual agents, interacting over a static or…

Optimization and Control · Mathematics 2023-12-12 Dmitry Metelev , Aleksandr Beznosikov , Alexander Rogozin , Alexander Gasnikov , Anton Proskurnikov

In this paper, we study the peak-aware energy scheduling problem using the competitive framework with machine learning prediction. With the uncertainty of energy demand as the fundamental challenge, the goal is to schedule the energy output…

Data Structures and Algorithms · Computer Science 2019-11-20 Russell Lee , Mohammad H. Hajiesmaili , Jian Li

The interconnectedness and interdependence of modern graphs are growing ever more complex, causing enormous resources for processing, storage, communication, and decision-making of these graphs. In this work, we focus on the task graph…

Machine Learning · Computer Science 2023-01-16 Ryan Wickman , Xiaofei Zhang , Weizi Li

The increasing demand for mobile ad hoc networks (MANETs) calls for decentralized mechanisms that can allocate transmit power across nodes and channels under stringent resource constraints. Existing optimization-based approaches, however,…

Networking and Internet Architecture · Computer Science 2026-05-14 Tomer Alter , Nir Shlezinger , Michael Segal

We derive a relationship between network representation in energy-efficient neuromorphic architectures and block Toplitz convolutional matrices. Inspired by this connection, we develop deep convolutional networks using a family of…

Neural and Evolutionary Computing · Computer Science 2016-06-09 Rathinakumar Appuswamy , Tapan Nayak , John Arthur , Steven Esser , Paul Merolla , Jeffrey Mckinstry , Timothy Melano , Myron Flickner , Dharmendra Modha

Localization in a pre-built map is a basic technique for robot autonomous navigation. Existing mapping and localization methods commonly work well in small-scale environments. As a map grows larger, however, more memory is required and…

Robotics · Computer Science 2023-03-21 Xiaoyu Zhang , Yun-Hui Liu

We define a graph-based rate optimization problem and consider its computation, which provides a unified approach to the computation of various theoretical limits, including the (conditional) graph entropy, rate-distortion functions and…

Information Theory · Computer Science 2025-03-18 Deheng Yuan , Tao Guo , Zhongyi Huang , Shi Jin

In this paper, we consider the problem of recovering a graph that represents the statistical data dependency among nodes for a set of data samples generated by nodes, which provides the basic structure to perform an inference task, such as…

Machine Learning · Statistics 2018-05-01 Hyeryung Jang , HyungSeok Song , Yung Yi
‹ Prev 1 3 4 5 6 7 10 Next ›