English
Related papers

Related papers: A Parallel Distributed Algorithm for the Power SVD…

200 papers

In this paper we consider distributed optimization problems in which the cost function is separable, i.e., a sum of possibly non-smooth functions all sharing a common variable, and can be split into a strongly convex term and a convex one.…

Systems and Control · Computer Science 2016-06-27 Ivano Notarnicola , Giuseppe Notarstefano

We consider cooperative multi-agent resource sharing problems over time-varying communication networks, where only local communications are allowed. The objective is to minimize the sum of agent-specific composite convex functions subject…

Optimization and Control · Mathematics 2019-08-27 Necdet Serhat Aybat , Erfan Yazdandoost Hamedani

The sparse matrix-vector (SpMV) multiplication is an important computational kernel, but it is notoriously difficult to execute efficiently. This paper investigates algorithm performance for unstructured sparse matrices, which are more…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-27 Kobe Bergmans , Karl Meerbergen , Raf Vandebril

We address the issue of speeding up the training of convolutional networks. Here we study a distributed method adapted to stochastic gradient descent (SGD). The parallel optimization setup uses several threads, each applying individual…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Michael Blot , David Picard , Matthieu Cord , Nicolas Thome

For Device-to-device (D2D) communication of Internet-of-Things (IoT) enabled 5G system, there is a limit to allocating resources considering a complicated interference between different links in a centralized manner. If D2D link is…

Signal Processing · Electrical Eng. & Systems 2020-06-09 Jeehyeong Kim , Joohan Park , Jaewon Noh , Sunghyun Cho

In the first part of the paper, we have studied the computational privacy risks in distributed computing protocols against local or global dynamics eavesdroppers, and proposed a Privacy-Preserving-Summation-Consistent (PPSC) mechanism as a…

Systems and Control · Computer Science 2019-02-20 Yang Liu , Junfeng Wu , Ian Manchester , Guodong Shi

Iterative graph algorithms often compute intermediate values and update them as computation progresses. Updated output values are used as inputs for computations in current or subsequent iterations; hence the number of iterations required…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-05 Mark P. Blanco , Scott McMillan , Tze Meng Low

Community battery systems have been widely deployed to provide services to the grid. Unlike a single battery storage system in the community, coordinating multiple community batteries can further unlock their value, enhancing the viability…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Canchen Jiang , Hao Wang

Voltage regulation in distribution networks is challenged by increasing penetration of distributed energy resources (DERs). Thanks to advancement in power electronics, these DERs can be leveraged to regulate the grid voltage by quickly…

Optimization and Control · Mathematics 2017-07-25 Hao Jan Liu , Wei Shi , Hao Zhu

Cellular network performance can significantly benefit from direct device-to-device (D2D) communication, but interference from cochannel D2D communication limits the performance gain. In hybrid networks consisting of D2D and cellular links,…

Information Theory · Computer Science 2014-12-16 Qiaoyang Ye , Mazin Al-Shalash , Constantine Caramanis , Jeffrey G. Andrews

Eigenvectors of data matrices play an important role in many computational problems, ranging from signal processing to machine learning and control. For instance, algorithms that compute positions of the nodes of a wireless network on the…

Data Structures and Algorithms · Computer Science 2011-03-23 Satish Babu Korada , Andrea Montanari , Sewoong Oh

This paper studies the problem of distributed computation over a network of wireless sensors. While this problem applies to many emerging applications, to keep our discussion concrete we will focus on sensor networks used for structural…

Networking and Internet Architecture · Computer Science 2015-05-19 Apoorva Jindal , Mingyan Liu

Efficient and robust algorithms for decentralized estimation in networks are essential to many distributed systems. Whereas distributed estimation of sample mean statistics has been the subject of a good deal of attention, computation of…

Machine Learning · Statistics 2019-01-25 Igor Colin , Aurélien Bellet , Joseph Salmon , Stéphan Clémençon

In this paper we deal with a network of computing agents with local processing and neighboring communication capabilities that aim at solving (without any central unit) a submodular optimization problem. The cost function is the sum of many…

Optimization and Control · Mathematics 2020-05-26 Andrea Testa , Francesco Farina , Giuseppe Notarstefano

Some text generation tasks, such as Attribute Value Extraction (AVE), require decoding multiple independent sequences from the same document context. While standard autoregressive decoding is slow due to its sequential nature, the…

Computation and Language · Computer Science 2026-04-30 Theodore Glavas , Nikhita Vedula , Dushyanta Dhyani , Yilun Zhu , Shervin Malmasi

Higher-order singular value decomposition (HOSVD) is a celebrated tool for tensor data analysis. The sequential HOSVD was recently generalized to the quaternion domain, while a naive quaternion extension of the classical HOSVD% by De…

Numerical Analysis · Mathematics 2025-06-26 Hanxin Ya , Yuning Yang

Presented is an algorithm based on dynamic mode decomposition (DMD) for acceleration of the power method (PM). The power method is a simple technique for determining the dominant eigenmode of an operator $\mathbf{A}$, and variants of the…

Computational Physics · Physics 2019-04-23 Jeremy A. Roberts , Leidong Xu , Rabab Elzohery , Mohammad Abdo

We consider speeding up stochastic gradient descent (SGD) by parallelizing it across multiple workers. We assume the same data set is shared among $n$ workers, who can take SGD steps and coordinate with a central server. Unfortunately, this…

Optimization and Control · Mathematics 2020-06-05 Artin Spiridonoff , Alex Olshevsky , Ioannis Ch. Paschalidis

Power packets are proposed as a transmission unit that can deliver power and information simultaneously. They are transferred using the store-and-forward method of power routers. A system that achieves power supply/demand in this manner is…

Systems and Control · Electrical Eng. & Systems 2020-11-03 Seongcheol Baek , Hiroyasu Ando , Takashi Hikihara

Privacy-preserving distributed processing has received considerable attention recently. The main purpose of these algorithms is to solve certain signal processing tasks over a network in a decentralised fashion without revealing…

Signal Processing · Electrical Eng. & Systems 2023-12-14 Sebastian O. Jordan , Qiongxiu Li , Richard Heusdens