English
Related papers

Related papers: On the Optimal Source Key Size of Secure Gradient …

200 papers

Training large neural networks requires distributing learning across multiple workers, where the cost of communicating gradients can be a significant bottleneck. signSGD alleviates this problem by transmitting just the sign of each…

Machine Learning · Computer Science 2018-08-09 Jeremy Bernstein , Yu-Xiang Wang , Kamyar Azizzadenesheli , Anima Anandkumar

Regenerating codes based on the approach of interference alignment for wireless interference channel achieve the cut-set bound for distributed storage systems. These codes provide data reliability, and perform efficient exact node repair…

Information Theory · Computer Science 2018-01-08 Natasa Paunkoska , Ninoslav Marina , Venceslav Kafedziski

We investigate the demand private coded caching problem, which is an $(N,K)$ coded caching problem with $N$ files, $K$ users, each equipped with a cache of size $M$, and an additional privacy constraint on user demands, i.e., each user can…

Information Theory · Computer Science 2025-04-28 Qinyi Lu , Nan Liu , Wei Kang , Chunguo Li

This paper reviews and highlights how coding schemes have been used to solve various problems in blockchain systems. Specifically, these problems relate to scaling blockchains in terms of their data storage, computation and communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-22 Changlin Yang , Kwan-Wu Chin , Jiguang Wang , Xiaodong Wang , Ying Liu , Zibin Zheng

We study the NP-hard problem of approximating a Minimum Routing Cost Spanning Tree in the message passing model with limited bandwidth (CONGEST model). In this problem one tries to find a spanning tree of a graph $G$ over $n$ nodes that…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-06 Alexandra Hochuli , Stephan Holzer , Roger Wattenhofer

With the vigorous development of artificial intelligence technology, various engineering technology applications have been implemented one after another. The gradient descent method plays an important role in solving various optimization…

Machine Learning · Computer Science 2021-04-27 Jinhuan Duan , Xianxian Li , Shiqi Gao , Jinyan Wang , Zili Zhong

Consensus is a common method for computing a function of the data distributed among the nodes of a network. Of particular interest is distributed average consensus, whereby the nodes iteratively compute the sample average of the data stored…

Information Theory · Computer Science 2021-12-06 Ryan Pilgrim

Achieving communication efficiency in decentralized machine learning has been attracting significant attention, with communication compression recognized as an effective technique in algorithm design. This paper takes a first step to…

Machine Learning · Computer Science 2023-05-18 Boyue Li , Yuejie Chi

Secure aggregation, which is a core component of federated learning, aggregates locally trained models from distributed users at a central server. The ``secure'' nature of such aggregation consists of the fact that no information about the…

Information Theory · Computer Science 2023-02-01 Kai Wan , Xin Yao , Hua Sun , Mingyue Ji , Giuseppe Caire

For a multi-source multi-terminal noiseless network, the key-dissemination problem involves the task of multicasting a secret key K from the network sources to its terminals. As in secure multicast network-coding, in the key-dissemination…

Information Theory · Computer Science 2022-05-20 Michael Langberg , Michelle Effros

We show optimal lower bounds for spanning forest computation in two different models: * One wants a data structure for fully dynamic spanning forest in which updates can insert or delete edges amongst a base set of $n$ vertices. The sole…

Data Structures and Algorithms · Computer Science 2019-11-27 Jelani Nelson , Huacheng Yu

Importance sampling has become an indispensable strategy to speed up optimization algorithms for large-scale applications. Improved adaptive variants - using importance values defined by the complete gradient information which changes…

Machine Learning · Computer Science 2017-11-08 Sebastian U. Stich , Anant Raj , Martin Jaggi

This paper studies the distributed linearly separable computation problem, which is a generalization of many existing distributed computing problems such as distributed gradient descent and distributed linear transform. In this problem, a…

Information Theory · Computer Science 2020-10-06 Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

This paper develops a communication-efficient algorithm to solve the stochastic optimization problem defined over a distributed network, aiming at reducing the burdensome communication in applications such as distributed machine…

Machine Learning · Statistics 2020-01-06 Weiyu Li , Tianyi Chen , Liping Li , Zhaoxian Wu , Qing Ling

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

Optimization and Control · Mathematics 2021-09-06 Yipeng Pang , Guoqiang Hu

In this paper, we investigate the transmission latency of the secure aggregation problem in a \emph{wireless} federated learning system with multiple curious servers. We propose a privacy-preserving coded aggregation scheme where the…

Information Theory · Computer Science 2025-07-01 Zhenhao Huang , Kai Liang , Yuanming Shi , Songze Li , Youlong Wu

We consider the problem of secure distributed matrix computation (SDMC), where a \textit{user} queries a function of data matrices generated at distributed \textit{source} nodes. We assume the availability of $N$ honest but curious…

Information Theory · Computer Science 2021-11-16 Nitish Mital , Cong Ling , Deniz Gunduz

In this work, we consider the problem of a network of agents collectively minimizing a sum of convex functions. The agents in our setting can only access their local objective functions and exchange information with their immediate…

Optimization and Control · Mathematics 2019-10-01 Charikleia Iakovidou , Ermin Wei

We study the secure decentralized Pliable Index CODing (PICOD) problem with circular side information sets at the users. The security constraint forbids every user to decode more than one message while a decentralized setting means there is…

Information Theory · Computer Science 2020-10-21 Tang Liu , Daniela Tuninetti

We study the problem of single-server multi-message private information retrieval with side information. One user wants to recover $N$ out of $K$ independent messages which are stored at a single server. The user initially possesses a…

Information Theory · Computer Science 2018-08-20 Su Li , Michael Gastpar