English
Related papers

Related papers: Deterministic Lifting Theorems for One-Way Number-…

200 papers

This work presents an analysis of semantic communication in the context of First-Order Logic (FOL)-based deduction. Specifically, the receiver holds a set of hypotheses about the State of the World (SotW), while the transmitter has…

Information Theory · Computer Science 2026-01-05 Ahmet Faruk Saz , Siheng Xiong , Faramarz Fekri

This paper considers distributed nonconvex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents…

Optimization and Control · Mathematics 2022-10-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

We study the communication complexity of truthful combinatorial auctions, and in particular the case where valuations are either subadditive or single-minded, which we denote with $\mathsf{SubAdd}\cup\mathsf{SingleM}$. We show that for…

Computer Science and Game Theory · Computer Science 2024-09-13 Shiri Ron , Clayton Thomas , S. Matthew Weinberg , Qianfan Zhang

We prove a sensitivity-to-communication lifting theorem for arbitrary gadgets. Given functions $f: \{0,1\}^n\to \{0,1\}$ and $g : \mathcal X\times \mathcal Y\to \{0,1\}$, denote $f\circ g(x,y) := f(g(x_1,y_1),\ldots,g(x_n,y_n))$. We show…

Computational Complexity · Computer Science 2025-04-01 Siddharth Iyer

Decentralized federated learning (DFL) is a variant of federated learning, where edge nodes only communicate with their one-hop neighbors to learn the optimal model. However, as information exchange is restricted in a range of one-hop in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-11 Li Chen , Wei Liu , Yunfei Chen , Weidong Wang

In this paper, we take a unified approach for network information theory and prove a coding theorem, which can recover most of the achievability results in network information theory that are based on random coding. The final single-letter…

Information Theory · Computer Science 2015-05-22 Si-Hyeon Lee , Sae-Young Chung

In this paper, we prove a strong XOR lemma for bounded-round two-player randomized communication. For a function $f:\mathcal{X}\times \mathcal{Y}\rightarrow\{0,1\}$, the $n$-fold XOR function $f^{\oplus n}:\mathcal{X}^n\times…

Computational Complexity · Computer Science 2022-08-25 Huacheng Yu

A restricted two-way communication problem in a small fully-connected network is investigated. The network consists of three nodes, all having access to a common channel with half-duplex constraint. Two nodes want to establish a dialog…

Information Theory · Computer Science 2014-09-05 Manuel Stein

Inspired by the great success of machine learning in the past decade, people have been thinking about the possibility of improving the theoretical results by exploring data distribution. In this paper, we revisit a fundamental problem…

Data Structures and Algorithms · Computer Science 2020-06-24 Hao Wu , Junhao Gan , Rui Zhang

There is a large and important collection of Ramsey-type combinatorial problems, closely related to central problems in complexity theory, that can be formulated in terms of the asymptotic growth of the size of the maximum independent sets…

Computational Complexity · Computer Science 2022-02-01 Matthias Christandl , Omar Fawzi , Hoang Ta , Jeroen Zuiddam

Many representation schemes combining first-order logic and probability have been proposed in recent years. Progress in unifying logical and probabilistic inference has been slower. Existing methods are mainly variants of lifted variable…

Artificial Intelligence · Computer Science 2012-02-20 Vibhav Gogate , Pedro Domingos

Federated learning is a training paradigm according to which a server-based model is cooperatively trained using local models running on edge devices and ensuring data privacy. These devices exchange information that induces a substantial…

Neural and Evolutionary Computing · Computer Science 2022-04-06 José Ángel Morell , Zakaria Abdelmoiz Dahi , Francisco Chicano , Gabriel Luque , Enrique Alba

In the Number On the Forehead (NOF) multiparty communication model, $k$ players want to evaluate a function $F : X_1 \times\cdots\times X_k\rightarrow Y$ on some input $(x_1,\dots,x_k)$ by broadcasting bits according to a predetermined…

Computational Complexity · Computer Science 2018-09-19 Yassine Hamoudi

Let $f: \{0,1\}^n \to \{0, 1\}$ be a boolean function, and let $f_\land (x, y) = f(x \land y)$ denote the AND-function of $f$, where $x \land y$ denotes bit-wise AND. We study the deterministic communication complexity of $f_\land$ and show…

Computational Complexity · Computer Science 2020-10-23 Alexander Knop , Shachar Lovett , Sam McGuire , Weiqiang Yuan

Lifted probabilistic inference algorithms exploit regularities in the structure of graphical models to perform inference more efficiently. More specifically, they identify groups of interchangeable variables and perform inference once per…

Artificial Intelligence · Computer Science 2014-02-05 Nima Taghipour , Daan Fierens , Jesse Davis , Hendrik Blockeel

In this paper we provide new bounds on classical and quantum distributional communication complexity in the two-party, one-way model of communication. In the classical model, our bound extends the well known upper bound of Kremer, Nisan and…

Information Theory · Computer Science 2008-02-29 Rahul Jain , Shengyu Zhang

In a multiparty message-passing model of communication, there are $k$ players. Each player has a private input, and they communicate by sending messages to one another over private channels. While this model has been used extensively in…

Data Structures and Algorithms · Computer Science 2013-05-22 Mark Braverman , Faith Ellen , Rotem Oshman , Toniann Pitassi , Vinod Vaikuntanathan

We investigate fast and communication-efficient algorithms for the classic problem of minimizing a sum of strongly convex and smooth functions that are distributed among $n$ different nodes, which can communicate using a limited number of…

Optimization and Control · Mathematics 2021-06-21 Foivos Alimisis , Peter Davies , Dan Alistarh

A subset of the integer planar grid $[N] \times [N]$ is called corner-free if it contains no triple of the form $(x,y), (x+\delta,y), (x,y+\delta)$. It is known that such a set has a vanishingly small density, but how large this density can…

Combinatorics · Mathematics 2021-10-05 Nati Linial , Adi Shraibman

Does Federated Learning (FL) work when both uplink and downlink communications have errors? How much communication noise can FL handle and what is its impact to the learning performance? This work is devoted to answering these practically…

Information Theory · Computer Science 2021-12-06 Xizixiang Wei , Cong Shen