English
Related papers

Related papers: The space complexity of recognizing well-parenthes…

200 papers

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

Machine Learning · Computer Science 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

We consider the problem of selecting $k$ seed nodes in a network to maximize the minimum probability of activation under an independent cascade beginning at these seeds. The motivation is to promote fairness by ensuring that even the least…

Social and Information Networks · Computer Science 2025-02-20 Dennis Robert Windham , Caroline J. Wendt , Alex Crane , Madelyn J Warr , Freda Shi , Sorelle A. Friedler , Blair D. Sullivan , Aaron Clauset

Quantized Indexing is a fast and space-efficient form of enumerative (combinatorial) coding, the strongest among asymptotically optimal universal entropy coding algorithms. The present advance in enumerative coding is similar to that made…

Information Theory · Computer Science 2016-11-18 Ratko V. Tomic

This paper introduces a novel lower bound on communication complexity using quantum relative entropy and mutual information, refining previous classical entropy-based results. By leveraging Uhlmann's lemma and quantum Pinsker inequalities,…

Quantum Physics · Physics 2025-07-29 Fengxia Liu , Zhiyong Zheng , Kun Tian , Yi Zhang , Heng Guo , Zhe Hu , Oleksiy Zhedanov , Zixian Gong

Encoding schemes and error-correcting codes are widely used in information technology to improve the reliability of data transmission over real-world communication channels. Quantum information protocols can further enhance the performance…

Compression algorithms reduce the redundancy in data representation to decrease the storage required for that data. Data compression offers an attractive approach to reducing communication costs by using available bandwidth effectively.…

Information Theory · Computer Science 2007-07-13 B. S. Shajee Mohan , V. K. Govindan

This paper investigates the performance of streaming codes in low-latency applications over a multi-link three-node relayed network. The source wishes to transmit a sequence of messages to the destination through a relay. Each message must…

Information Theory · Computer Science 2022-01-19 Gustavo Kasper Facenda , Elad Domanovitz , Ashish Khisti , Wai-Tian Tan , John Apostolopoulos

We introduce a framework - Artemis - to tackle the problem of learning in a distributed or federated setting with communication constraints and device partial participation. Several workers (randomly sampled) perform the optimization…

Machine Learning · Computer Science 2022-06-22 Constantin Philippenko , Aymeric Dieuleveut

Shared entanglement is a resource available to parties communicating over a quantum channel, much akin to public coins in classical communication protocols. Whereas shared randomness does not help in the transmission of information, or…

Quantum Physics · Physics 2018-03-22 Ashwin Nayak , Julia Salzman

We study the streaming complexity of the membership problem of 1-turn-Dyck2 and Dyck2 when there are a few errors in the input string. 1-turn-Dyck2 with errors: We prove that there exists a randomized one-pass algorithm that given x checks…

Computational Complexity · Computer Science 2012-06-04 Andreas Krebs , Nutan Limaye , Srikanth Srinivasan

We examine the problem of smoothed online optimization, where a decision maker must sequentially choose points in a normed vector space to minimize the sum of per-round, non-convex hitting costs and the costs of switching decisions between…

Machine Learning · Computer Science 2022-10-28 Daan Rutten , Nico Christianson , Debankur Mukherjee , Adam Wierman

We investigate the randomized and quantum communication complexities of the well-studied Equality function with small error probability $\epsilon$, getting optimal constant factors in the leading terms in a number of different models. In…

Quantum Physics · Physics 2023-10-19 Olivier Lalonde , Nikhil S. Mande , Ronald de Wolf

We establish new lower-bounds for the information complexity of mixed-integer convex optimization under two "bit-wise" oracles. The first oracle provides bits of first-order information in the standard coordinate model, and the second…

Optimization and Control · Mathematics 2025-11-05 Amitabh Basu , Phillip Kerger , Marco Molinaro

Unlike traditional file transfer where only total delay matters, streaming applications impose delay constraints on each packet and require them to be in order. To achieve fast in-order packet decoding, we have to compromise on the…

Information Theory · Computer Science 2015-11-26 Gauri Joshi , Yuval Kochman , Gregory Wornell

We characterize the communication complexity of the following distributed estimation problem. Alice and Bob observe infinitely many iid copies of $\rho$-correlated unit-variance (Gaussian or $\pm1$ binary) random variables, with unknown…

Information Theory · Computer Science 2019-04-19 Uri Hadar , Jingbo Liu , Yury Polyanskiy , Ofer Shayevitz

We study the streaming complexity of $k$-counter approximate counting. In the $k$-counter approximate counting problem, we are given an input string in $[k]^n$, and we are required to approximate the number of each $j$'s ($j\in[k]$) in the…

Data Structures and Algorithms · Computer Science 2024-06-19 Yichuan Wang

We show that fundamental learning tasks, such as finding an approximate linear separator or linear regression, require memory at least \emph{quadratic} in the dimension, in a natural streaming setting. This implies that such problems cannot…

Machine Learning · Computer Science 2019-06-13 Yuval Dagan , Gil Kur , Ohad Shamir

In this paper, we study streaming algorithms that minimize the number of changes made to their internal state (i.e., memory contents). While the design of streaming algorithms typically focuses on minimizing space and update time, these…

Data Structures and Algorithms · Computer Science 2024-06-12 Rajesh Jayaram , David P. Woodruff , Samson Zhou

We consider the problem of computing a $(1+\epsilon)$-approximation of the Hamming distance between a pattern of length $n$ and successive substrings of a stream. We first look at the one-way randomised communication complexity of this…

Data Structures and Algorithms · Computer Science 2016-02-24 Raphael Clifford , Tatiana Starikovskaya

We investigate distributed online convex optimization with compressed communication, where $n$ learners connected by a network collaboratively minimize a sequence of global loss functions using only local information and compressed data…

Machine Learning · Computer Science 2026-01-12 Sifan Yang , Wenhao Yang , Wei Jiang , Lijun Zhang