English
Related papers

Related papers: Three-input Majority Function as the Unique Optima…

200 papers

Despite their high computation and communication costs, Newton-type methods remain an appealing option for distributed training due to their robustness against ill-conditioned convex problems. In this work, we study ommunication compression…

Machine Learning · Computer Science 2022-06-09 Rustem Islamov , Xun Qian , Slavomír Hanzely , Mher Safaryan , Peter Richtárik

We consider a class of submodular maximization problems in which decision-makers have limited access to the objective function. We explore scenarios where the decision-maker can observe only pairwise information, i.e., can evaluate the…

Data Structures and Algorithms · Computer Science 2022-02-09 Andrew Downie , Bahman Gharesifard , Stephen L. Smith

We consider the problem of the classical simulation of quantum measurements in the scenario of communication complexity. Regev and Toner (2007) have presented a 2-bit protocol which simulates one particular correlation function arising from…

Quantum Physics · Physics 2013-10-09 Adrian Kosowski , Marcin Markiewicz

We present a novel adaptive optimization algorithm for black-box multi-objective optimization problems with binary constraints on the foundation of Bayes optimization. Our method is based on probabilistic regression and classification…

Machine Learning · Statistics 2021-03-01 Raoul Heese , Michael Bortz

We propose constructive approaches for the optimization of binary classical communication over a general noisy qubit quantum channel, for both the error probability and the classical capacity functionals. After showing that the optimal…

Quantum Physics · Physics 2014-01-09 Nicola Dalla Pozza , Nicola Laurenti , Francesco Ticozzi

We provide tight upper and lower bounds on the noise resilience of interactive communication over noisy channels with feedback. In this setting, we show that the maximal fraction of noise that any robust protocol can resist is 1/3.…

Data Structures and Algorithms · Computer Science 2015-01-06 Klim Efremenko , Ran Gelles , Bernhard Haeupler

Distributed minimax estimation and distributed adaptive estimation under communication constraints for Gaussian sequence model and white noise model are studied. The minimax rate of convergence for distributed estimation over a given Besov…

Statistics Theory · Mathematics 2021-07-02 T. Tony Cai , Hongji Wei

In this work, we consider the distributed optimization of non-smooth convex functions using a network of computing units. We investigate this problem under two regularity assumptions: (1) the Lipschitz continuity of the global objective…

Optimization and Control · Mathematics 2018-06-04 Kevin Scaman , Francis Bach , Sébastien Bubeck , Yin Tat Lee , Laurent Massoulié

We consider centralized distributed optimization in the classical federated learning setup, where $n$ workers jointly find an $\varepsilon$-stationary point of an $L$-smooth, $d$-dimensional nonconvex function $f$, having access only to…

Optimization and Control · Mathematics 2026-03-31 Alexander Tyurin

Probabilistic shaping of quadrature amplitude modulation (QAM) is used to enhance the sensitivity of an optical communication system. Sensitivity gains of 0.43 dB and 0.8 dB are demonstrated in back-to-back experiments by shaping of 16QAM…

Information Theory · Computer Science 2016-01-19 Tobias Fehenberger , Domaniç Lavery , Robert Maher , Alex Alvarado , Polina Bayvel , Norbert Hanik

We present a fully probabilistic approach for solving binary optimization problems with black-box objective functions and with budget constraints. In the probabilistic approach, the optimization variable is viewed as a random variable and…

Optimization and Control · Mathematics 2024-06-11 Ahmed Attia

We study the decentralized consensus and stochastic optimization problems with compressed communications over static directed graphs. We propose an iterative gradient-based algorithm that compresses messages according to a desired…

Optimization and Control · Mathematics 2022-04-19 Mohammad Taha Toghani , César A. Uribe

We consider the task of interactive communication in the presence of adversarial errors and present tight bounds on the tolerable error-rates in a number of different settings. Most significantly, we explore adaptive interactive…

Data Structures and Algorithms · Computer Science 2022-08-09 Mohsen Ghaffari , Bernhard Haeupler , Madhu Sudan

We develop a framework for spectrum sensing in cooperative amplify-and-forward cognitive radio networks. We consider a stochastic model where relays are assigned in cognitive radio networks to transmit the primary user's signal to a…

Information Theory · Computer Science 2011-11-02 Ido Nevat , Gareth W. Peters , Jinhong Yuan , Iain Collings

A new backward compatible WiFi amendment is under development by the IEEE bd Task Group towards the so-called IEEE 802.11bd, which includes the possibility to transmit up to three repetitions of the same packet. This feature increases time…

Networking and Internet Architecture · Computer Science 2023-06-01 Wu Zhuofei , Stefania Bartoletti , Vincent Martinez , Alessandro Bazzi

We consider the randomized decision tree complexity of the recursive 3-majority function. We prove a lower bound of $(1/2-\delta) \cdot 2.57143^h$ for the two-sided-error randomized decision tree complexity of evaluating height $h$ formulae…

Data Structures and Algorithms · Computer Science 2013-10-01 Frederic Magniez , Ashwin Nayak , Miklos Santha , Jonah Sherman , Gabor Tardos , David Xiao

For enhancement of noisy speech, a method of threshold determination based on modeling of Teager energy (TE) operated perceptual wavelet packet (PWP) coefficients of the noisy speech by exponential distribution is presented. A custom…

Audio and Speech Processing · Electrical Eng. & Systems 2018-02-19 Md Tauhidul Islam , Celia Shahnaz , Wei-Ping Zhu , M. Omair Ahmad

We prove an optimal $\Omega(n)$ lower bound on the randomized communication complexity of the much-studied Gap-Hamming-Distance problem. As a consequence, we obtain essentially optimal multi-pass space lower bounds in the data stream model…

Computational Complexity · Computer Science 2012-07-02 Amit Chakrabarti , Oded Regev

We study the problem of reaching agreement in a synchronous distributed system by $n$ autonomous parties, when the communication links from/to faulty parties can omit messages. The faulty parties are selected and controlled by an adaptive,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-27 Mohammad T. Hajiaghayi , Dariusz R. Kowalski , Jan Olkowski

High-dimensional numerical optimization presents a persistent challenge in computational science. This paper introduces Quasi-Adaptive Search with Asymptotic Reinitialization (QUASAR), an evolutionary algorithm to accelerate convergence in…

Optimization and Control · Mathematics 2026-02-03 Julian G. Soltes