English
Related papers

Related papers: A Sampling Technique of Proving Lower Bounds for N…

200 papers

The paper presents a technique for constructing noisy data structures called a walking tree. We apply it for a Red-Black tree (an implementation of a Self-Balanced Binary Search Tree) and a segment tree. We obtain the same complexity of the…

Quantum Physics · Physics 2023-05-16 Kamil Khadiev , Nikita Savelyev , Mansur Ziatdinov , Denis Melnikov

In his breakthrough paper, Raz showed that any parity learning algorithm requires either quadratic memory or an exponential number of samples [FOCS'16, JACM'19]. A line of work that followed extended this result to a large class of learning…

Machine Learning · Computer Science 2023-10-13 Xin Lyu , Avishay Tal , Hongxun Wu , Junzhao Yang

The question of what can be computed, and how efficiently, are at the core of computer science. Not surprisingly, in distributed systems and networking research, an equally fundamental question is what can be computed in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-01 Fabian Kuhn , Thomas Moscibroda , Roger Wattenhofer

In the recent years, branch-and-cut algorithms have been the target of data-driven approaches designed to enhance the decision making in different phases of the algorithm such as branching, or the choice of cutting planes (cuts). In…

Optimization and Control · Mathematics 2025-06-03 Sammy Khalife , Andrea Lodi

We report a simple extension of a model for noise reduction in signal processing, already introduced by Mourik et al., in the presence of binary coupling vectors, which turns to be more useful for practical and engineering implementations.…

Disordered Systems and Neural Networks · Physics 2007-05-23 Jun-ichi Inoue , Domenico M. Carlucci

Utilizing the hyperspace of noise-based logic, we show two string verification methods with low communication complexity. One of them is based on continuum noise-based logic. The other one utilizes noise-based logic with random telegraph…

Information Theory · Computer Science 2011-02-10 Laszlo B. Kish , Sunil Khatri , Tamas Horvath

Hyperparameter tuning is critical to the success of federated learning applications. Unfortunately, appropriately selecting hyperparameters is challenging in federated networks. Issues of scale, privacy, and heterogeneity introduce noise in…

Machine Learning · Computer Science 2023-05-16 Kevin Kuo , Pratiksha Thaker , Mikhail Khodak , John Nguyen , Daniel Jiang , Ameet Talwalkar , Virginia Smith

In this paper, we obtain a family of lower bounds for the sum capacity of Code Division Multiple Access (CDMA) channels assuming binary inputs and binary signature codes in the presence of additive noise with an arbitrary distribution. The…

Information Theory · Computer Science 2016-11-18 K. Alishahi , F. Marvasti , V. Aref , P. Pad

Models that adapt their predictions based on some given contexts, also known as in-context learning, have become ubiquitous in recent years. We propose to study the behavior of such models when data is contaminated by noise. Towards this…

Machine Learning · Computer Science 2024-11-05 Chen Shapira , Dan Rosenbaum

Noise is a part of data whether the data is from measurement, experiment or ... A few techniques are suggested for noise reduction to improve the data quality in recent years some of which are based on wavelet, orthogonalization and neural…

Computational Engineering, Finance, and Science · Computer Science 2023-08-02 Negin Bagherpour , Abbas Mohammadiyan

We consider the problem of sequential decision making on random fields corrupted by noise. In this scenario, the decision maker observes a noisy version of the data, yet judged with respect to the clean data. In particular, we first…

Information Theory · Computer Science 2007-07-13 Asaf Cohen , Tsachy Weissman , Neri Merhav

This paper introduces new empirical process tools for analyzing a broad class of statistical learning models under heavy-tailed noise and complex function classes. Our primary contribution is the derivation of two Dudley-type maximal…

Statistics Theory · Mathematics 2025-11-24 Yizhe Ding , Runze Li , Lingzhou Xue

Beeping models are models for networks of weak devices, such as sensor networks or biological networks. In these networks, nodes are allowed to communicate only via emitting beeps: unary pulses of energy. Listening nodes only the capability…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Peter Davies

Minimal models of a Boolean formula play a pivotal role in various reasoning tasks. While previous research has primarily focused on qualitative analysis over minimal models; our study concentrates on the quantitative aspect, specifically…

Logic in Computer Science · Computer Science 2024-07-17 Mohimenul Kabir , Kuldeep S Meel

In this paper, we consider large-scale ranking problems where one is given a set of (possibly non-redundant) pairwise comparisons and the underlying ranking explained by those comparisons is desired. We show that stochastic gradient descent…

Optimization and Control · Mathematics 2024-07-04 Benjamin Jarman , Lara Kassab , Deanna Needell , Alexander Sietsema

Theoreticians have studied distributed algorithms in the radio network model for close to three decades. A significant fraction of this work focuses on lower bounds for basic communication problems such as wake-up (symmetry breaking among…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-05-29 Calvin Newport

Superposition, the ability of neural networks to represent more features than neurons, is increasingly seen as key to the efficiency of large models. This paper investigates the theoretical foundations of computing in superposition,…

Computational Complexity · Computer Science 2026-02-27 Micah Adler , Nir Shavit

We introduce a ``Statistical Query Sampling'' model, in which the goal of an algorithm is to produce an element in a hidden set $Ssubseteqbit^n$ with reasonable probability. The algorithm gains information about $S$ through oracle calls…

Quantum Physics · Physics 2016-11-18 Avrim Blum , Ke Yang

We propose a new Bayesian Neural Net formulation that affords variational inference for which the evidence lower bound is analytically tractable subject to a tight approximation. We achieve this tractability by (i) decomposing ReLU…

Machine Learning · Statistics 2019-06-13 Manuel Haussmann , Fred A. Hamprecht , Melih Kandemir

Recent breakthrough results in compressive sensing (CS) have established that many high dimensional signals can be accurately recovered from a relatively small number of non-adaptive linear observations, provided that the signals possess a…

Information Theory · Computer Science 2013-10-17 Akshay Soni , Jarvis Haupt