English
Related papers

Related papers: Efficient Online Random Sampling via Randomness Re…

200 papers

For any discrete probability distributions with bounded entropy, we can generate exactly a random variate using only a finite expected number of perfect coin flips. A perfect coin flip is the outcome of an unbiased Bernoulli random…

Information Theory · Computer Science 2020-11-12 Luc Devroye , Claude Gravel

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

Starting with a set of weighted items, we want to create a generic sample of a certain size that we can later use to estimate the total weight of arbitrary subsets. For this purpose, we propose priority sampling which tested on Internet…

Data Structures and Algorithms · Computer Science 2007-05-23 Nick Duffield , Carsten Lund , Mikkel Thorup

Performing random walks in networks is a fundamental primitive that has found numerous applications in communication networks such as token management, load balancing, network topology discovery and construction, search, and peer-to-peer…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-01-12 Atish Das Sarma , Anisur Rahaman Molla , Gopal Pandurangan

We focus on the problem of performing random walks efficiently in a distributed network. Given bandwidth constraints, the goal is to minimize the number of rounds required to obtain a random walk sample. We first present a fast sublinear…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-03-03 Atish Das Sarma , Danupon Nanongkai , Gopal Pandurangan , Prasad Tetali

Random number generation plays a vital role in cryptographic systems and computational applications, where uniformity, unpredictability, and robustness are essential. This paper presents the Entropy Mixing Network (EMN), a novel hybrid…

Cryptography and Security · Computer Science 2025-01-15 Mohamed Aly Bouke , Omar Imhemmed Alramli , Azizol Abdullah , Nur Izura Udzir , Normalia Samian , Mohamed Othman , Zurina Mohd Hanapi

Optimization algorithms appear in the core calculations of numerous Artificial Intelligence (AI) and Machine Learning methods, as well as Engineering and Business applications. Following recent works on the theoretical deficiencies of AI, a…

Optimization and Control · Mathematics 2024-10-29 Nikolaos P. Bakas , Vagelis Plevris , Andreas Langousis , Savvas A. Chatzichristofis

We show that a simple telescoping sum trick, together with the triangle inequality and a tensorisation property of expected-contractive coefficients of random channels, allow us to achieve general simultaneous decoupling for multiple users…

Quantum Physics · Physics 2024-11-15 Pau Colomer , Andreas Winter

We study a problem of fundamental importance to ICNs, namely, minimizing routing costs by jointly optimizing caching and routing decisions over an arbitrary network topology. We consider both source routing and hop-by-hop routing settings.…

Networking and Internet Architecture · Computer Science 2017-08-22 Stratis Ioannidis , Edmund Yeh

We consider the problem of minimizing a sum of $n$ functions over a convex parameter set $\mathcal{C} \subset \mathbb{R}^p$ where $n\gg p\gg 1$. In this regime, algorithms which utilize sub-sampling techniques are known to be effective. In…

Machine Learning · Statistics 2015-12-03 Murat A. Erdogdu , Andrea Montanari

We propose a groundbreaking random number generator that achieves truly uniform, independent, and identically distributed (IID) randomness by integrating Quantum Permutation Pads (QPP) with system jitter--derived entropy, herein called…

Cryptography and Security · Computer Science 2025-05-08 Randy Kuang , Dafu Lou

We present a technique for entropy optimization to calculate a distribution from its moments. The technique is based upon maximizing a discretized form of the Shannon entropy functional by mapping the problem onto a dual space where an…

Disordered Systems and Neural Networks · Physics 2009-11-10 K. Bandyopadhyay , A. K. Bhattacharya , Parthapratim Biswas , D. A. Drabold

This paper considers the entropy of the sum of (possibly dependent and non-identically distributed) Bernoulli random variables. Upper bounds on the error that follows from an approximation of this entropy by the entropy of a Poisson random…

Information Theory · Computer Science 2016-11-17 Igal Sason

The pseudo-random number generators (PRNGs), sampling algorithms, and algorithms for generating random integers in some common statistical packages and programming languages are unnecessarily inaccurate, by an amount that may matter for…

Computation · Statistics 2018-10-29 Philip B. Stark , Kellie Ottoboni

We consider message-efficient continuous random sampling from a distributed stream, where the probability of inclusion of an item in the sample is proportional to a weight associated with the item. The unweighted version, where all weights…

Data Structures and Algorithms · Computer Science 2019-04-09 Rajesh Jayaram , Gokarna Sharma , Srikanta Tirthapura , David P. Woodruff

We consider the problem of sampling $n$ numbers from the range $\{1,\ldots,N\}$ without replacement on modern architectures. The main result is a simple divide-and-conquer scheme that makes sequential algorithms more cache efficient and…

Data Structures and Algorithms · Computer Science 2019-11-18 Peter Sanders , Sebastian Lamm , Lorenz Hübschle-Schneider , Emanuel Schrade , Carsten Dachsbacher

Fast distributed algorithms that output a feasible solution for constraint satisfaction problems, such as maximal independent sets, have been heavily studied. There has been much less research on distributed sampling problems, where one…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-07 Sriram V. Pemmaraju , Joshua Z. Sobel

Consider the problem: we are given $n$ boxes, labeled $\{1,2,\ldots, n\}$ by an adversary, each containing a single number chosen from an unknown distribution; these $n$ distributions are not necessarily identical. We are also given an…

Data Structures and Algorithms · Computer Science 2024-05-13 Mohammad Taghi Hajiaghayi , Dariusz R. Kowalski , Piotr Krysta , Jan Olkowski

In quantum Shannon theory, various kinds of quantum entropies are used to characterize the capacities of noisy physical systems. Among them, min-entropy and its smooth version attract wide interest especially in the field of quantum…

Quantum Physics · Physics 2025-07-15 Rong Wang , H. F. Chau

This article introduces an algorithm to draw random discrete uniform variables within a given range of size n from a source of random bits. The algorithm aims to be simple to implement and optimal both with regards to the amount of random…

Data Structures and Algorithms · Computer Science 2013-04-09 Jérémie Lumbroso