English
Related papers

Related papers: Near optimal quantum algorithm for estimating Shan…

200 papers

In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

In this short note a method for computing the naive plugin estimator of discrete entropy from a counting Bloom filter will be presented. The method does work reasonably as long as the collision probability in the bloom filter is kept low.

Information Theory · Computer Science 2018-02-20 Michael Cochez

The classical problem of maximizing the Shannon entropy of a sum of independent random variables supported on a finite alphabet is considered and settled in the ternary case. Namely, the following theorem is established: if…

Information Theory · Computer Science 2026-05-13 Mladen Kovačević

The Quantum Approximate Optimization Algorithm (QAOA) is a general-purpose algorithm for combinatorial optimization problems whose performance can only improve with the number of layers $p$. While QAOA holds promise as an algorithm that can…

Quantum Physics · Physics 2022-07-08 Edward Farhi , Jeffrey Goldstone , Sam Gutmann , Leo Zhou

This paper considers the quantum query complexity of {\it $\eps$-biased oracles} that return the correct value with probability only $1/2 + \eps$. In particular, we show a quantum algorithm to compute $N$-bit OR functions with…

Quantum Physics · Physics 2007-05-23 Tomoya Suzuki , Shigeru Yamashita , Masaki Nakanishi , Katsumasa Watanabe

We consider the problem of estimating the expected outcomes of Monte Carlo processes whose outputs are described by multidimensional random variables. We tightly characterize the quantum query complexity of this problem for various choices…

Quantum Physics · Physics 2021-07-09 Arjan Cornelissen , Sofiene Jerbi

Policy gradient algorithms have been widely applied to Markov decision processes and reinforcement learning problems in recent years. Regularization with various entropy functions is often used to encourage exploration and improve…

Machine Learning · Computer Science 2023-06-09 Haoya Li , Samarth Gupta , Hsiangfu Yu , Lexing Ying , Inderjit Dhillon

We investigate the properties of a Block Decomposition Method (BDM), which extends the power of a Coding Theorem Method (CTM) that approximates local estimations of algorithmic complexity based upon Solomonoff-Levin's theory of algorithmic…

Information Theory · Computer Science 2018-06-20 Hector Zenil , Santiago Hernández-Orozco , Narsis A. Kiani , Fernando Soler-Toscano , Antonio Rueda-Toicen

We present a very simple method for the calculation of Shannon, Fisher, Onicescu and Tsallis entropies in atoms, as well as SDL and LMC complexity measures, as functions of the atomic number Z. Fractional occupation probabilities of…

Quantum Physics · Physics 2015-05-13 C. P. Panos , N. S. Nikolaidis , K. Ch. Chatzisavvas , C. C. Tsouros

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem.…

Strongly Correlated Electrons · Physics 2016-08-18 Dominic Bergeron , A. -M. S. Tremblay

Quantum computing is powerful because unitary operators describing the time-evolution of a quantum system have exponential size in terms of the number of qubits present in the system. We develop a new "Singular value transformation"…

Quantum Physics · Physics 2020-02-21 András Gilyén , Yuan Su , Guang Hao Low , Nathan Wiebe

We design and analyze two new low depth algorithms for amplitude estimation (AE) achieving an optimal tradeoff between the quantum speedup and circuit depth. For $\beta \in (0,1]$, our algorithms require $N= \tilde{O}( \frac{1}{…

Quantum Physics · Physics 2022-06-29 Tudor Giurgica-Tiron , Iordanis Kerenidis , Farrokh Labib , Anupam Prakash , William Zeng

Shannon entropy is often a quantity of interest to linguists studying the communicative capacity of human language. However, entropy must typically be estimated from observed data because researchers do not have access to the underlying…

Computation and Language · Computer Science 2022-04-06 Aryaman Arora , Clara Meister , Ryan Cotterell

We prove tight lower bounds for the following variant of the counting problem considered by Aaronson, Kothari, Kretschmer, and Thaler (2020). The task is to distinguish whether an input set $x\subseteq [n]$ has size either $k$ or…

Quantum Physics · Physics 2024-05-08 Aleksandrs Belovs , Ansis Rosmanis

Compressed Counting (CC), based on maximally skewed stable random projections, was recently proposed for estimating the p-th frequency moments of data streams. The case p->1 is extremely useful for estimating Shannon entropy of data…

Data Structures and Algorithms · Computer Science 2009-10-09 Ping Li

Finding the minimal relative entropy of two quantum states under semidefinite constraints is a pivotal problem located at the mathematical core of various applications in quantum information theory. An efficient method for providing…

Quantum Physics · Physics 2026-02-02 Gereon Koßmann , René Schwonnek

We systematically investigate quantum algorithms and lower bounds for mean estimation given query access to non-identically distributed samples. On the one hand, we give quantum mean estimators with quadratic quantum speed-up given samples…

Quantum Physics · Physics 2024-05-22 Jiachen Hu , Tongyang Li , Xinzhao Wang , Yecheng Xue , Chenyi Zhang , Han Zhong

Maximization of an expensive, unimodal function under random observations has been an important problem in hyperparameter tuning. It features expensive function evaluations (which means small budgets) and a high level of noise. We develop…

Optimization and Control · Mathematics 2023-02-23 Xiaohe Luo , Warren B. Powell

The information content of a source is defined in terms of the minimum number of bits needed to store the output of the source in a perfectly recoverable way. A similar definition can be given in the case of quantum sources, with qubits…

Quantum Physics · Physics 2023-04-03 Paolo Perinotti , Alessandro Tosini , Leonardo Vaglini

The uncertainty relation based on the Shannon entropies of the probability densities in position and momentum spaces is improved for quantum systems in arbitrary $D$-dimensional spherically symmetric potentials. To find it, we have used the…

Mathematical Physics · Physics 2013-05-22 Łukasz Rudnicki , Pablo Sánchez-Moreno , Jesús S. Dehesa