English
Related papers

Related papers: Efficient $\varepsilon$-approximate minimum-entrop…

200 papers

Given a large real symmetric, positive semidefinite m-by-m matrix, the goal of this paper is to show how a numerical approximation of the entropy, given by the sum of the entropies of the individual eigenvalues, can be computed in an…

Numerical Analysis · Mathematics 2014-06-13 Thomas P. Wihler , Bänz Bessire , André Stefanov

In a complete bipartite graph with vertex sets of cardinalities $n$ and $m$, assign random weights from exponential distribution with mean 1, independently to each edge. We show that, as $n\rightarrow\infty$, with $m = \lceil…

Probability · Mathematics 2014-05-07 Mustafa Khandwawala

A prominent problem in scheduling theory is the weighted flow time problem on one machine. We are given a machine and a set of jobs, each of them characterized by a processing time, a release time, and a weight. The goal is to find a…

Data Structures and Algorithms · Computer Science 2023-08-14 Alexander Armbruster , Lars Rohwedder , Andreas Wiese

A unit disk graph is the intersection graph of n congruent disks in the plane. Dominating sets in unit disk graphs are widely studied due to their application in wireless ad-hoc networks. Because the minimum dominating set problem for unit…

Data Structures and Algorithms · Computer Science 2014-02-07 Guilherme D. da Fonseca , Celina M. H. de Figueiredo , Vinícius G. P. de Sá , Raphael Machado

The MEG (minimum equivalent graph) problem is, given a directed graph, to find a small subset of the edges that maintains all reachability relations between nodes. The problem is NP-hard. This paper gives an approximation algorithm with…

Data Structures and Algorithms · Computer Science 2015-06-02 Samir Khuller , Balaji Raghavachari , Neal E. Young

Given a set of $n$ points in $\mathbb R^d$, the (monochromatic) Closest Pair problem asks to find a pair of distinct points in the set that are closest in the $\ell_p$-metric. Closest Pair is a fundamental problem in Computational Geometry…

Computational Geometry · Computer Science 2018-12-04 Karthik C. S. , Pasin Manurangsi

We give a deterministic, polynomial-time algorithm for approximately counting the number of {0,1}-solutions to any instance of the knapsack problem. On an instance of length n with total weight W and accuracy parameter eps, our algorithm…

Data Structures and Algorithms · Computer Science 2010-08-20 Parikshit Gopalan , Adam Klivans , Raghu Meka

Tsallis' non-extensive entropy is extended to incorporate the dependence on affinities between the microstates of a system. At the core of our construction of the extended entropy ($\mathcal{H}$) is the concept of the effective number of…

Quantitative Methods · Quantitative Biology 2022-02-08 Keisuke Okamura

We present a family of fast pseudo-approximation algorithms for the minimum balanced vertex separator problem in a graph. Given a graph $G=(V,E)$ with $n$ vertices and $m$ edges, and a (constant) balance parameter $c\in(0,1/2)$, where $G$…

Data Structures and Algorithms · Computer Science 2026-03-18 Vladimir Kolmogorov , Jack Spalding-Jamieson

Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be calculated…

Machine Learning · Statistics 2025-01-23 Takashi Furuya , Hiroyuki Kusumoto , Koichi Taniguchi , Naoya Kanno , Kazuma Suetake

The EM (Expectation-Maximization) algorithm is regarded as an MM (Majorization-Minimization) algorithm for maximum likelihood estimation of statistical models. Expanding this view, this paper demonstrates that by choosing an appropriate…

Optimization and Control · Mathematics 2026-02-12 Kensuke Asai , Jun-ya Gotoh

Let G = ((A,B),E) be an instance of the stable marriage problem where every vertex ranks its neighbors in a strict order of preference. A matching M in G is popular if M does not lose a head-to-head election against any matching. Popular…

Data Structures and Algorithms · Computer Science 2020-05-06 Yuri Faenza , Telikepalli Kavitha

A recent conjecture regarding the average of the minimum eigenvalue of the reduced density matrix of a random complex state is proved. In fact, the full distribution of the minimum eigenvalue is derived exactly for both the cases of a…

Statistical Mechanics · Physics 2009-11-13 Satya N. Majumdar , Oriol Bohigas , Arul Lakshminarayan

Maximization of an expensive, unimodal function under random observations has been an important problem in hyperparameter tuning. It features expensive function evaluations (which means small budgets) and a high level of noise. We develop…

Optimization and Control · Mathematics 2023-02-23 Xiaohe Luo , Warren B. Powell

We exploit the idea to use the maximal-entropy method, successfully tested in information theory and statistical thermodynamics, to determine approximating function's coefficients and squared errors' weights simultaneously as output of one…

Numerical Analysis · Mathematics 2021-03-04 Domenico Giordano , Felice Iavernaro

Recent work of Acharya et al. (NeurIPS 2019) showed how to estimate the entropy of a distribution $\mathcal D$ over an alphabet of size $k$ up to $\pm\epsilon$ additive error by streaming over $(k/\epsilon^3) \cdot…

Data Structures and Algorithms · Computer Science 2022-05-23 Maryam Aliakbarpour , Andrew McGregor , Jelani Nelson , Erik Waingarten

We present a near-optimal quantum algorithm, up to logarithmic factors, for estimating the Shannon entropy in the quantum probability oracle model. Our approach combines the singular value separation algorithm with quantum amplitude…

Quantum Physics · Physics 2026-02-03 Myeongjin Shin , Kabgyun Jeong

We examine the possibility of approximating Maximum Vertex-Disjoint Shortest Paths. In this problem, the input is an edge-weighted (directed or undirected) $n$-vertex graph $G$ along with $k$ terminal pairs…

Data Structures and Algorithms · Computer Science 2025-04-23 Matthias Bentert , Fedor V. Fomin , Petr A. Golovach

We survey recent results on combinatorial optimization problems in which the objective function is the entropy of a discrete distribution. These include the minimum entropy set cover, minimum entropy orientation, and minimum entropy…

Data Structures and Algorithms · Computer Science 2013-05-24 Jean Cardinal , Samuel Fiorini , Gwenaël Joret

Consider an undirected weighted graph $G = (V,E,w)$. We study the problem of computing $(1+\epsilon)$-approximate shortest paths for $S \times V$, for a subset $S \subseteq V$ of $|S| = n^r$ sources, for some $0 < r \le 1$. We devise a…

Data Structures and Algorithms · Computer Science 2021-02-15 Michael Elkin , Ofer Neiman