English
Related papers

Related papers: Efficient estimation of the cardinality of large d…

200 papers

Many randomized approximation algorithms operate by giving a procedure for simulating a random variable $X$ which has mean $\mu$ equal to the target answer, and a relative standard deviation bounded above by a known constant $c$. Examples…

Computation · Statistics 2019-08-16 Mark Huber

Motivation: With the growth of big data, variable selection has become one of the major challenges in statistics. Although many methods have been proposed in the literature their performance in terms of recall and precision are limited in a…

Gaussian Processes and the Kullback-Leibler divergence have been deeply studied in Statistics and Machine Learning. This paper marries these two concepts and introduce the local Kullback-Leibler divergence to learn about intervals where two…

Methodology · Statistics 2023-07-13 Nicolás Hernández , Gabriel Martos

We present novel bounds for estimating discrete probability distributions under the $\ell_\infty$ norm. These are nearly optimal in various precise senses, including a kind of instance-optimality. Our data-dependent convergence guarantees…

Statistics Theory · Mathematics 2024-02-14 Aryeh Kontorovich , Amichai Painsky

The design of modern recommender systems relies on understanding which parts of the feature space are relevant for solving a given recommendation task. However, real-world data sets in this domain are often characterized by their large…

Information Retrieval · Computer Science 2023-09-06 Blaž Škrlj , Blaž Mramor

Let $G$ be a finite group generated by $k$ elements. The well-known product replacement algorithm provides an effective method for sampling generating sets of $G$. We study a refinement of this algorithm that is designed to output…

Group Theory · Mathematics 2025-12-23 Michał Marcinkowski , Piotr Mizerka

We derive new results for the performance of a simple greedy algorithm for finding large independent sets and matchings in constant degree regular graphs. We show that for $r$-regular graphs with $n$ nodes and girth at least $g$, the…

Discrete Mathematics · Computer Science 2008-07-09 David Gamarnik , David Goldberg

In the era of big data, learning from categorical features with very large vocabularies (e.g., 28 million for the Criteo click prediction dataset) has become a practical challenge for machine learning researchers and practitioners. We…

Machine Learning · Computer Science 2019-05-01 MohammadHossein Bateni , Lin Chen , Hossein Esfandiari , Thomas Fu , Vahab S. Mirrokni , Afshin Rostamizadeh

Score-based methods have demonstrated their effectiveness in discovering causal relationships by scoring different causal structures based on their goodness of fit to the data. Recently, Huang et al. proposed a generalized score function…

Machine Learning · Computer Science 2024-07-16 Wenjie Wang , Biwei Huang , Feng Liu , Xinge You , Tongliang Liu , Kun Zhang , Mingming Gong

This article introduces a framework for evaluating statistical decisions under both prior ambiguity and likelihood misspecification. We begin with an ambiguity set - a frequentist model that pairs a possibly misspecified likelihood with…

Econometrics · Economics 2026-05-14 Karun Adusumilli

Concrete/abstract words are used in a growing number of psychological and neurophysiological research. For a few languages, large dictionaries have been created manually. This is a very time-consuming and costly process. To generate large…

Computation and Language · Computer Science 2022-06-14 Vladimir Ivanov , Valery Solovyev

In the setting where we have $n$ independent observations of a random variable $X$, we derive explicit error bounds in total variation distance when approximating the number of observations equal to the maximum of the sample (in the case…

Probability · Mathematics 2026-04-10 Fraser Daly

We consider the problem of constructing a least conservative estimator of the expected value $\mu$ of a non-negative heavy-tailed random variable. We require that the probability of overestimating the expected value $\mu$ is kept…

Optimization and Control · Mathematics 2026-04-21 Bart P. G. van Parys , Bert Zwart

Several algorithms have been proposed to compute partitions of networks into communities that score high on a graph clustering index called modularity. While publications on these algorithms typically contain experimental evaluations to…

Data Analysis, Statistics and Probability · Physics 2007-05-23 U. Brandes , D. Delling , M. Gaertler , R. Goerke , M. Hoefer , Z. Nikoloski , D. Wagner

A large set of signals can sometimes be described sparsely using a dictionary, that is, every element can be represented as a linear combination of few elements from the dictionary. Algorithms for various signal processing applications,…

Machine Learning · Statistics 2013-02-06 Daniel Vainsencher , Shie Mannor , Alfred M. Bruckstein

Algorithms can be used to prove and to discover new theorems. This paper shows how algorithmic skills in general, and the notion of invariance in particular, can be used to derive many results from Euclid's algorithm. We illustrate how to…

Data Structures and Algorithms · Computer Science 2023-08-21 Roland Backhouse , João F. Ferreira

A high-ranking goal of interdisciplinary modeling approaches in the natural sciences are quantitative prediction of system dynamics and model based optimization. For this purpose, mathematical modeling, numerical simulation and scientific…

Optimization and Control · Mathematics 2015-03-17 Dominik Skanda , Dirk Lebiedz

The aim of this thesis is to determine classes of NP relations for which random generation and approximate counting problems admit an efficient solution. Since efficient rank implies efficient random generation, we first investigate some…

Computational Complexity · Computer Science 2010-12-15 Massimo Santini

We present a new algorithm for spectral clustering based on a column-pivoted QR factorization that may be directly used for cluster assignment or to provide an initial guess for k-means. Our algorithm is simple to implement, direct, and…

Numerical Analysis · Mathematics 2017-04-18 Anil Damle , Victor Minden , Lexing Ying

We build a new class of generative algorithms capable of efficiently learning an arbitrary target distribution from possibly scarce, high-dimensional data and subsequently generate new samples. These generative algorithms are particle-based…

Machine Learning · Statistics 2024-08-29 Hyemin Gu , Panagiota Birmpa , Yannis Pantazis , Luc Rey-Bellet , Markos A. Katsoulakis