English
Related papers

Related papers: Maximally Consistent Sampling and the Jaccard Inde…

200 papers

In this paper we introduce a new sampling algorithm which has the potential to be adopted as a universal replacement to the Metropolis--Hastings algorithm. It is related to the slice sampler, and motivated by an algorithm which is…

Computation · Statistics 2020-10-19 Yanxin Li , Stephen G. Walker

Demand for high-performance, robust, and safe autonomous systems has grown substantially in recent years. These objectives motivate the desire for efficient safety-theoretic reasoning that can be embedded in core decision-making tasks such…

Robotics · Computer Science 2022-12-27 Kristoffer M. Frey , Ted J. Steiner , Jonathan P. How

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

Space partitions of $\mathbb{R}^d$ underlie a vast and important class of fast nearest neighbor search (NNS) algorithms. Inspired by recent theoretical work on NNS for general metric spaces [Andoni, Naor, Nikolov, Razenshteyn, Waingarten…

Machine Learning · Computer Science 2020-09-30 Yihe Dong , Piotr Indyk , Ilya Razenshteyn , Tal Wagner

Data similarity (or distance) computation is a fundamental research topic which fosters a variety of similarity-based machine learning and data mining applications. In big data analytics, it is impractical to compute the exact similarity of…

Data Structures and Algorithms · Computer Science 2025-03-12 Wei Wu , Bin Li

In this paper, we establish the theory of weak convergence (toward a normal distribution) for both single-chain and population stochastic approximation MCMC algorithms. Based on the theory, we give an explicit ratio of convergence rates for…

Statistics Theory · Mathematics 2013-10-29 Qifan Song , Mingqi Wu , Faming Liang

We introduce and study the computational problem of determining statistical similarity between probability distributions. For distributions $P$ and $Q$ over a finite sample space, their statistical similarity is defined as…

Data Structures and Algorithms · Computer Science 2025-06-03 Arnab Bhattacharyya , Sutanu Gayen , Kuldeep S. Meel , Dimitrios Myrisiotis , A. Pavan , N. V. Vinodchandran

Binary vector embeddings enable fast nearest neighbor retrieval in large databases of high-dimensional objects, and play an important role in many practical applications, such as image and video retrieval. We study the problem of learning…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Fatih Cakir , Kun He , Sarah Adel Bargal , Stan Sclaroff

For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least squares estimate in linear regression, where…

Computation · Statistics 2019-06-27 HaiYing Wang , Rong Zhu , Ping Ma

The construction of a well tuned probability distributions is illustrated in synthetic way, these probability distributions produce faithful realizations of the impact point distributions for particles in silicon strip detector. Their use…

Instrumentation and Detectors · Physics 2016-05-17 Gregorio Landi , Giovanni E. Landi

We introduce collapsed compilation, a novel approximate inference algorithm for discrete probabilistic graphical models. It is a collapsed sampling algorithm that incrementally selects which variable to sample next based on the partial…

Artificial Intelligence · Computer Science 2018-06-01 Tal Friedman , Guy Van den Broeck

A striking result of [Acharya et al. 2017] showed that to estimate symmetric properties of discrete distributions, plugging in the distribution that maximizes the likelihood of observed multiset of frequencies, also known as the profile…

Statistics Theory · Mathematics 2020-11-03 Yanjun Han , Kirankumar Shiragur

Molecular fingerprinting methods use hash functions to create fixed-length vector representations of molecules. However, hash collisions cause distinct substructures to be represented with the same feature, leading to overestimates in…

Machine Learning · Computer Science 2025-11-24 Walter Virany , Austin Tripp

We present a new algorithm which detects the maximal possible number of matched disjoint pairs satisfying a given caliper when a bipartite matching is done with respect to a scalar index (e.g., propensity score), and constructs a…

Computation · Statistics 2022-07-20 Pavel S. Ruzankin

This paper addresses the problem of estimating the containment and similarity between two sets using only random samples from each set, without relying on sketches of full sets. The study introduces a binomial model for predicting the…

Computation · Statistics 2025-07-22 Pranav Joshi

We give a general unified method that can be used for $L_1$ {\em closeness testing} of a wide range of univariate structured distribution families. More specifically, we design a sample optimal and computationally efficient algorithm for…

Data Structures and Algorithms · Computer Science 2015-08-25 Ilias Diakonikolas , Daniel M. Kane , Vladimir Nikishkin

Fairness has become a crucial aspect in the development of trustworthy machine learning algorithms. Current fairness metrics to measure the violation of demographic parity have the following drawbacks: (i) the average difference of model…

Machine Learning · Computer Science 2024-06-06 Jinqiu Jin , Haoxuan Li , Fuli Feng

All pairs similarity search is a problem where a set of data objects is given and the task is to find all pairs of objects that have similarity above a certain threshold for a given similarity measure-of-interest. When the number of points…

Information Retrieval · Computer Science 2016-06-29 Aniket Chakrabarti , Srinivasan Parthasarathy

We aim to create the highest possible quality of treatment-control matches for categorical data in the potential outcomes framework. Matching methods are heavily used in the social sciences due to their interpretability, but most matching…

Machine Learning · Statistics 2019-06-11 Yameng Liu , Aw Dieng , Sudeepa Roy , Cynthia Rudin , Alexander Volfovsky

Classification in the dissimilarity space has become a very active research area since it provides a possibility to learn from data given in the form of pairwise non-metric dissimilarities, which otherwise would be difficult to cope with.…