English
Related papers

Related papers: Jaccard/Tanimoto similarity test and estimation me…

200 papers

The Jaccard similarity index is an important measure of the overlap of two sets, widely used in machine learning, computational genomics, information retrieval, and many other areas. We design and implement SimilarityAtScale, the first…

Computational Engineering, Finance, and Science · Computer Science 2020-11-12 Maciej Besta , Raghavendra Kanakagiri , Harun Mustafa , Mikhail Karasikov , Gunnar Rätsch , Torsten Hoefler , Edgar Solomonik

Nonignorable missing data, where the probability of missingness depends on unobserved values, presents a significant challenge in statistical analysis. Traditional methods often rely on strong parametric assumptions that are difficult to…

Methodology · Statistics 2025-09-19 Yujie Zhao

Health economic evaluations based on patient-level data collected alongside clinical trials~(e.g. health related quality of life and resource use measures) are an important component of the process which informs resource allocation…

Applications · Statistics 2020-05-25 Andrea Gabrio , Rachael Hunter , Alexina J. Mason , Gianluca Baio

Binned scatter plots are a powerful statistical tool for empirical work in the social, behavioral, and biomedical sciences. Available methods rely on a quantile-based partitioning estimator of the conditional mean regression function to…

Methodology · Statistics 2024-07-23 Matias D. Cattaneo , Richard K. Crump , Max H. Farrell , Yingjie Feng

This paper presents a new method for conditional probability density simulation. The method is design to work with unstructured data set when data are not characterized by the same covariates yet share common information. Specific examples…

Methodology · Statistics 2025-08-05 Esteban G. Tabak , Giulio Trigila , Wenjun Zhao

Methods for quantifying the similarity of datasets are relevant in applications where two or more datasets, or their underlying distributions, need to be compared, ranging from two- and k-sample testing to applications in machine learning…

Methodology · Statistics 2026-04-15 Marieke Stolte , Jörg Rahnenführer , Andrea Bommert

Using a sample from a population to estimate the proportion of the population with a certain category label is a broadly important problem. In the context of microbiome studies, this problem arises when researchers wish to use a sample from…

Methodology · Statistics 2019-02-08 Bryan D. Martin , Daniela Witten , Amy D. Willis

The pseudo-observations approach has been gaining popularity as a method to estimate covariate effects on censored survival data. It is used regularly to estimate covariate effects on quantities such as survival probabilities, restricted…

Methodology · Statistics 2024-12-06 Yael Travis-Lumer , Micha Mandel , Rebecca A. Betensky

Most practical data science problems encounter missing data. A wide variety of solutions exist, each with strengths and weaknesses that depend upon the missingness-generating process. Here we develop a theoretical framework for training and…

Machine Learning · Computer Science 2022-11-15 Jahan C. Penny-Dimri , Christoph Bergmeir , Julian Smith

Heterogeneity is a dominant factor in the behaviour of many biological processes. Despite this, it is common for mathematical and statistical analyses to ignore biological heterogeneity as a source of variability in experimental data.…

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that…

Machine Learning · Statistics 2024-12-12 Mitsuhiro Fujikawa , Yohei Akimoto , Jun Sakuma , Kazuto Fukuchi

Garcia-Donato et al. (2025) present a methodology for handling missing data in a model selection problem using an objective Bayesian approach. The current comment discusses an alternative, existing objective Bayesian method for this…

Methodology · Statistics 2025-12-25 Joris Mulder

The goal of this paper is to describe the application of quasi-likelihood estimating equations for spatially correlated binary data. In this paper, a logistic function is used to model the marginal probability of binary responses in terms…

Statistics Theory · Mathematics 2007-06-13 Pei-Sheng Lin , Murray K. Clayton

The Tanimoto coefficient is commonly used to measure the similarity between molecules represented as discrete fingerprints, either as a distance metric or a positive definite kernel. While many kernel methods can be accelerated using random…

Machine Learning · Computer Science 2023-11-15 Austin Tripp , Sergio Bacallado , Sukriti Singh , José Miguel Hernández-Lobato

We study a missing-value imputation method, termed kNNSampler, that imputes a given unit's missing response by randomly sampling from the observed responses of the $k$ most similar units to the given unit in terms of the observed…

Machine Learning · Statistics 2025-12-03 Parastoo Pashmchi , Jérôme Benoit , Motonobu Kanagawa

When there is a suspicious figure reuse case in science, research integrity investigators often find it difficult to rebut authors claiming that "it happened by chance". In other words, when there is a "collision" of image features, it is…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Daniel E. Acuna , Ziyue Xiang

Specimens are collected from $N$ different sources. Each specimen has probability $p$ of being contaminated, independently of the other specimens. We assume group testing is applicable, namely one can take small portions from several…

Probability · Mathematics 2024-09-24 Vassilis G. Papanicolaou

To alleviate the data requirement for training effective binary classifiers in binary classification, many weakly supervised learning settings have been proposed. Among them, some consider using pairwise but not pointwise labels, when…

Machine Learning · Computer Science 2022-01-14 Lei Feng , Senlin Shu , Nan Lu , Bo Han , Miao Xu , Gang Niu , Bo An , Masashi Sugiyama

This work considers the problem of binary classification: given training data $x_1, \dots, x_n$ from a certain population, together with associated labels $y_1,\dots, y_n \in \left\{0,1 \right\}$, determine the best label for an element $x$…

Statistics Theory · Mathematics 2016-07-04 Nicolas Garcia Trillos , Ryan Murray

The debate about which similarity measure one should use for the normalization in the case of Author Co-citation Analysis (ACA) is further complicated when one distinguishes between the symmetrical co-citation--or, more generally,…

Physics and Society · Physics 2009-11-10 Loet Leydesdorff