English
Related papers

Related papers: Gower's similarity coefficients with automatic wei…

200 papers

The "maximum similarity correlation" definition introduced in this study is motivated by the seminal work of Szekely et al on "distance covariance" (Ann. Statist. 2007, 35: 2769-2794; Ann. Appl. Stat. 2009, 3: 1236-1265). Instead of using…

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

Estimating causal effects from observational data is a central problem in many domains. A general approach is to balance covariates with weights such that the distribution of the data mimics randomization. We present generalized balancing…

Machine Learning · Statistics 2023-10-02 Yoshiaki Kitazawa

The problem of nearest neighbor condensing has enjoyed a long history of study, both in its theoretical and practical aspects. In this paper, we introduce the problem of weighted distance nearest neighbor condensing, where one assigns…

Machine Learning · Computer Science 2023-10-25 Lee-Ad Gottlieb , Timor Sharabi , Roi Weiss

Considering two random variables with different laws to which we only have access through finite size iid samples, we address how to reweight the first sample so that its empirical distribution converges towards the true law of the second…

Statistics Theory · Mathematics 2022-06-08 Julien Reygner , Adrien Touboul

Score function estimation is the cornerstone of both training and sampling from diffusion generative models. Despite this fact, the most commonly used estimators are either biased neural network approximations or high variance Monte Carlo…

In observational studies, propensity scores are commonly estimated by maxi- mum likelihood but may fail to balance high-dimensional pre-treatment covariates even after specification search. We introduce a general framework that unifies and…

Methodology · Statistics 2017-03-22 Qingyuan Zhao

Estimating some mathematical expectations from partially observed data and in particular missing outcomes is a central problem encountered in numerous fields such as transfer learning, counterfactual analysis or causal inference. Matching…

Statistics Theory · Mathematics 2025-05-01 Simon Viel , Lionel Truquet , Ikko Yamane

Expanding a lower-dimensional problem to a higher-dimensional space and then projecting back is often beneficial. This article rigorously investigates this perspective in the context of finite mixture models, namely how to improve inference…

Methodology · Statistics 2014-11-10 Andrea Mercatanti , Fan Li , Fabrizia Mealli

There is a rich literature on Bayesian methods for density estimation, which characterize the unknown density as a mixture of kernels. Such methods have advantages in terms of providing uncertainty quantification in estimation, while being…

Methodology · Statistics 2024-04-10 Shounak Chattopadhyay , Antik Chakraborty , David B. Dunson

The statistical matching problem is a data integration problem with structured missing data. The general form involves the analysis of multiple datasets that only have a strict subset of variables jointly observed across all datasets. The…

Methodology · Statistics 2019-04-01 Daniel Ahfock , Saumyadipta Pyne , Geoffrey J. McLachlan

Imputing missing values is an important preprocessing step in data analysis, but the literature offers little guidance on how to choose between different imputation models. This letter suggests adopting the imputation model that generates a…

Methodology · Statistics 2021-07-13 Moritz Marbach

In this article the issues are discussed with the Bayesian approach, least-square fits, and most-likely fits. Trying to counter these issues, a method, based on weighted confidence, is proposed for estimating probabilities and other…

Statistics Theory · Mathematics 2017-01-26 Fetze Pijlman

Missing values with mixed data types is a common problem in a large number of machine learning applications such as processing of surveys and in different medical applications. Recently, Gaussian copula models have been suggested as a means…

Machine Learning · Statistics 2021-07-02 Benjamin Christoffersen , Mark Clements , Keith Humphreys , Hedvig Kjellström

A weighted likelihood approach for robust fitting of a mixture of multivariate Gaussian components is developed in this work. Two approaches have been proposed that are driven by a suitable modification of the standard EM and CEM…

Methodology · Statistics 2018-11-19 Luca Greco , Claudio Agostinelli

Data cohesion, a recently introduced measure inspired by social interactions, uses distance comparisons to assess relative proximity. In this work, we provide a collection of results which can guide the development of cohesion-based methods…

Social and Information Networks · Computer Science 2023-08-08 Katherine E. Moore

The stochastic volatility model is a popular tool for modeling the volatility of assets. The model is a nonlinear and non-Gaussian state space model, and consequently is difficult to fit. Many approaches, both classical and Bayesian, have…

Methodology · Statistics 2019-07-22 Chen Gong , David S. Stoffer

Measuring the correlation (association) between two random variables is one of the important goals in statistical applications. In the literature, the covariance between two random variables is a widely used criterion in measuring the…

Methodology · Statistics 2018-10-30 Majid Asadi , Somayeh Zarezadeh

Fitting mixed models to complex survey data is a challenging problem. Most methods in the literature, including the most widely used one, require a close relationship between the model structure and the survey design. In this paper we…

Methodology · Statistics 2023-11-23 Thomas Lumley , Xudong Huang

Comparing the differences in outcomes (that is, in "dependent variables") between two subpopulations is often most informative when comparing outcomes only for individuals from the subpopulations who are similar according to "independent…

Methodology · Statistics 2021-12-20 Mark Tygert