English
Related papers

Related papers: Featurized Density Ratio Estimation

200 papers

The density ratio is an important metric for evaluating the relative likelihood of two probability distributions, with extensive applications in statistics and machine learning. However, existing estimation theories for density ratios often…

Machine Learning · Statistics 2025-04-03 Shuntuo Xu , Zhou Yu , Jian Huang

Synthetic data generation is a promising technique to facilitate the use of sensitive data while mitigating the risk of privacy breaches. However, for synthetic data to be useful in downstream analysis tasks, it needs to be of sufficient…

Machine Learning · Statistics 2024-08-26 Thom Benjamin Volker , Peter-Paul de Wolf , Erik-Jan van Kesteren

Estimating the ratio of two probability densities from a finite number of observations is a central machine learning problem. A common approach is to construct estimators using binary classifiers that distinguish observations from the two…

Machine Learning · Computer Science 2025-01-28 Werner Zellinger

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

Breast density estimation is one of the key tasks in recognizing individuals predisposed to breast cancer. It is often challenging because of low contrast and fluctuations in mammograms' fatty tissue background. Most of the time, the breast…

Image and Video Processing · Electrical Eng. & Systems 2022-10-11 Vikash Gupta , Mutlu Demirer , Robert W. Maxwell , Richard D. White , Barbaros Selnur Erdal

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

It can be difficult to tell whether a trained generative model has learned to generate novel examples or has simply memorized a specific set of outputs. In published work, it is common to attempt to address this visually, for example by…

Machine Learning · Computer Science 2017-05-29 Matt Feiszli

Real-world datasets are often biased with respect to key demographic factors such as race and gender. Due to the latent nature of the underlying factors, detecting and mitigating bias is especially challenging for unsupervised machine…

Machine Learning · Computer Science 2020-07-01 Kristy Choi , Aditya Grover , Trisha Singh , Rui Shu , Stefano Ermon

We present sparse tree-based and list-based density estimation methods for binary/categorical data. Our density estimation models are higher dimensional analogies to variable bin width histograms. In each leaf of the tree (or list), the…

Machine Learning · Statistics 2023-11-16 Siong Thye Goh , Lesia Semenova , Cynthia Rudin

Consider a scenario where we have access to train data with both covariates and outcomes while test data only contains covariates. In this scenario, our primary aim is to predict the missing outcomes of the test data. With this objective in…

Methodology · Statistics 2024-10-29 Masahiro Kato , Kota Matsui , Ryo Inokuchi

Effective non-parametric density estimation is a key challenge in high-dimensional multivariate data analysis. In this paper,we propose a novel approach that builds upon tensor factorization tools. Any multivariate density can be…

Machine Learning · Statistics 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Learning probabilistic models that can estimate the density of a given set of samples, and generate samples from that density, is one of the fundamental challenges in unsupervised machine learning. We introduce a new generative model based…

Machine Learning · Computer Science 2020-06-11 Siavash A. Bigdeli , Geng Lin , Tiziano Portenier , L. Andrea Dunbar , Matthias Zwicker

Density ratio estimation (DRE) is a fundamental machine learning technique for comparing two probability distributions. However, existing methods struggle in high-dimensional settings, as it is difficult to accurately compare probability…

Machine Learning · Computer Science 2022-03-15 Kristy Choi , Chenlin Meng , Yang Song , Stefano Ermon

The ratio of two probability densities, called a density-ratio, is a vital quantity in machine learning. In particular, a relative density-ratio, which is a bounded extension of the density-ratio, has received much attention due to its…

Machine Learning · Statistics 2021-07-05 Atsutoshi Kumagai , Tomoharu Iwata , Yasuhiro Fujiwara

Propensity score weighting is widely used to improve the representativeness and correct the selection bias in the voluntary sample. The propensity score is often developed using a model for the sampling probability, which can be subject to…

Methodology · Statistics 2022-07-20 Hengfang Wang , Jae Kwang Kim

I consider two problems in machine learning and statistics: the problem of estimating the joint probability density of a collection of random variables, known as density estimation, and the problem of inferring model parameters when their…

Machine Learning · Statistics 2019-10-30 George Papamakarios

Binary density ratio estimation (DRE), the problem of estimating the ratio $p_1/p_2$ given their empirical samples, provides the foundation for many state-of-the-art machine learning algorithms such as contrastive representation learning…

Machine Learning · Computer Science 2021-12-08 Lantao Yu , Yujia Jin , Stefano Ermon

We present a method for feature interpretation that makes use of recent advances in autoregressive density estimation models to invert model representations. We train generative inversion models to express a distribution over input features…

Machine Learning · Statistics 2019-01-03 Charlie Nash , Nate Kushman , Christopher K. I. Williams

We explain how effective automatic probability density function estimates can be constructed using contemporary Bayesian inference engines such as those based on no-U-turn sampling and expectation propagation. Extensive simulation studies…

Machine Learning · Statistics 2021-09-28 M. P. Wand , J. C. F. Yu

While the manifold hypothesis is widely adopted in modern machine learning, complex data is often better modeled as stratified spaces -- unions of manifolds (strata) of varying dimensions. Stratified learning is challenging due to varying…

Machine Learning · Statistics 2026-04-14 Randy Martinez , Rong Tang , Lizhen Lin