English
Related papers

Related papers: A likelihood approach to nonparametric estimation …

200 papers

Extracting meaningful information from high-dimensional data poses a formidable modeling challenge, particularly when the data is obscured by noise or represented through different modalities. This research proposes a novel non-parametric…

Machine Learning · Computer Science 2024-08-27 Navid Ziaei , Behzad Nazari , Uri T. Eden , Alik Widge , Ali Yousefi

We introduce a generative learning framework to model high-dimensional parametric systems using gradient guidance and virtual observations. We consider systems described by Partial Differential Equations (PDEs) discretized with structured…

Machine Learning · Computer Science 2024-08-02 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

Recent advances in engineering technologies have enabled the collection of a large number of longitudinal features. This wealth of information presents unique opportunities for researchers to investigate the complex nature of diseases and…

Methodology · Statistics 2023-11-27 Zihang Lu , Noirrit Kiran Chandra

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

Machine Learning · Computer Science 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki

We consider a discrete latent variable model for two-way data arrays, which allows one to simultaneously produce clusters along one of the data dimensions (e.g. exchangeable observational units or features) and contiguous groups, or…

The shape of an object is an important characteristic for many vision problems such as segmentation, detection and tracking. Being independent of appearance, it is possible to generalize to a large range of objects from only small amounts…

Machine Learning · Statistics 2018-12-14 Alessandro Di Martino , Erik Bodin , Carl Henrik Ek , Neill D. F. Campbell

Clustering aims to divide a set of points into groups. The current paradigm assumes that the grouping is well-defined (unique) given the probability model from which the data is drawn. Yet, recent experiments have uncovered several…

Machine Learning · Statistics 2024-06-25 Mireille Boutin , Evzenie Coupkova

The ratio between two probability density functions is an important component of various tasks, including selection bias correction, novelty detection and classification. Recently, several estimators of this ratio have been proposed. Most…

Methodology · Statistics 2014-04-30 Rafael Izbicki , Ann B. Lee , Chad M. Schafer

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

Machine Learning · Computer Science 2021-04-13 Lars Ruthotto , Eldad Haber

Given data, deep generative models, such as variational autoencoders (VAE) and generative adversarial networks (GAN), train a lower dimensional latent representation of the data space. The linear Euclidean geometry of data space pulls back…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Line Kuhnel , Tom Fletcher , Sarang Joshi , Stefan Sommer

In this paper, we introduce a convenient framework for studying (adversarial) generative models from a statistical perspective. It consists in modeling the generative device as a smooth transformation of the unit hypercube of a dimension…

Statistics Theory · Mathematics 2020-10-20 Nicolas Schreuder , Victor-Emmanuel Brunel , Arnak Dalalyan

Likelihood-based deep generative models (DGMs) have gained significant attention for their ability to approximate the distributions of high-dimensional data. However, these models lack a performance guarantee in assigning higher likelihood…

Machine Learning · Computer Science 2025-02-04 Behrooz Montazeran , Ullrich Köthe

We investigate a data-driven approach to constructing uncertainty sets for robust optimization problems, where the uncertain problem parameters are modeled as random variables whose joint probability distribution is not known. Relying only…

Optimization and Control · Mathematics 2020-09-22 Polina Alexeenko , Eilyan Bitar

In this paper, different strands of literature are combined in order to obtain algorithms for semi-parametric estimation of discrete choice models that include the modelling of unobserved heterogeneity by using mixing distributions for the…

Methodology · Statistics 2022-12-12 Dietmar Bauer , Sebastian Büscher , Manuel Batram

Recent work has shown that deep generative models can assign higher likelihood to out-of-distribution data sets than to their training data (Nalisnick et al., 2019; Choi et al., 2019). We posit that this phenomenon is caused by a mismatch…

Machine Learning · Statistics 2019-10-17 Eric Nalisnick , Akihiro Matsukawa , Yee Whye Teh , Balaji Lakshminarayanan

We introduce an approach to bias deep generative models, such as GANs and diffusion models, towards generating data with either enhanced fidelity or increased diversity. Our approach involves manipulating the distribution of training and…

Machine Learning · Computer Science 2024-10-07 Shuangqi Li , Chen Liu , Tong Zhang , Hieu Le , Sabine Süsstrunk , Mathieu Salzmann

This paper tackles the issue of real-time parametric estimation of a wide class of probability density functions from limited datasets. This type of estimation addresses recent applications that require joint sensing and actuation. The…

Information Theory · Computer Science 2022-03-21 Ahmad A. Masoud

Descriptive statistics for parametric models are currently highly sensative to departures, gross errors, and/or random errors. Here, leveraging the structures of parametric distributions and their central moment kernel distributions, a…

Statistics Theory · Mathematics 2024-09-11 Li Tuobang

Most work on supervised learning research has focused on marginal predictions. In decision problems, joint predictive distributions are essential for good performance. Previous work has developed methods for assessing low-order predictive…

Machine Learning · Statistics 2022-03-01 Ian Osband , Zheng Wen , Seyed Mohammad Asghari , Vikranth Dwaracherla , Xiuyuan Lu , Benjamin Van Roy