English
Related papers

Related papers: Proper losses for discrete generative models

200 papers

In the context of some machine learning applications, obtaining data instances is a relatively easy process but labeling them could become quite expensive or tedious. Such scenarios lead to datasets with few labeled instances and a larger…

Machine Learning · Computer Science 2020-07-21 Isel Grau , Dipankar Sengupta , Maria M. Garcia Lorenzo , Ann Nowe

Deep models have shown their vulnerability when processing adversarial samples. As for the black-box attack, without access to the architecture and weights of the attacked model, training a substitute model for adversarial attacks has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Wenxuan Wang , Bangjie Yin , Taiping Yao , Li Zhang , Yanwei Fu , Shouhong Ding , Jilin Li , Feiyue Huang , Xiangyang Xue

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

Optimization and Control · Mathematics 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

We propose to use a model-based generative loss for training hand pose estimators on depth images based on a volumetric hand model. This additional loss allows training of a hand pose estimator that accurately infers the entire set of 21…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jiayi Wang , Franziska Mueller , Florian Bernard , Christian Theobalt

While generative models have become increasingly prevalent across various domains, fundamental concerns regarding their reliability persist. A crucial yet understudied aspect of these models is the uncertainty quantification surrounding…

Machine Learning · Computer Science 2025-11-17 Giorgio Morales , Frederic Jurie , Jalal Fadili

In high-dimensional classification settings, we wish to seek a balance between high power and ensuring control over a desired loss function. In many settings, the points most likely to be misclassified are those who lie near the decision…

Machine Learning · Statistics 2017-06-06 Arun Srinivasan

Many applications, including natural language processing, sensor networks, collaborative filtering, and federated learning, call for estimating discrete distributions from data collected in batches, some of which may be untrustworthy,…

Machine Learning · Computer Science 2020-02-26 Ayush Jain , Alon Orlitsky

In this paper, we introduce a convenient framework for studying (adversarial) generative models from a statistical perspective. It consists in modeling the generative device as a smooth transformation of the unit hypercube of a dimension…

Statistics Theory · Mathematics 2020-10-20 Nicolas Schreuder , Victor-Emmanuel Brunel , Arnak Dalalyan

Simulation methods have always been instrumental in finance, and data-driven methods with minimal model specification, commonly referred to as generative models, have attracted increasing attention, especially after the success of deep…

Portfolio Management · Quantitative Finance 2025-04-24 Adil Rengim Cetingoz , Charles-Albert Lehalle

Economists often estimate models using data from a particular domain, e.g. estimating risk preferences in a particular subject pool or for a specific class of lotteries. Whether a model's predictions extrapolate well across domains depends…

Theoretical Economics · Economics 2025-03-05 Isaiah Andrews , Drew Fudenberg , Lihua Lei , Annie Liang , Chaofeng Wu

It is common practice to discretize continuous defect counts into defective and non-defective classes and use them as a target variable when building defect classifiers (discretized classifiers). However, this discretization of continuous…

Software Engineering · Computer Science 2022-02-15 Gopi Krishnan Rajbahadur , Shaowei Wang , Yasutaka Kamei , Ahmed E. Hassan

We develop new approaches in multi-class settings for constructing proper scoring rules and hinge-like losses and establishing corresponding regret bounds with respect to the zero-one or cost-weighted classification loss. Our construction…

Statistics Theory · Mathematics 2021-05-18 Zhiqiang Tan , Xinwei Zhang

Prediction of outstanding claims has been done via nonparametric models (chain ladder), semiparametric models (overdispersed poisson) or fully parametric models. In this paper, we propose models based on negative binomial distributions for…

Methodology · Statistics 2026-01-12 Luis E. Nieto-Barajas , Rodrigo S. Targino

Set prediction is about learning to predict a collection of unordered variables with unknown interrelations. Training such models with set losses imposes the structure of a metric space over sets. We focus on stochastic and underdefined…

Machine Learning · Computer Science 2021-02-23 David W. Zhang , Gertjan J. Burghouts , Cees G. M. Snoek

In compressed sensing, a small number of linear measurements can be used to reconstruct an unknown signal. Existing approaches leverage assumptions on the structure of these signals, such as sparsity or the availability of a generative…

Machine Learning · Statistics 2018-08-02 Manik Dhar , Aditya Grover , Stefano Ermon

When the prediction of a black-box machine learning model deviates from the true observation, what can be said about the reason behind that deviation? This is a fundamental and ubiquitous question that the end user in a business or…

Machine Learning · Computer Science 2024-08-20 Tsuyoshi Idé , Naoki Abe

Evaluation of generative models has been an underrepresented field despite the surge of generative architectures. Most recent models are evaluated upon rather obsolete metrics which suffer from robustness issues, while being unable to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Maria Lymperaiou , Giorgos Filandrianos , Konstantinos Thomas , Giorgos Stamou

This paper presents a methodology that enables projection-based model reduction for black-box high-fidelity models such as commercial CFD codes. The methodology specifically addresses the situation where the high-fidelity model may be a…

Analysis of PDEs · Mathematics 2017-10-18 S. Ashwin Renganathan , Yingjie Liu , Dimitri N. Mavris

The accuracy and understandability of bank failure prediction models are crucial. While interpretable models like logistic regression are favored for their explainability, complex models such as random forest, support vector machines, and…

Machine Learning · Computer Science 2026-04-15 Seyma Gunonu , Gizem Altun , Mustafa Cavus

In the study of natural and artificial complex systems, responses that are not completely determined by the considered decision variables are commonly modelled probabilistically, resulting in response distributions varying across decision…

Methodology · Statistics 2021-10-07 Athénaïs Gautier , David Ginsbourger , Guillaume Pirot