English
Related papers

Related papers: Generative Modelling via Quantile Regression

200 papers

We propose new parametric frameworks of regression analysis with the conditional mode of a bounded response as the focal point of interest. Covariate effects estimation and prediction based on the maximum likelihood method under two new…

Methodology · Statistics 2020-06-22 Haiming Zhou , Xianzheng Huang

Quantile regression is a field with steadily growing importance in statistical modeling. It is a complementary method to linear regression, since computing a range of conditional quantile functions provides a more accurate modelling of the…

Methodology · Statistics 2022-05-09 Marija Tepegjozova , Jing Zhou , Gerda Claeskens , Claudia Czado

Generative models have enjoyed widespread success in a variety of applications. However, they encounter inherent mathematical limitations in modeling distributions where samples are constrained by equalities, as is frequently the setting in…

Machine Learning · Computer Science 2026-02-02 Katherine Keegan , Lars Ruthotto

In the regression problem, L1 and L2 are the most commonly used loss functions, which produce mean predictions with different biases. However, the predictions are neither robust nor adequate enough since they only capture a few conditional…

Machine Learning · Computer Science 2019-11-14 Faen Zhang , Xinyu Fan , Hui Xu , Pengcheng Zhou , Yujian He , Junlong Liu

We explore a data-driven approach for learning to optimize neural networks. We construct a dataset of neural network checkpoints and train a generative model on the parameters. In particular, our model is a conditional diffusion transformer…

Machine Learning · Computer Science 2022-09-27 William Peebles , Ilija Radosavovic , Tim Brooks , Alexei A. Efros , Jitendra Malik

We propose a method for inference in generalised linear mixed models (GLMMs) and several extensions of these models. First, we extend the GLMM by allowing the distribution of the random components to be non-Gaussian, that is, assuming an…

Methodology · Statistics 2021-07-27 Jeanett S. Pelck , Rodrigo Labouriau

Expectile regression is a nice tool for investigating conditional distributions beyond the conditional mean. It is well-known that expectiles can be described with the help of the asymmetric least square loss function, and this link makes…

Computation · Statistics 2015-07-15 Muhammad Farooq , Ingo Steinwart

Adversarial Regression is a proposition to perform high dimensional non-linear regression with uncertainty estimation. We used Conditional Generative Adversarial Network to obtain an estimate of the full predictive distribution for a new…

Machine Learning · Statistics 2019-10-22 Yoann Boget

Learning controllable and generalizable representation of multivariate data with desired structural properties remains a fundamental problem in machine learning. In this paper, we present a novel framework for learning generative models…

Machine Learning · Computer Science 2020-10-05 Ruixiang Zhang , Masanori Koyama , Katsuhiko Ishiguro

In practical applications, one often does not know the "true" structure of the underlying conditional quantile function, especially in the ultra-high dimensional setting. To deal with ultra-high dimensionality, quantile-adaptive marginal…

Methodology · Statistics 2024-04-26 Daoji Li , Yinfei Kong , Dawit Zerom

In this paper, we consider estimation of the conditional mode of an outcome variable given regressors. To this end, we propose and analyze a computationally scalable estimator derived from a linear quantile regression model and develop…

Statistics Theory · Mathematics 2019-07-30 Hirofumi Ota , Kengo Kato , Satoshi Hara

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Quantile crossing is a common phenomenon in shape constrained nonparametric quantile regression. A recent study by Wang et al. (2014) has proposed to address this problem by imposing non-crossing constraints to convex quantile regression.…

Methodology · Statistics 2025-10-09 Sheng Dai , Timo Kuosmanen , Xun Zhou

Generative adversarial networks constitute a powerful approach to generative modeling. While generated samples often are indistinguishable from real data, there is no guarantee that they will follow the true data distribution. For…

Machine Learning · Statistics 2024-09-09 Philipp Pilar , Niklas Wahlström

It is known that recursive training from generative models can lead to the so called `collapse' of the simulated probability distribution. This note shows that one in fact gets two different asymptotic behaviours depending on whether an…

Probability · Mathematics 2025-09-30 Vivek Shripad Borkar

Generative modeling, which learns joint probability distribution from data and generates samples according to it, is an important task in machine learning and artificial intelligence. Inspired by probabilistic interpretation of quantum…

Statistical Mechanics · Physics 2018-07-20 Zhao-Yu Han , Jun Wang , Heng Fan , Lei Wang , Pan Zhang

Generative Bayesian Computation (GBC) methods are developed for Casual Inference. Generative methods are simulation-based methods that use a large training dataset to represent posterior distributions as a map (a.k.a. optimal transport) to…

Methodology · Statistics 2024-12-25 Maria Nareklishvili , Nicholas Polson , Vadim Sokolov

Conformal prediction is a theoretically grounded framework for constructing predictive intervals. We study conformal prediction with missing values in the covariates -- a setting that brings new challenges to uncertainty quantification. We…

Machine Learning · Statistics 2023-06-06 Margaux Zaffran , Aymeric Dieuleveut , Julie Josse , Yaniv Romano

Quantile regression, based on check loss, is a widely used inferential paradigm in Econometrics and Statistics. The conditional quantiles provide a robust alternative to classical conditional means, and also allow uncertainty quantification…

Machine Learning · Computer Science 2021-02-15 Anuj Tambwekar , Anirudh Maiya , Soma Dhavala , Snehanshu Saha

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare