English
Related papers

Related papers: Generative modeling of density regression through …

200 papers

Generative models inspired by dynamical transport of measure -- such as flows and diffusions -- construct a continuous-time map between two probability densities. Conventionally, one of these is the target density, only accessible through…

Machine Learning · Computer Science 2024-09-24 Michael S. Albergo , Mark Goldstein , Nicholas M. Boffi , Rajesh Ranganath , Eric Vanden-Eijnden

Conditional distribution is a fundamental quantity for describing the relationship between a response and a predictor. We propose a Wasserstein generative approach to learning a conditional distribution. The proposed approach uses a…

Machine Learning · Computer Science 2021-12-21 Shiao Liu , Xingyu Zhou , Yuling Jiao , Jian Huang

There are many approaches for training decision trees. This work introduces a novel gradient-based method for constructing decision trees that optimize arbitrary differentiable loss functions, overcoming the limitations of heuristic…

Machine Learning · Computer Science 2025-03-25 Andrei V. Konstantinov , Lev V. Utkin

We present an algorithm for learning decision trees using stochastic gradient information as the source of supervision. In contrast to previous approaches to gradient-based tree learning, our method operates in the incremental learning…

Machine Learning · Statistics 2019-09-25 Henry Gouk , Bernhard Pfahringer , Eibe Frank

Geophysical inverse problems are often ill-posed and admit multiple solutions. Conventional discriminative methods typically yield a single deterministic solution, which fails to model the posterior distribution, cannot generate diverse…

Generative modeling provides a powerful framework for learning data distributions. These models initially relied on probabilistic methods such as Gaussian Processes (GP) for uncertainty-aware predictions and shifted towards larger trainable…

Generative models reliant on sequential autoregression have been at the forefront of language generation for an extensive period, particularly following the introduction of widely acclaimed transformers. Despite its excellent performance,…

Computation and Language · Computer Science 2024-06-21 Yaguang Li , Xin Chen

Conformal prediction provides a distribution-free framework for uncertainty quantification via prediction sets with exact finite-sample coverage. In low dimensions these sets are easy to interpret, but in high-dimensional or structured…

Machine Learning · Statistics 2026-05-08 Trevor Harris

Model trees provide an appealing way to perform interpretable machine learning for both classification and regression problems. In contrast to ``classic'' decision trees with constant values in their leaves, model trees can use linear…

Machine Learning · Computer Science 2026-03-11 Sabino Francesco Roselli , Eibe Frank

Diffusion-based models have significant achievements in time series generation but suffer from inefficient computation: solving high-dimensional ODEs/SDEs via iterative numerical solvers demands hundreds to thousands of drift function…

Machine Learning · Computer Science 2025-02-11 Yang Hu , Xiao Wang , Zezhen Ding , Lirong Wu , Huatian Zhang , Stan Z. Li , Sheng Wang , Jiheng Zhang , Ziyun Li , Tianlong Chen

Generative flows are promising tractable models for density modeling that define probabilistic distributions with invertible transformations. However, tractability imposes architectural constraints on generative flows, making them less…

Machine Learning · Statistics 2020-07-23 Jianfei Chen , Cheng Lu , Biqi Chenli , Jun Zhu , Tian Tian

Modeling transformations between arbitrary data distributions is a fundamental scientific challenge, arising in applications like drug discovery and evolutionary simulation. While flow matching offers a natural framework for this task, its…

Machine Learning · Computer Science 2025-10-09 Shiye Su , Yuhui Zhang , Linqi Zhou , Rajesh Ranganath , Serena Yeung-Levy

Flow-based generative models parameterize probability distributions through an invertible transformation and can be trained by maximum likelihood. Invertible residual networks provide a flexible family of transformations where only…

Machine Learning · Statistics 2020-07-27 Ricky T. Q. Chen , Jens Behrmann , David Duvenaud , Jörn-Henrik Jacobsen

Estimating counterfactual distributions under interventions is central to treatment risk assessment and counterfactual generation tasks. Existing approaches model the counterfactual distribution as a standalone generative target, without…

Machine Learning · Statistics 2026-05-11 Hugh Dance , Johnny Xi , Peter Orbanz , Benjamin Bloem-Reddy

We propose a way of transforming the problem of conditional density estimation into a single nonparametric regression task via the introduction of auxiliary samples. This allows leveraging regression methods that work well in high…

Machine Learning · Statistics 2025-11-25 Alexander G. Reisach , Olivier Collier , Alex Luedtke , Antoine Chambaz

In this study, we address causal inference when only observational data and a valid causal ordering from the causal graph are available. We introduce a set of flow models that can recover component-wise, invertible transformation of…

Machine Learning · Computer Science 2024-12-16 Minh Khoa Le , Kien Do , Truyen Tran

This paper demonstrates how to use generative models trained for image synthesis as tools for visual data mining. Our insight is that since contemporary generative models learn an accurate representation of their training data, we can use…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Ioannis Siglidis , Aleksander Holynski , Alexei A. Efros , Mathieu Aubry , Shiry Ginosar

This paper is about the problem of learning a stochastic policy for generating an object (like a molecular graph) from a sequence of actions, such that the probability of generating an object is proportional to a given positive reward for…

Machine Learning · Computer Science 2021-11-22 Emmanuel Bengio , Moksh Jain , Maksym Korablyov , Doina Precup , Yoshua Bengio

Regression methods for interval-valued data have been increasingly studied in recent years. As most of the existing works focus on linear models, it is important to note that many problems in practice are nonlinear in nature and therefore…

Methodology · Statistics 2022-01-11 Chih-Ching Yeh , Yan Sun , Adele Cutler

Despite much work on advanced deep learning and generative modeling techniques for tabular data generation and imputation, traditional methods have continued to win on imputation benchmarks. We herein present UnmaskingTrees, a simple method…

Machine Learning · Computer Science 2025-07-24 Calvin McCarter