English
Related papers

Related papers: Sampling Decisions

200 papers

Suppose X is a multivariate diffusion process that is observed discretely in time. At each observation time, a transformation of the state of the process is observed with noise. The smoothing problem consists of recovering the path of the…

Computation · Statistics 2024-09-04 Marcin Mider , Moritz Schauer , Frank van der Meulen

Recently, Masked Diffusion Models (MDMs) have shown promising potential across vision, language, and cross-modal generation. However, a notable discrepancy exists between their training and inference procedures. In particular, MDM inference…

Machine Learning · Computer Science 2025-12-30 Renping Zhou , Zanlin Ni , Tianyi Chen , Zeyu Liu , Yang Yue , Yulin Wang , Yuxuan Wang , Jingshu Liu , Gao Huang

Markov decision processes (MDPs) in queues and networks have been an interesting topic in many practical areas since the 1960s. This paper provides a detailed overview on this topic and tracks the evolution of many basic results. Also, this…

Optimization and Control · Mathematics 2019-08-26 Quan-Lin Li , Jing-Yu Ma , Rui-Na Fan , Li Xia

We propose a deterministic denoising algorithm for discrete-state diffusion models. The key idea is to derandomize the generative reverse Markov chain by introducing a variant of the herding algorithm, which induces deterministic state…

Machine Learning · Computer Science 2026-01-30 Hideyuki Suzuki , Wataru Kurebayashi , Hiroshi Yamashita

Caching content over CDNs or at the network edge has been solidified as a means to improve network cost and offer better streaming experience to users. Furthermore, nudging the users towards low-cost content has recently gained momentum as…

Networking and Internet Architecture · Computer Science 2020-12-08 Theodoros Giannakas , Anastasios Giovanidis , Thrasyvoulos Spyropoulos

Recent years have witnessed the rapid progress and broad application of diffusion probabilistic models (DPMs). Sampling from DPMs can be viewed as solving an ordinary differential equation (ODE). Despite the promising performance, the…

Artificial Intelligence · Computer Science 2023-12-13 Enshu Liu , Xuefei Ning , Huazhong Yang , Yu Wang

Diffusion Probabilistic Models (DPM) have shown remarkable efficacy in the synthesis of high-quality images. However, their inference process characteristically requires numerous, potentially hundreds, of iterative steps, which could…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mingxiao Li , Tingyu Qu , Ruicong Yao , Wei Sun , Marie-Francine Moens

Flow matching has emerged as a powerful generative modeling approach with flexible choices of source distribution. While Gaussian distributions are commonly used, the potential for better alternatives in high-dimensional data generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Junho Lee , Kwanseok Kim , Joonseok Lee

Deep generative models are often used for human motion prediction as they are able to model multi-modal data distributions and characterize diverse human behavior. While much care has been taken into designing and learning deep generative…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Ye Yuan , Kris Kitani

Diffusion models offer powerful generative capabilities for robot trajectory planning, yet their practical deployment on robots is hindered by a critical bottleneck: a reliance on imitation learning from expert demonstrations. This paradigm…

Robotics · Computer Science 2026-02-25 Lei Ye , Haibo Gao , Peng Xu , Zhelin Zhang , Junqi Shan , Ao Zhang , Wei Zhang , Ruyi Zhou , Zongquan Deng , Liang Ding

This work presents a multiscale framework to solve a class of stochastic optimal control problems in the context of robot motion planning and control in a complex environment. In order to handle complications resulting from a large decision…

Robotics · Computer Science 2017-03-14 Jung-Su Ha , Han-Lim Choi

The task of deducing three-dimensional molecular configurations from their two-dimensional graph representations holds paramount importance in the fields of computational chemistry and pharmaceutical development. The rapid advancement of…

Biomolecules · Quantitative Biology 2025-01-09 Bobin Yang , Jie Deng , Zhenghan Chen , Ruoxue Wu

We present a general framework for applying machine-learning algorithms to the verification of Markov decision processes (MDPs). The primary goal of these techniques is to improve performance by avoiding an exhaustive exploration of the…

The solution convergence of Markov Decision Processes (MDPs) can be accelerated by prioritized sweeping of states ranked by their potential impacts to other states. In this paper, we present new heuristics to speed up the solution…

Artificial Intelligence · Computer Science 2019-01-07 Shoubhik Debnath , Lantao Liu , Gaurav Sukhatme

The Distributed Cooperative Modeling System (DCMS) solves complex decision problems involving a lot of participants with different viewpoints by network based distributed modeling and multi-template aggregation. This thesis aims at…

Artificial Intelligence · Computer Science 2014-03-04 Menghan Wang

Steering large-scale swarms with only limited control updates is often needed due to communication or computational constraints, yet most learning-based approaches do not account for this and instead model instantaneous velocity fields. As…

Machine Learning · Computer Science 2026-04-07 Anqi Dong , Yongxin Chen , Karl H. Johansson , Johan Karlsson

Efficient sampling of complex data distributions can be achieved using trained invertible flows (IF), where the model distribution is generated by pushing a simple base distribution through multiple non-linear bijective transformations.…

Machine Learning · Computer Science 2021-07-13 Daniel O'Connor , Walter Vinci

In this work, we propose the Generative Latent Flow (GLF), an algorithm for generative modeling of the data distribution. GLF uses an Auto-encoder (AE) to learn latent representations of the data, and a normalizing flow to map the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhisheng Xiao , Qing Yan , Yali Amit

While generative modeling has achieved remarkable success on tasks like natural language-conditioned image generation, enabling model adaptation from example data points remains a relatively underexplored and challenging problem. To this…

Machine Learning · Computer Science 2026-05-08 Tyler Ingebrand , Ruihan Zhao , Kushagra Gupta , David Fridovich-Keil , Sandeep P. Chinchali , Ufuk Topcu

Normalizing flows (NF) use a continuous generator to map a simple latent (e.g. Gaussian) distribution, towards an empirical target distribution associated with a training data set. Once trained by minimizing a variational objective, the…

Machine Learning · Statistics 2023-05-23 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais