English
Related papers

Related papers: Controllable Generation via Locally Constrained Re…

200 papers

In this paper we propose a data-driven distributionally robust Model Predictive Control framework for constrained stochastic systems with unbounded additive disturbances. Recursive feasibility is ensured by optimizing over an linearly…

Optimization and Control · Mathematics 2023-03-07 Christoph Mark , Steven Liu

We show that estimating the complexity (mean and distribution) of the instances of a fixed size Constraint Satisfaction Problem (CSP) can be very hard. We deal with the main two aspects of the problem: defining a measure of complexity and…

Artificial Intelligence · Computer Science 2015-06-03 Denis Berthier

Autoregressive models are widely used for tasks such as image and audio generation. The sampling process of these models, however, does not allow interruptions and cannot adapt to real-time computational resources. This challenge impedes…

Machine Learning · Computer Science 2021-02-24 Yilun Xu , Yang Song , Sahaj Garg , Linyuan Gong , Rui Shu , Aditya Grover , Stefano Ermon

Controllable layout generation aims at synthesizing plausible arrangement of element bounding boxes with optional constraints, such as type or position of a specific element. In this work, we try to solve a broad range of layout generation…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Naoto Inoue , Kotaro Kikuchi , Edgar Simo-Serra , Mayu Otani , Kota Yamaguchi

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

Autoregressive language models, despite their impressive capabilities, struggle with complex reasoning and long-term planning tasks. We introduce discrete diffusion models as a novel solution to these challenges. Through the lens of subgoal…

Computation and Language · Computer Science 2025-02-19 Jiacheng Ye , Jiahui Gao , Shansan Gong , Lin Zheng , Xin Jiang , Zhenguo Li , Lingpeng Kong

Bayesian model-based reinforcement learning is a formally elegant approach to learning optimal behaviour under model uncertainty, trading off exploration and exploitation in an ideal way. Unfortunately, finding the resulting Bayes-optimal…

Machine Learning · Computer Science 2015-03-20 Arthur Guez , David Silver , Peter Dayan

In this paper, we present a general method that can improve the sample quality of pre-trained likelihood based generative models. Our method constructs an energy function on the latent variable space that yields an energy function on…

Machine Learning · Computer Science 2020-06-16 Zhisheng Xiao , Qing Yan , Yali Amit

This paper addresses optimal decoding strategies in lossy compression where the assumed distribution for compressor design mismatches the actual (true) distribution of the source. This problem has immediate relevance in standardized…

Information Theory · Computer Science 2026-02-04 Saeed R. Khosravirad , Ahmed Alkhateeb , Ingrid van de Voorde

We study two log-concave sampling problems: constrained sampling and composite sampling. First, we consider sampling from a target distribution with density proportional to $\exp(-f(x))$ supported on a convex set $K \subset \mathbb{R}^d$,…

Machine Learning · Statistics 2026-02-17 Thanh Dang , Jiaming Liang

We propose a hybrid generative model for efficient sampling of high-dimensional, multimodal probability distributions for Bayesian inference. Traditional Monte Carlo methods, such as the Metropolis-Hastings and Langevin Monte Carlo sampling…

Machine Learning · Statistics 2025-05-14 Hoang Tran , Zezhong Zhang , Feng Bao , Dan Lu , Guannan Zhang

This paper introduces an alternative approach to sampling from autoregressive models. Autoregressive models are typically sampled sequentially, according to the transition dynamics defined by the model. Instead, we propose a sampling…

Machine Learning · Computer Science 2021-12-20 Vivek Jayaram , John Thickstun

A reduction of a source distribution is a collection of smaller sized distributions that are collectively equivalent to the source distribution with respect to the property of decomposability. That is, an arbitrary language is decomposable…

Systems and Control · Computer Science 2018-03-30 Liyong Lin , Tomáš Masopust , W. Murray Wonham , Rong Su

Current mathematical frameworks for predicting the flux state and macromolecular composition of the cell do not rely on thermodynamic constraints to determine the spontaneous direction of reactions. These predictions may be biologically…

Optimization and Control · Mathematics 2020-08-14 Amir Akbari , Bernhard O. Palsson

Diffusion models have shown remarkable potential in planning and control tasks due to their ability to represent multimodal distributions over actions and trajectories. However, ensuring safety under constraints remains a critical challenge…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Jichen Zhang , Liqun Zhao , Antonis Papachristodoulou , Jack Umenberger

Stochastic differential equation (SDE)-based generative models have achieved substantial progress in conditional generation via training-free differentiable loss-guided approaches. However, existing methodologies utilizing posterior sam-…

Machine Learning · Computer Science 2026-03-10 Minsi Ren , Wenhao Deng , Ruiqi Feng , Tailin Wu

Tree-controlled grammars are context-free grammars where the derivation process is controlled in such a way that every word on a level of the derivation tree must belong to a certain control language. We investigate the generative capacity…

Computational Complexity · Computer Science 2023-09-07 Bianca Truthe

Lexically constrained sentence generation allows the incorporation of prior knowledge such as lexical constraints into the output. This technique has been applied to machine translation, and dialog response generation. Previous work usually…

Computation and Language · Computer Science 2021-09-14 Xingwei He , Victor O. K. Li

Invertible flow-based generative models are an effective method for learning to generate samples, while allowing for tractable likelihood computation and inference. However, the invertibility requirement restricts models to have the same…

Machine Learning · Computer Science 2020-02-21 Abhishek Kumar , Ben Poole , Kevin Murphy

Generative Bayesian Computation (GBC) methods are developed for Casual Inference. Generative methods are simulation-based methods that use a large training dataset to represent posterior distributions as a map (a.k.a. optimal transport) to…

Methodology · Statistics 2024-12-25 Maria Nareklishvili , Nicholas Polson , Vadim Sokolov