English
Related papers

Related papers: Diffusion Models as Constrained Samplers for Optim…

200 papers

Recovering high-dimensional statistical structure from limited measurements is a fundamental challenge in hyperspectral imaging, where capturing full-resolution data is often infeasible due to sensor, bandwidth, or acquisition constraints.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-01 Jonathan Monsalve , Kumar Vijay Mishra

Many stochastic optimization problems include chance constraints that enforce constraint satisfaction with a specific probability; however, solving an optimization problem with chance constraints assumes that the solver has access to the…

Optimization and Control · Mathematics 2021-09-21 Joshua Comden , Ahmed S. Zamzam , Andrey Bernstein

Many segmentation tasks, such as medical image segmentation or future state prediction, are inherently ambiguous, meaning that multiple predictions are equally correct. Current methods typically rely on generative models to capture this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Sebastian Gerard , Josephine Sullivan

Diffusion models have achieved remarkable success in generative modeling. Despite more stable training, the loss of diffusion models is not indicative of absolute data-fitting quality, since its optimal value is typically not zero but…

Machine Learning · Computer Science 2026-04-17 Yixian Xu , Shengjie Luo , Liwei Wang , Di He , Chang Liu

Calibrated estimates of uncertainty are critical for many real-world computer vision applications of deep learning. While there are several widely-used uncertainty estimation methods, dropout inference stands out for its simplicity and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Yichen Shen , Zhilu Zhang , Mert R. Sabuncu , Lin Sun

There is a long history in machine learning of model ensembling, beginning with boosting and bagging and continuing to the present day. Much of this history has focused on combining models for classification and regression, but recently…

Machine Learning · Computer Science 2024-05-28 Ira Globus-Harris , Varun Gupta , Michael Kearns , Aaron Roth

Data-driven optimization uses contextual information and machine learning algorithms to find solutions to decision problems with uncertain parameters. While a vast body of work is dedicated to interpreting machine learning models in the…

Machine Learning · Computer Science 2023-07-21 Alexandre Forel , Axel Parmentier , Thibaut Vidal

Real-world problems typically require the simultaneous optimization of several, often conflicting objectives. Many of these multi-objective optimization problems are characterized by wide ranges of uncertainties in their decision variables…

Neural and Evolutionary Computing · Computer Science 2019-10-21 Faramarz Khosravi , Alexander Raß , Jürgen Teich

Offline black-box optimization aims to discover novel designs with high property scores using only a static dataset, a task fundamentally challenged by the out-of-distribution (OOD) extrapolation problem. Existing approaches typically…

Machine Learning · Computer Science 2026-05-22 Yonghan Yang , Ye Yuan , Zipeng Sun , Linfeng Du , Bowei He , Haolun Wu , Can Chen , Xue Liu

This paper introduces a simple formulation for topology optimization problems ensuring manufacturability by machining. The method distinguishes itself from existing methods by using the advection-diffusion equation with Robin boundary…

Computational Engineering, Finance, and Science · Computer Science 2022-02-16 Lukas Christian Høghøj , Erik Albert Träff

In this article, we study the optimization of resource distributions in a one-dimensional logistic diffusive model. The goal is to determine a distribution on a bounded one-dimensional domain that maximizes the total population at…

Analysis of PDEs · Mathematics 2025-11-21 Junyoung Heo , Yubin Lee

This paper is concerned with topology optimization based on a level set method using (doubly) nonlinear diffusion equations. Topology optimization using the level set method is called level set-based topology optimization, which is possible…

Optimization and Control · Mathematics 2023-03-22 Tomoyuki Oka , Takayuki Yamada

Diffusion models have shown significant potential in generating oracle items that best match user preference with guidance from user historical interaction sequences. However, the quality of guidance is often compromised by unpredictable…

Information Retrieval · Computer Science 2025-05-20 Wenyu Mao , Zhengyi Yang , Jiancan Wu , Haozhe Liu , Yancheng Yuan , Xiang Wang , Xiangnan He

The recent introduction of diffusion models in dataset distillation has shown promising potential in creating compact surrogate datasets for large, high-resolution target datasets, offering improved efficiency and performance over…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Haoxuan Wang , Zhenghao Zhao , Junyi Wu , Yuzhang Shang , Gaowen Liu , Yan Yan

Sampling from a distribution $p(x) \propto e^{-\mathcal{E}(x)}$ known up to a normalising constant is an important and challenging problem in statistics. Recent years have seen the rise of a new family of amortised sampling algorithms,…

Machine Learning · Computer Science 2026-05-29 Arran Carter , Sanghyeok Choi , Kirill Tamogashev , Víctor Elvira , Esmeralda S. Whitammer

Solving statistical learning problems often involves nonconvex optimization. Despite the empirical success of nonconvex statistical optimization methods, their global dynamics, especially convergence to the desirable local minima, remain…

Machine Learning · Statistics 2018-08-30 Chris Junchi Li , Zhaoran Wang , Han Liu

Curse of Dimensionality is an unavoidable challenge in statistical probability models, yet diffusion models seem to overcome this limitation, achieving impressive results in high-dimensional data generation. Diffusion models assume that…

Machine Learning · Statistics 2025-10-01 Zhenxin Zheng , Zhenjie Zheng

Recently proposed generative models for discrete data, such as Masked Diffusion Models (MDMs), exploit conditional independence approximations to reduce the computational cost of popular Auto-Regressive Models (ARMs), at the price of some…

Machine Learning · Statistics 2025-12-18 Hugo Lavenant , Giacomo Zanella

Many real world data mining applications involve obtaining predictive models using data sets with strongly imbalanced distributions of the target variable. Frequently, the least common values of this target variable are associated with…

Machine Learning · Computer Science 2015-05-14 Paula Branco , Luis Torgo , Rita Ribeiro

Constrained blackbox optimization is a difficult problem, with most approaches coming from the mathematical programming literature. The statistical literature is sparse, especially in addressing problems with nontrivial constraints. This…