English
Related papers

Related papers: Rethinking the Diffusion Models for Numerical Tabu…

200 papers

Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and…

Machine Learning · Computer Science 2025-09-23 Stefano Bruno , Sotirios Sabanis

Inverse design refers to the problem of optimizing the input of an objective function in order to enact a target outcome. For many real-world engineering problems, the objective function takes the form of a simulator that predicts how the…

Variational inference (VI) can be cast as an optimization problem in which the variational parameters are tuned to closely align a variational distribution with the true posterior. The optimization task can be approached through vanilla…

Machine Learning · Computer Science 2025-04-24 Dai Hai Nguyen , Tetsuya Sakurai , Hiroshi Mamitsuka

Inverse multiobjective optimization provides a general framework for the unsupervised learning task of inferring parameters of a multiobjective decision making problem (DMP), based on a set of observed decisions from the human expert.…

Optimization and Control · Mathematics 2020-10-01 Chaosheng Dong , Bo Zeng

Data imputation, the process of filling in missing feature elements for incomplete data sets, plays a crucial role in data-driven learning. A fundamental belief is that data imputation is helpful for learning performance, and it follows…

Machine Learning · Computer Science 2025-09-30 Ruikai Yang , Fan He , Mingzhen He , Kaijie Wang , Xiaolin Huang

We develop in this paper a new regularized flow dynamic approach to construct efficient numerical schemes for Wasserstein gradient flows in Lagrangian coordinates. Instead of approximating the Wasserstein distance which needs to solve…

Numerical Analysis · Mathematics 2024-06-24 Qing Cheng , Qianqian Liu , Wenbin Chen , Jie Shen

Wasserstein geometry and information geometry are two important structures to be introduced in a manifold of probability distributions. Wasserstein geometry is defined by using the transportation cost between two distributions, so it…

Statistics Theory · Mathematics 2021-01-01 Shun-ichi Amari , Takeru Matsuda

Transfer learning is a popular strategy to leverage external knowledge and improve statistical efficiency, particularly with a limited target sample. We propose a novel knowledge-guided Wasserstein Distributionally Robust Optimization…

Machine Learning · Computer Science 2025-02-13 Zitao Wang , Ziyuan Wang , Molei Liu , Nian Si

Addressing challenges in urban water infrastructure systems including aging infrastructure, supply uncertainty, extreme events, and security threats, depend highly on water distribution networks modeling emphasizing the importance of…

Optimization and Control · Mathematics 2020-05-20 Shen Wang , Ahmad F. Taha , Lina Sela , Marcio Giacomoni , Nikolaos Gatsis

We introduce the so called DeepParticle method to learn and generate invariant measures of stochastic dynamical systems with physical parameters based on data computed from an interacting particle method (IPM). We utilize the expressiveness…

Machine Learning · Computer Science 2022-06-22 Zhongjian Wang , Jack Xin , Zhiwen Zhang

The blooming diffusion probabilistic models (DPMs) have garnered significant interest due to their impressive performance and the elegant inspiration they draw from physics. While earlier DPMs relied upon the Markovian assumption, recent…

Artificial Intelligence · Computer Science 2023-12-12 Bowen Sun , Shibao Zheng

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart

Worst-case generation plays a critical role in evaluating robustness and stress-testing systems under distribution shifts, in applications ranging from machine learning models to power grids and medical prediction systems. We develop a…

Machine Learning · Statistics 2025-12-10 Xiuyuan Cheng , Yao Xie , Linglingzhi Zhu , Yunqin Zhu

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

This paper presents a novel approach to addressing the distributionally robust nonlinear model predictive control (DRNMPC) problem. Current literature primarily focuses on the static Wasserstein distributionally robust optimal control…

Optimization and Control · Mathematics 2023-04-18 Zhengang Zhong , Jia-Jie Zhu

Missing data imputation, which aims to impute the missing values in the raw datasets to achieve the completeness of datasets, is crucial for modern data-driven models like large language models (LLMs) and has attracted increasing interest…

Machine Learning · Computer Science 2025-01-07 Jianwei Wang , Kai Wang , Ying Zhang , Wenjie Zhang , Xiwei Xu , Xuemin Lin

Many real-world machine learning tasks require outputs that satisfy hard constraints, such as physical conservation laws, structured dependencies in graphs, or column-level relationships in tabular data. Existing approaches rely either on…

Artificial Intelligence · Computer Science 2025-11-21 Pantelis Dogoulis , Fabien Bernier , Félix Fourreau , Karim Tit , Maxime Cordy

Diffusion models have been the predominant generative model for tabular data generation. However, they face the conundrum of modeling under a separate versus a unified data representation. The former encounters the challenge of jointly…

Machine Learning · Computer Science 2025-12-23 Jacob Si , Zijing Ou , Mike Qu , Zhengrui Xiang , Yingzhen Li

Many data clustering applications must handle objects that cannot be represented as vectors. In this context, the bag-of-vectors representation describes complex objects through discrete distributions, for which the Wasserstein distance…

Machine Learning · Computer Science 2025-10-15 Alfredo Oneto , Blazhe Gjorgiev , Giovanni Sansavini

We study data-driven decision problems where historical observations are generated by a time-evolving distribution whose consecutive shifts are bounded in Wasserstein distance. We address this nonstationarity using a distributionally robust…

Optimization and Control · Mathematics 2025-12-25 Dominic S. T. Keehan , Edward J. Anderson , Wolfram Wiesemann