English
Related papers

Related papers: Optimal Stochastic Trace Estimation in Generative …

200 papers

Stochastic trace estimation is a well-established tool for approximating the trace of a large symmetric matrix $\boldsymbol{B}$. Several applications involve a matrix that depends continuously on a parameter $t \in [a,b]$, and require trace…

Numerical Analysis · Mathematics 2026-02-23 Fabio Matti , Haoze He , Daniel Kressner , Hei Yin Lam

This paper presents a continuous-time optimal control framework for the generation of reference trajectories in driving scenarios with uncertainty. A previous work presented a discrete-time stochastic generator for autonomous vehicles;…

Optimization and Control · Mathematics 2026-03-17 Ange Valli , Shangyuan Zhang , Abdel Lisser

Flight diversions are rare but high-impact events in aviation, making their reliable prediction vital for both safety and operational efficiency. However, their scarcity in historical records impedes the training of machine learning models…

Machine Learning · Computer Science 2026-04-23 Karim Aly , Alexei Sharpanskykh , Jacco Hoekstra

With the discovery of Wasserstein GANs, Optimal Transport (OT) has become a powerful tool for large-scale generative modeling tasks. In these tasks, OT cost is typically used as the loss for training GANs. In contrast to this approach, we…

Machine Learning · Computer Science 2022-03-08 Litu Rout , Alexander Korotin , Evgeny Burnaev

Statistical inference from high-dimensional data with low-dimensional structures has recently attracted lots of attention. In machine learning, deep generative modeling approaches implicitly estimate distributions of complex objects by…

Statistics Theory · Mathematics 2022-02-21 Rong Tang , Yun Yang

Transfer learning plays a key role in modern data analysis when: (1) the target data are scarce but the source data are sufficient; (2) the distributions of the source and target data are heterogeneous. This paper develops an interpretable…

Machine Learning · Statistics 2024-01-31 Shuo Shuo Liu

We investigate the problem of sampling from posterior distributions with intractable normalizing constants in Bayesian inference. Our solution is a new generative modeling approach based on optimal transport (OT) that learns a deterministic…

Computation · Statistics 2026-03-03 Ke Li , Wei Han , Yuexi Wang , Yun Yang

We consider the problem of minimizing the number of matrix-vector queries needed for accurate trace estimation in the dynamic setting where our underlying matrix is changing slowly, such as during an optimization process. Specifically, for…

Data Structures and Algorithms · Computer Science 2022-10-03 David P. Woodruff , Fred Zhang , Qiuyi Zhang

Generative models have gained significant attention in multivariate time series forecasting (MTS), particularly due to their ability to generate high-fidelity samples. Forecasting the probability distribution of multivariate time series is…

Machine Learning · Computer Science 2025-02-13 Shibo Feng , Peilin Zhao , Liu Liu , Pengcheng Wu , Zhiqi Shen

We propose a new framework for generative modeling based on a discrete-time stochastic control formulation of measure transport. Adapting classic results from control theory, we formulate our problem as a linear program whose dual variables…

Machine Learning · Computer Science 2026-05-22 Pablo Moreno-Muñoz , Adrian Müller , Gergely Neu

The design of mean and variance schedules for the perturbed signal is a fundamental challenge in generative models. While score-based and Schr\"odinger bridge-based models require careful selection of the stochastic differential equation to…

Sound · Computer Science 2025-09-10 Taihui Wang , Rilin Chen , Tong Lei , Andong Li , Jinzheng Zhao , Meng Yu , Dong Yu

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series,…

Methodology · Statistics 2022-06-22 Di Wang , Ruey S. Tsay

To address the challenges of low detection accuracy and high false positive rates of transmission lines in UAV (Unmanned Aerial Vehicle) images, we explore the linear features and spatial distribution. We introduce an enhanced stochastic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Wei Song , Pei Li , Man Wang

In this work we investigate stochastic non-convex optimization problems where the objective is an expectation over smooth loss functions, and the goal is to find an approximate stationary point. The most popular approach to handling such…

Optimization and Control · Mathematics 2021-11-02 Kfir Y. Levy , Ali Kavis , Volkan Cevher

Optimal transport has found widespread applications in signal processing and machine learning. Among its many equivalent formulations, optimal transport seeks to reconstruct a random variable/vector with a prescribed distribution at the…

Information Theory · Computer Science 2025-03-06 Jun Chen , Jia Wang , Ruibin Li , Han Zhou , Wei Dong , Huan Liu , Yuanhao Yu

This paper investigates the theoretical behavior of generative models under finite training populations. Within the stochastic interpolation generative framework, we derive closed-form expressions for the optimal velocity field and score…

Machine Learning · Computer Science 2025-09-29 Yunchen Li , Shaohui Lin , Zhou Yu

In real-time trajectory planning for unmanned vehicles, on-board sensors, radars and other instruments are used to collect information on possible obstacles to be avoided and pathways to be followed. Since, in practice, observations of the…

Methodology · Statistics 2013-09-25 Adriano Zanin Zambom , Julian A. A. Collazos , Ronaldo Dias

Learning conditional distributions is challenging because the desired outcome is not a single distribution but multiple distributions that correspond to multiple instances of the covariates. We introduce a novel neural entropic optimal…

Machine Learning · Computer Science 2024-06-05 Bao Nguyen , Binh Nguyen , Hieu Trung Nguyen , Viet Anh Nguyen

Consistency models are a new family of generative models capable of producing high-quality samples in either a single step or multiple steps. Recently, consistency models have demonstrated impressive performance, achieving results on par…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Quan Dao , Khanh Doan , Di Liu , Trung Le , Dimitris Metaxas

Forecasting on sparse multivariate time series (MTS) aims to model the predictors of future values of time series given their incomplete past, which is important for many emerging applications. However, most existing methods process MTS's…

Machine Learning · Computer Science 2021-03-04 Yinjun Wu , Jingchao Ni , Wei Cheng , Bo Zong , Dongjin Song , Zhengzhang Chen , Yanchi Liu , Xuchao Zhang , Haifeng Chen , Susan Davidson