English
Related papers

Related papers: Wasserstein Autoregressive Models for Density Time…

200 papers

We introduce Autoregressive Diffusion Models (ARDMs), a model class encompassing and generalizing order-agnostic autoregressive models (Uria et al., 2014) and absorbing discrete diffusion (Austin et al., 2021), which we show are special…

Machine Learning · Computer Science 2022-02-03 Emiel Hoogeboom , Alexey A. Gritsenko , Jasmijn Bastings , Ben Poole , Rianne van den Berg , Tim Salimans

It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension…

Machine Learning · Statistics 2022-06-01 Adam Block , Zeyu Jia , Yury Polyanskiy , Alexander Rakhlin

In this article, we introduce and study a one sided tempered stable first order autoregressive model called TAR(1). Under the assumption of stationarity of the model, the marginal probability density function of the error term is found. It…

Statistics Theory · Mathematics 2021-07-30 Niharika Bhootna , Arun Kumar

Emotions are an essential part of human behavior that can impact thinking, decision-making, and communication skills. Thus, the ability to accurately monitor and identify emotions can be useful in many human-centered applications such as…

Machine Learning · Computer Science 2023-08-22 Nibraas Khan , Mahrukh Tauseef , Ritam Ghosh , Nilanjan Sarkar

Conformal prediction yields a prediction set with guaranteed $1-\alpha$ coverage of the true target under the i.i.d. assumption, which may not hold and lead to a gap between $1-\alpha$ and the actual coverage. Prior studies bound the gap…

Machine Learning · Computer Science 2025-03-07 Rui Xu , Chao Chen , Yue Sun , Parvathinathan Venkitasubramaniam , Sihong Xie

Wasserstein distributionally robust estimators have emerged as powerful models for prediction and decision-making under uncertainty. These estimators provide attractive generalization guarantees: the robust objective obtained from the…

Machine Learning · Computer Science 2023-11-07 Waïss Azizian , Franck Iutzeler , Jérôme Malick

Various statistical tasks, including sampling or computing Wasserstein barycenters, can be reformulated as fixed-point problems for operators on probability distributions. Accelerating standard fixed-point iteration schemes provides a…

Optimization and Control · Mathematics 2026-01-30 Vitalii Aksenov , Martin Eigel , Mathias Oster

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

Optimization and Control · Mathematics 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in view of the equality of opportunity criterion. We use a type-$\infty$ Wasserstein ambiguity set centered at…

Machine Learning · Computer Science 2021-07-13 Yijie Wang , Viet Anh Nguyen , Grani A. Hanasusanto

This paper develops a unified framework, based on iterated random operator theory, to analyze the convergence of constant stepsize recursive stochastic algorithms (RSAs). RSAs use randomization to efficiently compute expectations, and so…

Machine Learning · Computer Science 2021-01-06 Abhishek Gupta , William B. Haskell

Diffusion models are one of the most important families of deep generative models. In this note, we derive a quantitative upper bound on the Wasserstein distance between the data-generating distribution and the distribution learned by a…

Machine Learning · Computer Science 2024-09-17 Sokhna Diarra Mbacke , Omar Rivasplata

Object density reconstruction from projections containing scattered radiation and noise is of critical importance in many applications. Existing scatter correction and density reconstruction methods may not provide the high accuracy needed…

Image and Video Processing · Electrical Eng. & Systems 2022-04-28 Zhishen Huang , Marc Klasky , Trevor Wilcox , Saiprasad Ravishankar

In this work, we propose a novel generalized Wasserstein-2 distance approach for efficiently training stochastic neural networks to reconstruct random field models, where the target random variable comprises both continuous and categorical…

Machine Learning · Computer Science 2025-07-08 Mingtao Xia , Qijing Shen

We study the problem of network regression, where one is interested in how the topology of a network changes as a function of Euclidean covariates. We build upon recent developments in generalized regression models on metric spaces based on…

Machine Learning · Statistics 2024-06-19 Alex G. Zalles , Kai M. Hung , Ann E. Finneran , Lydia Beaudrot , César A. Uribe

Time series regression models are commonly used in time series analysis. However, in modern real-world applications, serially correlated data with an ultra-high dimension and fat tails are prevalent. This presents a challenge in developing…

Statistics Theory · Mathematics 2023-04-21 Linbo Liu , Danna Zhang

Denoising diffusion models are a recent class of generative models exhibiting state-of-the-art performance in image and audio synthesis. Such models approximate the time-reversal of a forward noising process from a target distribution to a…

Machine Learning · Statistics 2023-05-30 Valentin De Bortoli

The subject of this paper is the estimation of a probability measure on ${\mathbb R}^d$ from data observed with an additive noise, under the Wasserstein metric of order $p$ (with $p\geq 1$). We assume that the distribution of the errors is…

Statistics Theory · Mathematics 2013-07-22 Jérôme Dedecker , Bertrand Michel

Markov decision processes (MDPs) are known to be sensitive to parameter specification. Distributionally robust MDPs alleviate this issue by allowing for \emph{ambiguity sets} which give a set of possible distributions over parameter sets.…

Optimization and Control · Mathematics 2021-05-05 Julien Grand-Clément , Christian Kroer

Probabilistic time series forecasting involves estimating the distribution of future based on its history, which is essential for risk management in downstream decision-making. We propose a deep state space model for probabilistic time…

Machine Learning · Computer Science 2021-02-02 Longyuan Li , Junchi Yan , Xiaokang Yang , Yaohui Jin

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

Optimization and Control · Mathematics 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang