English
Related papers

Related papers: Modeling Persistent Trends in Distributions

200 papers

This work is concerned with model reduction of stochastic differential equations and builds on the idea of replacing drift and noise coefficients of preselected relevant, e.g. slow variables by their conditional expectations. We extend…

Analysis of PDEs · Mathematics 2020-03-05 Carsten Hartmann , Lara Neureither , Upanshu Sharma

In this work, we propose a novel probabilistic sequence model that excels at capturing high variability in time series data, both across sequences and within an individual sequence. Our method uses temporal latent variables to capture…

Machine Learning · Computer Science 2020-02-26 Ruizhi Deng , Yanshuai Cao , Bo Chang , Leonid Sigal , Greg Mori , Marcus A. Brubaker

We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space. Our key step is to build universal kernels…

Methodology · Statistics 2023-04-26 Qi Zhang , Bing Li , Lingzhou Xue

Despite of its importance for safe machine learning, uncertainty quantification for neural networks is far from being solved. State-of-the-art approaches to estimate neural uncertainties are often hybrid, combining parametric models with…

Machine Learning · Computer Science 2021-12-03 Joachim Sicking , Maram Akila , Maximilian Pintz , Tim Wirtz , Asja Fischer , Stefan Wrobel

We introduce the first probabilistic framework tailored for sequential random projection, an approach rooted in the challenges of sequential decision-making under uncertainty. The analysis is complicated by the sequential dependence and…

Statistics Theory · Mathematics 2024-05-14 Yingru Li

When modeling a probability distribution with a Bayesian network, we are faced with the problem of how to handle continuous variables. Most previous work has either solved the problem by discretizing, or assumed that the data are generated…

Machine Learning · Computer Science 2013-02-21 George H. John , Pat Langley

Most graph kernels are an instance of the class of $\mathcal{R}$-Convolution kernels, which measure the similarity of objects by comparing their substructures. Despite their empirical success, most graph kernels use a naive aggregation of…

Machine Learning · Computer Science 2019-10-31 Matteo Togninalli , Elisabetta Ghisu , Felipe Llinares-López , Bastian Rieck , Karsten Borgwardt

Real-world data often exhibits sequential dependence, across diverse domains such as human behavior, medicine, finance, and climate modeling. Probabilistic methods capture the inherent uncertainty associated with prediction in these…

Machine Learning · Statistics 2024-03-08 Alex Boyd

We introduce a dynamic distribution regression panel data model with heterogeneous coefficients across units. The objects of primary interest are functionals of these coefficients, including predicted one-step-ahead and stationary…

Econometrics · Economics 2025-07-31 Ivan Fernandez-Val , Wayne Yuan Gao , Yuan Liao , Francis Vella

The analysis of parametric and non-parametric uncertainties of very large dynamical systems requires the construction of a stochastic model of said system. Linear approaches relying on random matrix theory and principal componant analysis…

Machine Learning · Statistics 2023-02-02 Hamza Boukraichi , Nissrine Akkari , Fabien Casenave , David Ryckelynck

Gradient boosting is a sequential ensemble method that fits a new weaker learner to pseudo residuals at each iteration. We propose Wasserstein gradient boosting, a novel extension of gradient boosting that fits a new weak learner to…

Methodology · Statistics 2024-08-30 Takuo Matsubara

We introduce a new methodology for analyzing serial data by quantile regression assuming that the underlying quantile function consists of constant segments. The procedure does not rely on any distributional assumption besides serial…

Methodology · Statistics 2020-09-09 Laura Jula Vanegas , Merle Behr , Axel Munk

Expectile regression is a useful tool for exploring the relation between the response and the explanatory variables beyond the conditional mean. This article develops a continuous threshold expectile regression for modeling data in which…

Methodology · Statistics 2016-11-09 Feipeng Zhang , Qunhua Li

This paper builds Wasserstein ambiguity sets for the unknown probability distribution of dynamic random variables leveraging noisy partial-state observations. The constructed ambiguity sets contain the true distribution of the data with…

Optimization and Control · Mathematics 2021-07-21 Dimitris Boskos , Jorge Cortés , Sonia Martínez

In the presence of modeling errors, the mainstream Bayesian methods seldom give a realistic account of uncertainties as they commonly underestimate the inherent variability of parameters. This problem is not due to any misconception in the…

Applications · Statistics 2020-05-19 Omid Sedehi , Costas Papadimitriou , Lambros S. Katafygiotis

When propagating uncertainty in the data of differential equations, the probability laws describing the uncertainty are typically themselves subject to uncertainty. We present a sensitivity analysis of uncertainty propagation for…

Probability · Mathematics 2022-03-01 Oliver G. Ernst , Alois Pichler , Björn Sprungk

In this work, we investigate an intriguing and prevalent phenomenon of diffusion models which we term as "consistent model reproducibility": given the same starting noise input and a deterministic sampler, different diffusion models often…

Machine Learning · Computer Science 2024-06-11 Huijie Zhang , Jinfan Zhou , Yifu Lu , Minzhe Guo , Peng Wang , Liyue Shen , Qing Qu

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning with fundamental…

Machine Learning · Statistics 2021-08-23 Ruidi Chen , Ioannis Ch. Paschalidis

We propose a relative entropy gradient sampler (REGS) for sampling from unnormalized distributions. REGS is a particle method that seeks a sequence of simple nonlinear transforms iteratively pushing the initial samples from a reference…

Machine Learning · Statistics 2021-10-07 Xingdong Feng , Yuan Gao , Jian Huang , Yuling Jiao , Xu Liu

Linear regression on network-linked observations has been an essential tool in modeling the relationship between response and covariates with additional network structures. Previous methods either lack inference tools or rely on restrictive…

Methodology · Statistics 2022-08-22 Can M. Le , Tianxi Li