English
Related papers

Related papers: Variational Inference for L\'evy Process-Driven SD…

200 papers

The stochastic gradient noise (SGN) is a significant factor in the success of stochastic gradient descent (SGD). Following the central limit theorem, SGN was initially modeled as Gaussian, and lately, it has been suggested that stochastic…

Machine Learning · Computer Science 2023-03-07 Barak Battash , Ofir Lindenbaum

The neural dynamics underlying brain activity are critical to understanding cognitive processes and mental disorders. However, current voxel-based whole-brain dimensionality reduction techniques fall short of capturing these dynamics,…

Neurons and Cognition · Quantitative Biology 2023-05-25 Eloy Geenjaar , Donghyun Kim , Riyasat Ohib , Marlena Duda , Amrit Kashyap , Sergey Plis , Vince Calhoun

With the rapid increase of valuable observational, experimental and simulated data for complex systems, much efforts have been devoted to identifying governing laws underlying the evolution of these systems. Despite the wide applications of…

Machine Learning · Statistics 2021-10-01 Yang Li , Yubin Lu , Shengyuan Xu , Jinqiao Duan

We study the extremal behavior of a stochastic integral driven by a multivariate L\'{e}vy process that is regularly varying with index $\alpha>0$. For predictable integrands with a finite $(\alpha+\delta)$-moment, for some $\delta>0$, we…

Probability · Mathematics 2007-05-23 Henrik Hult , Filip Lindskog

Many modern unsupervised or semi-supervised machine learning algorithms rely on Bayesian probabilistic models. These models are usually intractable and thus require approximate inference. Variational inference (VI) lets us approximate a…

Machine Learning · Computer Science 2018-10-24 Cheng Zhang , Judith Butepage , Hedvig Kjellstrom , Stephan Mandt

A new shrinkage-based construction is developed for a compressible vector $\boldsymbol{x}\in\mathbb{R}^n$, for cases in which the components of $\xv$ are naturally associated with a tree structure. Important examples are when $\xv$…

Machine Learning · Statistics 2014-01-14 Xin Yuan , Vinayak Rao , Shaobo Han , Lawrence Carin

We extend the L\'evy Langevin Monte Carlo method studied by Oechsler in 2024 to the setting of a target distribution with heavy tails: Choosing a target distribution from the class of subexponential distributions we prove convergence of a…

Probability · Mathematics 2025-07-15 Anita Behme , Claudius Lütke Schwienhorst

L\'evy processes are widely used in financial modeling due to their ability to capture discontinuities and heavy tails, which are common in high-frequency asset return data. However, parameter estimation remains a challenge when associated…

Machine Learning · Statistics 2025-10-01 Nicolas Coloma , William Kleiber

Posterior distributions arising in ill-posed Bayesian inverse problems are often both analytically intractable and highly sensitive to parameters of the chosen prior family. We aim to understand the sensitivity of intractable posterior…

Methodology · Statistics 2026-04-20 Yucong Liu , Zilai Si , Alexander Strang

We study a Monte Carlo algorithm for simulation of probability distributions based on stochastic step functions, and compare to the traditional Metropolis/Hastings method. Unlike the latter, the step function algorithm can produce an…

Probability · Mathematics 2015-12-07 Torquil Macdonald Sørensen , Fred Espen Benth

Standard GPs offer a flexible modelling tool for well-behaved processes. However, deviations from Gaussianity are expected to appear in real world datasets, with structural outliers and shocks routinely observed. In these cases GPs can fail…

Machine Learning · Statistics 2022-09-08 Yaman Kındap , Simon Godsill

This work has been motivated by the challenge of the 2017 conference on Extreme-Value Analysis (EVA2017), with the goal of predicting daily precipitation quantiles at the $99.8\%$ level for each month at observed and unobserved locations.…

Methodology · Statistics 2018-02-06 Thomas Opitz , Raphaël Huser , Haakon Bakka , Håvard Rue

Large neural networks trained on large datasets have become the dominant paradigm in machine learning. These systems rely on maximum likelihood point estimates of their parameters, precluding them from expressing model uncertainty. This may…

Machine Learning · Statistics 2024-05-01 Javier Antoran

Stochastic processes provide a mathematically elegant way model complex data. In theory, they provide flexible priors over function classes that can encode a wide range of interesting assumptions. In practice, however, efficient inference…

Machine Learning · Computer Science 2022-09-15 Swapnil Mishra , Seth Flaxman , Tresnia Berah , Harrison Zhu , Mikko Pakkanen , Samir Bhatt

Variational inference provides a powerful tool for approximate probabilistic in- ference on complex, structured models. Typical variational inference methods, however, require to use inference networks with computationally tractable proba-…

Machine Learning · Statistics 2017-11-01 Qiang Liu , Yihao Feng

Latent space models (LSMs) are often used to analyze dynamic (time-varying) networks that evolve in continuous time. Existing approaches to Bayesian inference for these models rely on Markov chain Monte Carlo algorithms, which cannot handle…

Methodology · Statistics 2024-01-19 Joshua Daniel Loyal

Deriving Bayesian inference for exponential random graph models (ERGMs) is a challenging "doubly intractable" problem as the normalizing constants of the likelihood and posterior density are both intractable. Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2019-11-26 Linda S. L. Tan , Nial Friel

In this paper, we consider McKean-Vlasov stochastic differential equations (MVSDEs) driven by L\'evy noise. By identifying the right equations satisfied by the solutions of the MVSDEs with shifted driving L\'evy noise, we build up a…

Probability · Mathematics 2020-11-18 Wei Liu , Yulin Song , Jianliang Zhai , Tusheng Zhang

Bayesian inference plays an important role in advancing machine learning, but faces computational challenges when applied to complex models such as deep neural networks. Variational inference circumvents these challenges by formulating…

Machine Learning · Statistics 2018-08-03 Mohammad Emtiyaz Khan , Didrik Nielsen

Constructions of numerous approximate sampling algorithms are based on the well-known fact that certain Gibbs measures are stationary distributions of ergodic stochastic differential equations (SDEs) driven by the Brownian motion. However,…

Probability · Mathematics 2020-07-07 Lu-Jing Huang , Mateusz B. Majka , Jian Wang
‹ Prev 1 3 4 5 6 7 10 Next ›