English
Related papers

Related papers: Symmetrized importance samplers for stochastic dif…

200 papers

We apply the theory of Lie symmetries in order to study a fourth-order $1+2$ evolutionary partial differential equation which has been proposed for the image processing noise reduction. In particular we determine the Lie point symmetries…

Exactly Solvable and Integrable Systems · Physics 2020-08-17 Andronikos Paliathanasis , P. G. L. Leach

Simulated annealing - moving from a tractable distribution to a distribution of interest via a sequence of intermediate distributions - has traditionally been used as an inexact method of handling isolated modes in Markov chain samplers.…

Computational Physics · Physics 2007-05-23 Radford M. Neal

Importance sampling is used to approximate Bayes' rule in many computational approaches to Bayesian inverse problems, data assimilation and machine learning. This paper reviews and further investigates the required sample size for…

Computation · Statistics 2021-02-03 Daniel Sanz-Alonso , Zijian Wang

Self-supervised learning is an increasingly popular approach to unsupervised learning, achieving state-of-the-art results. A prevalent approach consists in contrasting data points and noise points within a classification task: this requires…

Machine Learning · Statistics 2023-01-25 Omar Chehab , Alexandre Gramfort , Aapo Hyvarinen

Optimization problems with the objective function in the form of weighted sum and linear equality constraints are considered. Given that the number of local cost functions can be large as well as the number of constraints, a stochastic…

Optimization and Control · Mathematics 2026-05-26 Nataša Krejić , Nataša Krklec Jerinkić , Sanja Rapajić , Luka Rutešić

As a concrete setting where stochastic partial differential equations (SPDEs) are able to model real phenomena, we propose a stochastic Meinhardt model for cell repolarisation and study how parameter estimation techniques developed for…

Statistics Theory · Mathematics 2021-08-17 Randolf Altmeyer , Till Bretschneider , Josef Janák , Markus Reiß

The efficient importance sampling (EIS) method is a general principle for the numerical evaluation of high-dimensional integrals that uses the sequential structure of target integrands to build variance minimising importance samplers.…

Computation · Statistics 2013-09-27 Marcel Scharth , Robert Kohn

This study presents an importance sampling formulation based on adaptively relaxing parameters from the indicator function and/or the probability density function. The formulation embodies the prevalent mathematical concept of relaxing a…

Applications · Statistics 2024-04-11 Jianhua Xian , Ziqi Wang

In this paper, we propose a new image denoising method, tailored to specific classes of images, assuming that a dataset of clean images of the same class is available. Similarly to the non-local means (NLM) algorithm, the proposed method…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Milad Niknejad , Jose M. Bioucas-Dias , Mario A. T. Figueiredo

In this paper, the successive approximation method is applied to investigate the existence and uniqueness of solutions to the stochastic differential equations (SDEs) driven by L\'evy noise under non-Lipschitz condition which is a much…

Dynamical Systems · Mathematics 2014-05-15 Y Xu , B Pei

We study the convergence rates of the semi-discrete (SD) method originally proposed in Halidias (2012), Semi-discrete approximations for stochastic differential equations and applications, International Journal of Computer Mathematics,…

Numerical Analysis · Mathematics 2020-05-06 Ioannis S. Stamatiou , Nikolaos Halidias

This paper is concerned with developing and analyzing two novel implicit temporal discretization methods for the stochastic semilinear wave equations with multiplicative noise. The proposed methods are natural extensions of well-known…

Numerical Analysis · Mathematics 2024-08-26 Xiaobing Feng , Yukun Li , Liet Vo

Symmetry methods are by now recognized as one of the main tools to attack deterministic differential equations (both ODEs and PDEs); the situation is quite different for what concerns stochastic differential equations: here, symmetry…

Mathematical Physics · Physics 2007-05-23 Giuseppe Gaeta

In Score based Generative Modeling (SGMs), the state-of-the-art in generative modeling, stochastic reverse processes are known to perform better than their deterministic counterparts. This paper delves into the heart of this phenomenon,…

Machine Learning · Computer Science 2023-12-15 Karthik Elamvazhuthi , Samet Oymak , Fabio Pasqualetti

Importance sampling has been successfully used to accelerate stochastic optimization in many convex problems. However, the lack of an efficient way to calculate the importance still hinders its application to Deep Learning. In this paper,…

Machine Learning · Computer Science 2017-09-14 Angelos Katharopoulos , François Fleuret

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

Machine Learning · Computer Science 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

In this paper we construct a framework for doing statistical inference for discretely observed stochastic differential equations (SDEs) where the driving noise has 'memory'. Classical SDE models for inference assume the driving noise to be…

Methodology · Statistics 2013-07-05 Martin Lysy , Natesh S. Pillai

(Mini-batch) Stochastic Gradient Descent is a popular optimization method which has been applied to many machine learning applications. But a rather high variance introduced by the stochastic gradient in each step may slow down the…

Machine Learning · Computer Science 2018-10-09 Jingchang Liu , Linli Xu

Importance Sampling (IS) is a widely used variance reduction technique for enhancing the efficiency of Monte Carlo methods, particularly in rare-event simulation and related applications. Despite its effectiveness, the performance of IS is…

Optimization and Control · Mathematics 2026-02-11 Liviu Aolaritei , Bart P. G. Van Parys , Henry Lam , Michael I. Jordan

We consider stochastic partial differential equations (SPDEs) on the one-dimensional torus, driven by space-time white noise, and with a time-periodic drift term, which vanishes on two stable and one unstable equilibrium branches. Each of…

Probability · Mathematics 2024-02-27 Nils Berglund , Rita Nader