English
Related papers

Related papers: Divergence-Kernel method for scores of random syst…

200 papers

Neural Stochastic Differential Equations (NSDEs) model the drift and diffusion functions of a stochastic process as neural networks. While NSDEs are known to make accurate predictions, their uncertainty quantification properties have been…

Machine Learning · Computer Science 2022-09-13 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

Denoising Score Matching estimates the score of a noised version of a target distribution by minimizing a regression loss and is widely used to train the popular class of Denoising Diffusion Models. A well known limitation of Denoising…

Machine Learning · Computer Science 2024-02-14 Valentin De Bortoli , Michael Hutchinson , Peter Wirnsberger , Arnaud Doucet

In image processing, solving inverse problems is the task of finding plausible reconstructions of an image that was corrupted by some (usually known) degradation operator. Commonly, this process is done using a generative image model that…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Idan Achituve , Hai Victor Habi , Amir Rosenfeld , Arnon Netzer , Idit Diamant , Ethan Fetaya

Standard Monte Carlo computation is widely known to exhibit a canonical square-root convergence speed in terms of sample size. Two recent techniques, one based on control variate and one on importance sampling, both derived from an…

Computation · Statistics 2023-03-13 Henry Lam , Haofeng Zhang

We propose a sparse grid stochastic collocation method for long-time simulations of stochastic differential equations (SDEs) driven by white noise. The method uses pre-determined sparse quadrature rules for the forcing term and constructs…

Numerical Analysis · Mathematics 2017-06-13 H. Cagan Ozen , Guillaume Bal

Score-based diffusion models have significantly advanced generative deep learning for image processing. Measurement conditioned models have also been applied to inverse problems such as CT reconstruction. However, the conventional approach,…

Medical Physics · Physics 2025-02-24 Matthew Tivnan , Dufan Wu , Quanzheng Li

This study introduces a training-free conditional diffusion model for learning unknown stochastic differential equations (SDEs) using data. The proposed approach addresses key challenges in computational efficiency and accuracy for modeling…

Machine Learning · Computer Science 2024-10-07 Yanfang Liu , Yuan Chen , Dongbin Xiu , Guannan Zhang

In this work, we propose a novel end-to-end sinkhorn autoencoder with noise generator for efficient data collection simulation. Simulating processes that aim at collecting experimental data is crucial for multiple real-life applications,…

Machine Learning · Computer Science 2020-06-15 Kamil Deja , Jan Dubiński , Piotr Nowak , Sandro Wenzel , Tomasz Trzciński

Debiased collaborative filtering aims to learn an unbiased prediction model by removing different biases in observational datasets. To solve this problem, one of the simple and effective methods is based on the propensity score, which…

Information Retrieval · Computer Science 2024-05-01 Haoxuan Li , Chunyuan Zheng , Yanghao Xiao , Peng Wu , Zhi Geng , Xu Chen , Peng Cui

We propose a fast potential splitting Markov Chain Monte Carlo method which costs $O(1)$ time each step for sampling from equilibrium distributions (Gibbs measures) corresponding to particle systems with singular interacting kernels. We…

Computational Physics · Physics 2020-10-13 Lei Li , Zhenli Xu , Yue Zhao

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

Machine Learning · Statistics 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

Evaluating whether data streams are drawn from the same distribution is at the heart of various machine learning problems. This is particularly relevant for data generated by dynamical systems since such systems are essential for many…

Robust diffusion adaptive estimation algorithms based on the maximum correntropy criterion (MCC), including adaptation to combination MCC and combination to adaptation MCC, are developed to deal with the distributed estimation over network…

Machine Learning · Statistics 2016-02-04 Wentao Ma , Badong Chen , Jiandong Duan , Haiquan Zhao

With the advent of recent advances in unsupervised learning, efficient training of a deep network for image denoising without pairs of noisy and clean images has become feasible. However, most current unsupervised denoising methods are…

Image and Video Processing · Electrical Eng. & Systems 2020-12-08 Kanggeun Lee , Won-Ki Jeong

In presence of sparse noise we propose kernel regression for predicting output vectors which are smooth over a given graph. Sparse noise models the training outputs being corrupted either with missing samples or large perturbations. The…

Machine Learning · Statistics 2018-11-07 Arun Venkitaraman , Pascal Frossard , Saikat Chatterjee

In this paper, we prove the moderate deviations principle (MDP) for a general system of slow-fast dynamics. We provide a unified approach, based on weak convergence ideas and stochastic control arguments, that cover both the averaging and…

Probability · Mathematics 2017-06-02 Matthew R. Morse , Konstantinos Spiliopoulos

An algorithm called MUSIC-like algorithm was originally proposed as an alternative method to the MUltiple SIgnal Classification (MUSIC) algorithm for direction-of-arrival (DOA) estimation. Without requiring explicit model order estimation,…

Signal Processing · Electrical Eng. & Systems 2018-11-20 Narong Borijindargoon , Boon Poh Ng

We develop a biased Monte Carlo algorithm to measure probabilities of rare events in cluster-cluster aggregation for arbitrary collision kernels. Given a trajectory with a fixed number of collisions, the algorithm modifies both the waiting…

Statistical Mechanics · Physics 2023-05-24 Rahul Dandekar , R. Rajesh , V. Subashri , Oleg Zaboronski

The standard Kernel Quadrature method for numerical integration with random point sets (also called Bayesian Monte Carlo) is known to converge in root mean square error at a rate determined by the ratio $s/d$, where $s$ and $d$ encode the…

Machine Learning · Statistics 2017-08-01 Francois-Xavier Briol , Chris J. Oates , Jon Cockayne , Wilson Ye Chen , Mark Girolami

Score-based generative models (SGMs) aim at estimating a target data distribution by learning score functions using only noise-perturbed samples from the target.Recent literature has focused extensively on assessing the error between the…

Statistics Theory · Mathematics 2025-01-28 Stanislas Strasman , Antonio Ocello , Claire Boyer , Sylvain Le Corff , Vincent Lemaire