English
Related papers

Related papers: Heavy-Tailed Diffusion with Denoising L\'evy Proba…

200 papers

Removing the shape noise from the observed weak lensing field, i.e., denoising, enhances the potential of WL by accessing information at small scales where the shape noise dominates without denoising. We utilise two machine learning (ML)…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-13 Shohei D. Aoyama , Ken Osato , Masato Shirasaki

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

Machine Learning · Statistics 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

The gradient noise (GN) in the stochastic gradient descent (SGD) algorithm is often considered to be Gaussian in the large data regime by assuming that the \emph{classical} central limit theorem (CLT) kicks in. This assumption is often made…

Machine Learning · Statistics 2019-12-03 Umut Şimşekli , Mert Gürbüzbalaban , Thanh Huy Nguyen , Gaël Richard , Levent Sagun

Diffusion models are often introduced from multiple perspectives, such as VAEs, score matching, or flow matching, accompanied by dense and technically demanding mathematics that can be difficult for beginners to grasp. One classic question…

Machine Learning · Computer Science 2026-04-14 Candi Zheng , Yuan Lan

We study parametric inference for ergodic diffusion processes with a degenerate diffusion matrix. Existing research focuses on a particular class of hypo-elliptic SDEs, with components split into `rough'/`smooth' and noise from rough…

Statistics Theory · Mathematics 2024-05-29 Yuga Iguchi , Alexandros Beskos , Matthew Graham

We propose a novel unpaired image-to-image translation method that uses denoising diffusion probabilistic models without requiring adversarial training. Our method, UNpaired Image Translation with Denoising Diffusion Probabilistic Models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hiroshi Sasaki , Chris G. Willcocks , Toby P. Breckon

Discrete diffusion models (DMs) have achieved strong performance in language and other discrete domains, offering a compelling alternative to autoregressive modeling. Yet this performance typically depends on large training datasets,…

Machine Learning · Computer Science 2026-04-16 Julian Kleutgens , Claudio Battiloro , Lingkai Kong , Benjamin Grewe , Francesca Dominici , Mauricio Tec

Deep learning algorithms have significantly reduced the computational time and improved the spatial resolution of particle image velocimetry~(PIV). However, the models trained on synthetic datasets might have a degraded performance on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Qianyu Zhu , Junjie Wang , Jeremiah Hu , Jia Ai , Yong Lee

Distributed methods are essential for handling machine learning pipelines comprising large-scale models and datasets. However, their benefits often come at the cost of increased communication overhead between the central server and agents,…

Machine Learning · Computer Science 2025-03-03 Enea Monzio Compagnoni , Rustem Islamov , Frank Norbert Proske , Aurelien Lucchi

Noise transition matrix (NTM) estimation is a promising approach for learning with label noise. It can infer clean posterior probabilities, known as Label Distribution (LD), based on noisy ones and reduce the impact of noisy labels.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zehui Liao , Shishuai Hu , Yutong Xie , Yong Xia

Artifact removal is critical for accurate analysis and interpretation of Electroencephalogram (EEG) signals. Traditional methods perform poorly with strong artifact-EEG correlations or single-channel data. Recent advances in diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-19 Feixue Shao , Xueyu Liu , Yongfei Wu , Jianbo Lu , Guiying Yan , Weihua Yang

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Haorui Ji , Taojun Lin , Hongdong Li

Diffusion models have become fundamental tools for modeling data distributions in machine learning. Despite their success, these models face challenges when generating data with extreme brightness values, as evidenced by limitations…

Machine Learning · Statistics 2026-04-10 Takuro Kutsuna

Deep Metric Learning (DML) is a group of techniques that aim to measure the similarity between objects through the neural network. Although the number of DML methods has rapidly increased in recent years, most previous studies cannot…

Machine Learning · Computer Science 2022-12-02 Chenkang Zhang , Lei Luo , Bin Gu

High-dimensional linear regression is a fundamental tool in modern statistics, particularly when the number of predictors exceeds the sample size. The classical Lasso, which relies on the squared loss, performs well under Gaussian noise…

Methodology · Statistics 2025-06-10 The Tien Mai

The gradient noise (GN) in the stochastic gradient descent (SGD) algorithm is often considered to be Gaussian in the large data regime by assuming that the classical central limit theorem (CLT) kicks in. This assumption is often made for…

Machine Learning · Computer Science 2019-01-21 Umut Simsekli , Levent Sagun , Mert Gurbuzbalaban

Score-based diffusion methods provide a powerful strategy to solve image restoration tasks by flexibly combining a pre-trained foundational prior model with a likelihood function specified during test time. Such methods are predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Charlesquin Kemajou Mbakam , Jean-Francois Giovannelli , Marcelo Pereyra

Reinforcement Learning from Human Feedback (RLHF) is increasingly used to fine-tune diffusion models, but a key challenge arises from the mismatch between stochastic samplers used during training and deterministic samplers used during…

Machine Learning · Computer Science 2025-12-17 Jiayuan Sheng , Hanyang Zhao , Haoxian Chen , David D. Yao , Wenpin Tang

Stepwise signals are ubiquitous in single-molecule detections, where abrupt changes in signal levels typically correspond to molecular conformational changes or state transitions. However, these features are inevitably obscured by noise,…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Xingdi Tong , Chenyu Wen

Score-based diffusion models generate samples from an unknown target distribution using a time-reversed diffusion process. While such models represent state-of-the-art approaches in industrial applications such as artificial image…

Machine Learning · Computer Science 2026-02-09 Adrian Baule