English
Related papers

Related papers: Avoiding subtraction and division of stochastic si…

200 papers

We study hard constraint satisfaction problems with a decimation approach based on message passing algorithms. Decimation induces a renormalization flow in the space of problems, and we exploit the fact that this flow transforms some of the…

Disordered Systems and Neural Networks · Physics 2010-05-11 Saburo Higuchi , Marc Mézard

Normalizing flows (NFs) provide a powerful tool to construct an expressive distribution by a sequence of trackable transformations of a base distribution and form a probabilistic model of underlying data. Rotation, as an important quantity…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Yulin Liu , Haoran Liu , Yingda Yin , Yang Wang , Baoquan Chen , He Wang

Efficient sampling of the Boltzmann distribution of molecular systems is a long-standing challenge. Recently, instead of generating long molecular dynamics simulations, generative machine learning methods such as normalizing flows have been…

Machine Learning · Computer Science 2024-08-06 Henrik Schopmans , Pascal Friederich

Fueled by the expressive power of deep neural networks, normalizing flows have achieved spectacular success in generative modeling, or learning to draw new samples from a distribution given a finite dataset of training samples. Normalizing…

Machine Learning · Computer Science 2023-05-05 Yuehaw Khoo , Michael Lindsey , Hongli Zhao

We provide a general framework for learning diffusion bridges that transport prior to target distributions. It includes existing diffusion models for generative modeling, but also underdamped versions with degenerate diffusion matrices,…

Machine Learning · Computer Science 2025-08-14 Denis Blessing , Julius Berner , Lorenz Richter , Gerhard Neumann

We introduce a novel stochastic regularization technique for deep neural networks, which decomposes a layer into multiple branches with different parameters and merges stochastically sampled combinations of the outputs from the branches…

Machine Learning · Computer Science 2019-10-04 Wonpyo Park , Paul Hongsuck Seo , Bohyung Han , Minsu Cho

When working with textual data, a natural application of disentangled representations is fair classification where the goal is to make predictions without being biased (or influenced) by sensitive attributes that may be present in the data…

Computation and Language · Computer Science 2022-10-10 Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Reinforcement Learning (RL) has recently emerged as a powerful technique for improving image and video generation in Diffusion and Flow Matching models, specifically for enhancing output quality and alignment with prompts. A critical step…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Feng Wang , Zihao Yu

Quantifying uncertainty in medical image segmentation applications is essential, as it is often connected to vital decision-making. Compelling attempts have been made in quantifying the uncertainty in image segmentation architectures, e.g.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 M. M. A. Valiuddin , C. G. A. Viviers , R. J. G. van Sloun , P. H. N. de With , F. van der Sommen

Molecular dynamics simulations are widely used across chemistry, physics, and biology, providing quantitative insight into complex processes with atomic detail. However, their limited timescale of a few microseconds is a significant…

Chemical Physics · Physics 2025-04-10 Ofir Blumer , Barak Hirshberg

Variational inference with normalizing flows (NFs) is an increasingly popular alternative to MCMC methods. In particular, NFs based on coupling layers (Real NVPs) are frequently used due to their good empirical performance. In theory,…

Machine Learning · Statistics 2024-02-27 Daniel Andrade

To enhance low-light images to normally-exposed ones is highly ill-posed, namely that the mapping relationship between them is one-to-many. Previous works based on the pixel-wise reconstruction losses and deterministic processes fail to…

Image and Video Processing · Electrical Eng. & Systems 2021-09-14 Yufei Wang , Renjie Wan , Wenhan Yang , Haoliang Li , Lap-Pui Chau , Alex C. Kot

Normalizing flows are flexible, parameterized distributions that can be used to approximate expectations from intractable distributions via importance sampling. However, current flow-based approaches are limited on challenging targets where…

Machine Learning · Computer Science 2022-03-15 Laurence Illing Midgley , Vincent Stimper , Gregor N. C. Simm , José Miguel Hernández-Lobato

Sampling from nonsmooth target probability distributions is essential in various applications, including the Bayesian Lasso. We propose a splitting-based sampling algorithm for the time-implicit discretization of the probability flow for…

Computation · Statistics 2025-07-14 Fuqun Han , Stanley Osher , Wuchen Li

Understanding the dynamics of complex molecular processes is often linked to the study of infrequent transitions between long-lived stable states. The standard approach to the sampling of such rare events is to generate an ensemble of…

Computational Physics · Physics 2023-05-22 Sebastian Falkner , Alessandro Coretti , Salvatore Romano , Phillip Geissler , Christoph Dellago

In this manuscript, a purely data driven statistical regularization method is proposed for extracting the information from big data with randomly distributed noise. Since the variance of the noise maybe large, the method can be regarded as…

Numerical Analysis · Mathematics 2021-02-19 Jin Cheng , Jiantang Zhang , Min Zhong

Varied sensory systems use noise in order to enhance detection of weak signals. It has been conjectured in the literature that this effect, known as stochastic resonance, may take place in central cognitive processes such as the memory…

Neurons and Cognition · Quantitative Biology 2007-05-23 Julien Mayor , Wulfram Gerstner

Regularization of deep neural networks has been an important issue to achieve higher generalization performance without overfitting problems. Although the popular method of Dropout provides a regularization effect, it causes inconsistent…

Machine Learning · Computer Science 2024-09-26 Bum Jun Kim , Sang Woo Kim

In recent years, the paradigm of cloud computing has emerged as an architecture for computing that makes use of distributed (networked) computing resources. In this paper, we consider a distributed computing algorithmic scheme for…

Optimization and Control · Mathematics 2017-09-22 Shi Pu , Alfredo Garcia

Stochastic resonance is a non-linear phenomenon, in which the sensitivity of signal detectors can be enhanced by adding random noise to the detector input. Here, we demonstrate that noise can also improve the information flux in recurrent…

Neurons and Cognition · Quantitative Biology 2018-11-30 Patrick Krauss , Karin Prebeck , Achim Schilling , Claus Metzner