English
Related papers

Related papers: Invertible Gaussian Reparameterization: Revisiting…

200 papers

The mollified uniform distribution is rediscovered, which constitutes a ``soft'' version of the continuous uniform distribution. Important stochastic properties are presented and used to demonstrate potential fields of applications. For…

Methodology · Statistics 2024-12-02 Christian H. Weiß

SoftMax is a ubiquitous ingredient of modern machine learning algorithms. It maps an input vector onto a probability simplex and reweights the input by concentrating the probability mass at large entries. Yet, as a smooth approximation to…

Machine Learning · Computer Science 2025-01-09 Yuxuan Zhou , Mario Fritz , Margret Keuper

Despite the frequent use of agent-based models (ABMs) for studying social phenomena, parameter estimation remains a challenge, often relying on costly simulation-based heuristics. This work uses variational inference to estimate the…

Computers and Society · Computer Science 2025-12-04 Jacopo Lenti , Fabrizio Silvestri , Gianmarco De Francisci Morales

The particle-in-cell numerical method of plasma physics balances a trade-off between computational cost and intrinsic noise. Inference on data produced by these simulations generally consists of binning the data to recover the particle…

Plasma Physics · Physics 2022-02-03 John Donaghy , Kai Germaschewski

The reparameterization trick enables optimizing large scale stochastic computation graphs via gradient descent. The essence of the trick is to refactor each stochastic node into a differentiable function of its parameters and a random…

Machine Learning · Computer Science 2017-03-07 Chris J. Maddison , Andriy Mnih , Yee Whye Teh

The reparameterization trick has become one of the most useful tools in the field of variational inference. However, the reparameterization trick is based on the standardization transformation which restricts the scope of application of…

Machine Learning · Computer Science 2020-02-26 Anbang Wu , Shuangxi Chen , Chunming Wu

Diffusion models have recently shown remarkable results in magnetic resonance imaging reconstruction. However, the employed networks typically are black-box estimators of the (smoothed) prior score with tens of millions of parameters,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-16 Laurenz Nagler , Martin Zach , Thomas Pock

Scarcity of hydrocarbon resources and high exploration risks motivate the development of high fidelity algorithms and computationally viable approaches to exploratory geophysics. Whereas early approaches considered least-squares…

Optimization and Control · Mathematics 2015-04-21 Stephen Becker , Lior Horesh , Aleksandr Aravkin , Sergiy Zhuk

Probabilistic smoothing is a standard tool for global optimization, but existing methods rely on Gaussian kernels and specific transforms, often resulting in strong hyperparameter sensitivity and limited robustness. We propose a general…

Machine Learning · Computer Science 2026-05-27 Kukyoung Jang , Taehyun Cho , Junrui Zhang , Ping Xu , Kyungjae Lee

The generalized inverse Gaussian, denoted $\mathrm{GIG}(p, a, b)$, is a flexible family of distributions that includes the gamma, inverse gamma, and inverse Gaussian distributions as special cases. In addition to its applications in…

Computation · Statistics 2025-01-28 Victor Peña , Michael Jauch

Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions,…

Machine Learning · Statistics 2021-07-15 Wenqi Fang , Guanlin Wu , Jingjing Li , Zheng Wang , Jiang Cao , Yang Ping

We consider nonparametric Bayesian estimation inference using a rescaled smooth Gaussian field as a prior for a multidimensional function. The rescaling is achieved using a Gamma variable and the procedure can be viewed as choosing an…

Statistics Theory · Mathematics 2009-08-26 A. W. van der Vaart , J. H. van Zanten

Diverse human motion prediction aims at predicting multiple possible future pose sequences from a sequence of observed poses. Previous approaches usually employ deep generative networks to model the conditional distribution of data, and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Lingwei Dang , Yongwei Nie , Chengjiang Long , Qing Zhang , Guiqing Li

The increasing availability of sensing techniques provides a great opportunity for engineers to design state estimation methods, which are optimal for the system under observation and the observed noise patterns. However, these patterns…

Systems and Control · Electrical Eng. & Systems 2023-06-19 Jean-Sébastien Brouillon , Florian Dörfler , Giancarlo Ferrari-Trecate

We study the finite-size scaling of the roughness of signals in systems displaying Gaussian 1/f power spectra. It is found that one of the extreme value distributions (Gumbel distribution) emerges as the scaling function when the boundary…

Statistical Mechanics · Physics 2009-11-07 T. Antal , M. Droz , G. Gyorgyi , Z. Racz

Granular jamming is a popular soft robotics technology that has seen recent widespread applications including industrial gripping, surgical robotics and haptics. However, to date the field has not fully exploited the fundamental science of…

Soft Condensed Matter · Physics 2021-09-23 Raghav Mishra , Tyson Philips , Gary W. Delaney , David Howard

Granular jamming has recently become popular in soft robotics with widespread applications including industrial gripping, surgical robotics and haptics. Previous work has investigated the use of various techniques that exploit the nature of…

Robotics · Computer Science 2022-12-14 Cameron Coombe , James Brett , Raghav Mishra , Gary W. Delaney , David Howard

While deep generative models have succeeded in image processing, natural language processing, and reinforcement learning, training that involves discrete random variables remains challenging due to the high variance of its gradient…

Machine Learning · Computer Science 2022-06-16 Ting-Han Fan , Ta-Chung Chi , Alexander I. Rudnicky , Peter J. Ramadge

Based on our recent findings regarding (non-)renormalizability of non-commutative U*(1) gauge theories [arxiv:0908.0467, arxiv:0908.1743] we present the construction of a new type of model. By introducing a soft breaking term in such a way…

High Energy Physics - Theory · Physics 2014-11-20 Daniel N. Blaschke , Arnold Rofner , Rene I. P. Sedmik , Michael Wohlgenannt

Soft extrapolation refers to the problem of recovering a function from its samples, multiplied by a fast-decaying window and perturbed by an additive noise, over an interval which is potentially larger than the essential support of the…

Numerical Analysis · Mathematics 2018-12-26 Dmitry Batenkov , Laurent Demanet , Hrushikesh N. Mhaskar