English
Related papers

Related papers: ReCAB-VAE: Gumbel-Softmax Variational Inference Ba…

200 papers

Recently, several deep learning methods are proposed for the gravitational wave data analysis. One is conditional variational auto encoder (CVAE), proposed by Gabbard et al. [1]. We study the accuracy of a CVAE in the context of the…

General Relativity and Quantum Cosmology · Physics 2020-02-28 Takahiro S. Yamamoto , Takahiro Tanaka

Approximate Bayesian Computation (ABC) is a popular sampling method in applications involving intractable likelihood functions. Without evaluating the likelihood function, ABC approximates the posterior distribution by the set of accepted…

Computation · Statistics 2017-08-17 Jin Zhou , Kenji Fukumizu

This paper explores the possibility of establishing an analytic form of the distribution of the order parameter fluctuations in a two-dimensional critical spin wave model, or width fluctuations of a two dimensional Edwards-Wilkinson…

Statistical Mechanics · Physics 2022-04-13 Steven T. Bramwell

A new method called "variational sampling" is proposed to estimate integrals under probability distributions that can be evaluated up to a normalizing constant. The key idea is to fit the target distribution with an exponential family model…

Computation · Statistics 2013-10-15 Alexis Roche

In indoor scenes, reverberation is a crucial factor in degrading the perceived quality and intelligibility of speech. In this work, we propose a generative dereverberation method. Our approach is based on a probabilistic model utilizing a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-18 Pengyu Wang , Xiaofei Li

Discrete diffusion models have recently emerged as a promising alternative to the autoregressive approach for generating discrete sequences. Sample generation via gradual denoising or demasking processes allows them to capture hierarchical…

Variational Auto-encoders (VAEs) have been very successful as methods for forming compressed latent representations of complex, often high-dimensional, data. In this paper, we derive an alternative variational lower bound from the one…

Machine Learning · Computer Science 2019-03-20 Shuyu Lin , Ronald Clark , Robert Birke , Niki Trigoni , Stephen Roberts

Mixture distributions arise in many application areas, for example as marginal distributions or convolutions of distributions. We present a method of constructing an easily tractable discrete mixture distribution as an approximation to a…

Computation · Statistics 2017-02-20 Christian Röver , Tim Friede

We study the statistical distribution of the closest encounter between generic smooth observations computed along different trajectories of a rapidly mixing dynamical system. At the limit of large trajectories, we obtain a distribution of…

Chaotic Dynamics · Physics 2022-08-31 Theophile Caby

A new form of variational autoencoder (VAE) is developed, in which the joint distribution of data and codes is considered in two (symmetric) forms: ($i$) from observed data fed through the encoder to yield codes, and ($ii$) from latent…

Machine Learning · Computer Science 2017-11-21 Yunchen Pu , Weiyao Wang , Ricardo Henao , Liqun Chen , Zhe Gan , Chunyuan Li , Lawrence Carin

Data-driven predictive control promises model-free wave-dampening strategies for Connected and Autonomous Vehicles (CAVs) in mixed traffic flow. However, its performance relies on data quality, which suffers from unknown noise and…

Systems and Control · Electrical Eng. & Systems 2024-10-03 Shuai Li , Chaoyi Chen , Haotian Zheng , Jiawei Wang , Qing Xu , Keqiang Li

Operational risk capital estimation under Basel II/III requires quantifying aggregate losses at extreme confidence levels of 99.9% and beyond, yet the standard Loss Distribution Approach (LDA) assumes independence between loss frequency and…

Computational Engineering, Finance, and Science · Computer Science 2026-05-25 Juan Ballesteros Gómez , Eduardo C. Garrido-Merchán , Pedro Pablo Pérez-Velasco

In Emotion Recognition in Conversations (ERC), the emotions of target utterances are closely dependent on their context. Therefore, existing works train the model to generate the response of the target utterance, which aims to recognise…

Computation and Language · Computer Science 2023-05-30 Kailai Yang , Tianlin Zhang , Sophia Ananiadou

Retrieval-Augmented Generation (RAG) has become critical for knowledge-intensive applications, yet evaluating its performance in vertical domains remains difficult due to domain complexity, diverse context scales, and heavy reliance on…

Computation and Language · Computer Science 2026-05-27 Jingbin Qian , Congwen Yi , Min Xia , Wen Wu , Jun Zhu , Jian Guan

Estimating a distribution given access to its unnormalized density is pivotal in Bayesian inference, where the posterior is generally known only up to an unknown normalizing constant. Variational inference and Markov chain Monte Carlo…

Machine Learning · Statistics 2025-05-06 Daniel Ward , Mark Beaumont , Matteo Fasiolo

In the loss function of Variational Autoencoders there is a well known tension between two components: the reconstruction loss, improving the quality of the resulting images, and the Kullback-Leibler divergence, acting as a regularizer of…

Neural and Evolutionary Computing · Computer Science 2020-02-19 Andrea Asperti , Matteo Trentin

We present Re-weighted Gradient Descent (RGD), a novel optimization technique that improves the performance of deep neural networks through dynamic sample re-weighting. Leveraging insights from distributionally robust optimization (DRO)…

Machine Learning · Computer Science 2024-10-15 Ramnath Kumar , Kushal Majmundar , Dheeraj Nagaraj , Arun Sai Suggala

This paper proposes a new family of lower and upper bounds on the minimum mean squared error (MMSE). The key idea is to minimize/maximize the MMSE subject to the constraint that the joint distribution of the input-output statistics lies in…

Information Theory · Computer Science 2020-06-09 Michael Fauß , Alex Dysto , H. Vincent Poor

Poisson-distributed latent variable models are widely used in computational neuroscience, but differentiating through discrete stochastic samples remains challenging. Two approaches address this: Exponential Arrival Time (EAT) simulation…

Machine Learning · Statistics 2026-02-05 Michael Ibrahim , Hanqi Zhao , Eli Sennesh , Zhi Li , Anqi Wu , Jacob L. Yates , Chengrui Li , Hadi Vafaii

We propose $\nabla$-RANSAC, a generalized differentiable RANSAC that allows learning the entire randomized robust estimation pipeline. The proposed approach enables the use of relaxation techniques for estimating the gradients in the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Tong Wei , Yash Patel , Alexander Shekhovtsov , Jiri Matas , Daniel Barath