English
Related papers

Related papers: Mode Collapse of Mean-Field Variational Inference

200 papers

Missing values often limit the usage of data analysis or cause falsification of results. Therefore, methods of missing value imputation (MVI) are of great significance. However, in general, there is no universal, fair MVI method for…

Databases · Computer Science 2025-07-29 Valerie Restat , Kai Tejkl , Uta Störl

This paper concerns a posteriori error analysis for the streamline diffusion (SD) finite element method for the one and one-half dimensional relativistic Vlasov-Maxwell system. The SD scheme yields a weak formulation, that corresponds to an…

Numerical Analysis · Mathematics 2016-12-23 Mohammad Asadzadeh , Christoffer Standar

The multivariate coefficient of variation (MCV) is an attractive and easy-to-interpret effect size for the dispersion in multivariate data. Recently, the first inference methods for the MCV were proposed by Ditzhaus and Smaga (2022) for…

Methodology · Statistics 2023-01-31 Marc Ditzhaus , Łukasz Smaga

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

Computation · Statistics 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

Sampling-based Model Predictive Control (MPC) has been a practical and effective approach in many domains, notably model-based reinforcement learning, thanks to its flexibility and parallelizability. Despite its appealing empirical…

Machine Learning · Computer Science 2024-01-17 Zeji Yi , Chaoyi Pan , Guanqi He , Guannan Qu , Guanya Shi

Purpose: Field monitoring measures field perturbations, which can be accounted for during image reconstructions. In certain field monitoring environments, significant phase deviations can arise far from isocenter due to the finite extent of…

Medical Physics · Physics 2023-01-25 Paul I. Dubovan , Kyle M. Gilbert , Corey A. Baron

Semi-implicit variational inference (SIVI) enhances the expressiveness of variational families through hierarchical semi-implicit distributions, but the intractability of their densities makes standard ELBO-based optimization biased. Recent…

Machine Learning · Statistics 2026-01-21 Longlin Yu , Ziheng Cheng , Shiyue Zhang , Cheng Zhang

In this paper, we propose CI-VI an efficient and scalable solver for semi-implicit variational inference (SIVI). Our method, first, maps SIVI's evidence lower bound (ELBO) to a form involving a nonlinear functional nesting of expected…

Machine Learning · Computer Science 2021-01-18 Vincent Moens , Hang Ren , Alexandre Maraval , Rasul Tutunov , Jun Wang , Haitham Ammar

We propose the Multiple Changepoint Isolation (MCI) method for detecting multiple changes in the mean and covariance of a functional process. We first introduce a pair of projections to represent the variability "between" and "within" the…

Methodology · Statistics 2021-10-22 Trevor Harris , Bo Li , James Derek Tucker

Constraint inference is widely considered essential to align reinforcement learning agents with safety boundaries and operational guidelines by observing expert demonstrations. However, existing approaches typically assume homogeneous…

Artificial Intelligence · Computer Science 2026-05-11 Syed Ihtesham Hussain Shah , Floris den Hengst , Aneta Lisowska , Annette ten Teije

Bayesian finite mixture models can identify discrete risk clusters (low-risk vs. high-risk equipment), but face three critical bottlenecks: (1) insufficient degradation signals from coarse state discretization, (2) unstable cluster…

Machine Learning · Computer Science 2026-04-29 Takato Yasuno

In this paper we propose a novel algorithm, factored value iteration (FVI), for the approximate solution of factored Markov decision processes (fMDPs). The traditional approximate value iteration algorithm is modified in two ways. For one,…

Artificial Intelligence · Computer Science 2008-08-13 Istvan Szita , Andras Lorincz

We propose a formulation of full-wavefield inversion (FWI) as a constrained optimization problem, and describe a computationally efficient technique for solving constrained full-wavefield inversion (CFWI). The technique is based on using a…

Geophysics · Physics 2014-10-28 Musa Maharramov , Biondo Biondi

Full waveform inversion (FWI) is a powerful yet computationally expensive technique that can yield subsurface models at high resolution. Randomly selected shots ("mini-batches") can be used to approximate the misfit and the gradient of FWI,…

Geophysics · Physics 2020-05-25 Bharath Shekar

Estimating confidence intervals in small or noisy datasets is a challenge in biomolecular research when data contain outliers or high variability. We introduce a robust method combining a hybrid bootstrap procedure with Steiner's most…

Nuclear Experiment · Physics 2025-11-04 Victor V. Golovko

Despite the popularity of feature importance (FI) measures in interpretable machine learning, the statistical adequacy of these methods is rarely discussed. From a statistical perspective, a major distinction is between analyzing a…

Machine Learning · Statistics 2023-05-03 Kristin Blesch , David S. Watson , Marvin N. Wright

I present an analytic method for estimating the errors in fitting a distribution. A well-known theorem from statistics gives the minimum variance bound (MVB) for the uncertainty in estimating a set of parameters $\l_i$, when a distribution…

Astrophysics · Physics 2009-10-22 Andrew Gould

Particle-based Variational Inference (ParVI) methods approximate the target distribution by iteratively evolving finite weighted particle systems. Recent advances of ParVI methods reveal the benefits of accelerated position update…

Machine Learning · Computer Science 2023-12-29 Fangyikang Wang , Huminhao Zhu , Chao Zhang , Hanbin Zhao , Hui Qian

We present an approach to identify a quasi Linear Parameter Varying (qLPV) model of a plant, with the qLPV model guaranteed to admit a robust control invariant (RCI) set. It builds upon the concurrent synthesis framework presented in [1],…

Optimization and Control · Mathematics 2025-05-13 Sampath Kumar Mulagaleti , Alberto Bemporad

Automatic Differentiation Variational Inference (ADVI) is efficient in learning probabilistic models. Classic ADVI relies on the parametric approach to approximate the posterior. In this paper, we develop a spline-based nonparametric…

Machine Learning · Statistics 2024-03-12 Yuda Shao , Shan Yu , Tianshu Feng