中文
相关论文

相关论文: Structured Black Box Variational Inference for Lat…

200 篇论文

The finite invert Beta-Liouville mixture model (IBLMM) has recently gained some attention due to its positive data modeling capability. Under the conventional variational inference (VI) framework, the analytically tractable solution to the…

机器学习 · 计算机科学 2021-12-30 Yongfa Ling , Wenbo Guan , Qiang Ruan , Heping Song , Yuping Lai

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

机器学习 · 计算机科学 2020-11-18 Minyoung Kim , Vladimir Pavlovic

We propose a new variational inference algorithm for learning in Gaussian Process State-Space Models (GPSSMs). Our algorithm enables learning of unstable and partially observable systems, where previous algorithms fail. Our main algorithmic…

机器学习 · 计算机科学 2020-06-11 Silvan Melchior , Sebastian Curi , Felix Berkenkamp , Andreas Krause

We develop a general optimization-theoretic framework for Bregman-Variational Learning Dynamics (BVLD), a new class of operator-based updates that unify Bayesian inference, mirror descent, and proximal learning under time-varying…

最优化与控制 · 数学 2025-10-24 Jinho Cha , Youngchul Kim , Jungmin Shin , Jaeyoung Cho , Seon Jin Kim , Junyeol Ryu

Stationary time series models built from parametric distributions are, in general, limited in scope due to the assumptions imposed on the residual distribution and autoregression relationship. We present a modeling approach for univariate…

统计方法学 · 统计学 2016-05-04 Maria DeYoreo , Athanasios Kottas

We present a probabilistic language model for time-stamped text data which tracks the semantic evolution of individual words over time. The model represents words and contexts by latent trajectories in an embedding space. At each moment in…

机器学习 · 统计学 2017-07-19 Robert Bamler , Stephan Mandt

Geoscientists use observed data to estimate properties of the Earth's interior. This often requires non-linear inverse problems to be solved and uncertainties to be estimated. Bayesian inference solves inverse problems under a probabilistic…

地球物理 · 物理学 2024-01-01 Xuebin Zhao , Andrew Curtis

Black-box alpha (BB-$\alpha$) is a new approximate inference method based on the minimization of $\alpha$-divergences. BB-$\alpha$ scales to large datasets because it can be implemented using stochastic gradient descent. BB-$\alpha$ can be…

Latent Factor Model (LFM) is one of the most successful methods for Collaborative filtering (CF) in the recommendation system, in which both users and items are projected into a joint latent factor space. Base on matrix factorization…

信息检索 · 计算机科学 2021-05-19 Jiansheng Fang , Xiaoqing Zhang , Yan Hu , Yanwu Xu , Ming Yang , Jiang Liu

The Kalman filter is an algorithm for the estimation of hidden variables in dynamical systems under linear Gauss-Markov assumptions with widespread applications across different fields. Recently, its Bayesian interpretation has received a…

神经元与认知 · 定量生物学 2021-11-23 Manuel Baltieri , Takuya Isomura

Current methods for learning graphical models with latent variables and a fixed structure estimate optimal values for the model parameters. Whereas this approach usually produces overfitting and suboptimal generalization performance,…

机器学习 · 计算机科学 2013-01-30 Hagai Attias

Variational Autoencoder (VAE) is widely used as a generative model to approximate a model's posterior on latent variables by combining the amortized variational inference and deep neural networks. However, when paired with strong…

机器学习 · 计算机科学 2020-06-02 Qile Zhu , Jianlin Su , Wei Bi , Xiaojiang Liu , Xiyao Ma , Xiaolin Li , Dapeng Wu

We introduce a gradient-free framework for Bayesian Optimal Experimental Design (BOED) in sequential settings, aimed at complex systems where gradient information is unavailable. Our method combines Ensemble Kalman Inversion (EKI) for…

机器学习 · 统计学 2025-09-22 Robert Gruhlke , Matei Hanu , Claudia Schillings , Philipp Wacker

Optimizing high-dimensional black-box functions under black-box constraints is a pervasive task in a wide range of scientific and engineering problems. These problems are typically harder than unconstrained problems due to hard-to-find…

机器学习 · 计算机科学 2026-05-08 Kiyoung Om , Kyuil Sim , Taeyoung Yun , Hyeongyu Kang , Jinkyoo Park

Factors models are routinely used to analyze high-dimensional data in both single-study and multi-study settings. Bayesian inference for such models relies on Markov Chain Monte Carlo (MCMC) methods which scale poorly as the number of…

统计方法学 · 统计学 2025-04-29 Blake Hansen , Alejandra Avalos-Pacheco , Massimiliano Russo , Roberta De Vito

We introduce a method combining variational autoencoders (VAEs) and deep metric learning to perform Bayesian optimisation (BO) over high-dimensional and structured input spaces. By adapting ideas from deep metric learning, we use label…

Modern neural network architectures have achieved remarkable accuracies but remain highly dependent on their training data, often lacking interpretability in their learned mappings. While effective on large datasets, they tend to overfit on…

机器学习 · 计算机科学 2025-03-19 Pavia Bera , Sanjukta Bhanja

This paper proposes a nonparametric Bayesian method for exploratory data analysis and feature construction in continuous time series. Our method focuses on understanding shared features in a set of time series that exhibit significant…

机器学习 · 统计学 2010-08-13 Suchi Saria , Daphne Koller , Anna Penn

We consider continuous-time diffusion models driven by fractional Brownian motion. Observations are assumed to possess a non-trivial likelihood given the latent path. Due to the non-Markovianity and high-dimensionality of the latent paths,…

统计方法学 · 统计学 2015-03-25 Alexandros Beskos , Joseph Dureau , Konstantinos Kalogeropoulos