English
Related papers

Related papers: Scalable Random Feature Latent Variable Models

200 papers

Non-linear hierarchical models are commonly used in many disciplines. However, inference in the presence of non-nested effects and on large datasets is challenging and computationally burdensome. This paper provides two contributions to…

Methodology · Statistics 2021-10-22 Max Goplerud

In this paper, we propose an adaptive framework for the variable power of the fractional least mean square (FLMS) algorithm. The proposed algorithm named as robust variable power FLMS (RVP-FLMS) dynamically adapts the fractional power of…

Optimization and Control · Mathematics 2017-02-07 Jawwad Ahmad , Muhammad Usman , Shujaat Khan , Imran Naseem , Hassan Jamil Syed

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Variational Information Pursuit (V-IP) is a framework for making interpretable predictions by design by sequentially selecting a short chain of task-relevant, user-defined and interpretable queries about the data that are most informative…

Machine Learning · Computer Science 2023-08-25 Kwan Ho Ryan Chan , Aditya Chattopadhyay , Benjamin David Haeffele , Rene Vidal

Regression models are used for inference and prediction in a wide range of applications providing a powerful scientific tool for researchers and analysts from different fields. In many research fields the amount of available data as well as…

Methodology · Statistics 2018-06-08 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

In this paper we present BayesLDM, a system for Bayesian longitudinal data modeling consisting of a high-level modeling language with specific features for modeling complex multivariate time series data coupled with a compiler that can…

We study a mean-field spike and slab variational Bayes (VB) approximation to Bayesian model selection priors in sparse high-dimensional linear regression. Under compatibility conditions on the design matrix, oracle inequalities are derived…

Methodology · Statistics 2020-11-20 Kolyan Ray , Botond Szabo

The advancement and scaling of quantum technology has made the learning and identification of quantum systems and devices in highly-multidimensional parameter spaces a pressing task for a variety of applications. In many cases, the…

Quantum Physics · Physics 2026-04-20 Federico Belliardo , Erik M. Gauger , Tim H. Taminiau , Yoann Altmann , Cristian Bonato

In practical regression applications, multiple covariates are often measured, but not all may be associated with the response variable. Identifying and including only the relevant covariates in the model is crucial for improving prediction…

Methodology · Statistics 2026-03-10 Ana Carolina da Cruz , Camila P. E. de Souza , Pedro H. T. O. Sousa

Recent studies have raised significant concerns regarding the reliability of current mathematics benchmarks, highlighting issues such as simplistic design and potential data contamination. Consequently, developing a reliable benchmark that…

Computation and Language · Computer Science 2025-08-14 Zijin Hong , Hao Wu , Su Dong , Junnan Dong , Yilin Xiao , Yujing Zhang , Zhu Wang , Feiran Huang , Linyi Li , Hongxia Yang , Xiao Huang

We present the Mixed Likelihood Gaussian process latent variable model (GP-LVM), capable of modeling data with attributes of different types. The standard formulation of GP-LVM assumes that each observation is drawn from a Gaussian…

Machine Learning · Computer Science 2018-11-20 Samuel Murray , Hedvig Kjellström

This paper proposes and experimentally validates a Bayesian network model of a range finder adapted to dynamic environments. All modeling assumptions are rigorously explained, and all model parameters have a physical interpretation. This…

Artificial Intelligence · Computer Science 2014-01-16 Tinne De Laet , Joris De Schutter , Herman Bruyninckx

When a statistical model $\{P_{\theta} : \theta \in \Theta\}$ lacks analytically tractable likelihoods, parametric statistical inference based on data generated from an unknown underlying distribution $P$ can still be performed as long as…

Methodology · Statistics 2026-05-19 Peter Matthew Jacobs , Lekha Patel , Anirban Bhattacharya , Debdeep Pati

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

Machine Learning · Computer Science 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

We propose a robust and scalable variational Bayes (VB) framework designed to effectively handle contamination and outliers in dataset. Our approach partitions the data into $m$ disjoint subsets and formulates a joint optimization problem…

Methodology · Statistics 2025-12-16 Jiawei Yan , Ju Liu , Weidong Liu , Jiyuan Tu

Variational Bayes (VB) applied to latent Dirichlet allocation (LDA) has become the most popular algorithm for aspect modeling. While sufficiently successful in text topic extraction from large corpora, VB is less successful in identifying…

Machine Learning · Computer Science 2022-08-22 Rebecca M. C. Taylor , Johan A. du Preez

Regularization of inverse problems is of paramount importance in computational imaging. The ability of neural networks to learn efficient image representations has been recently exploited to design powerful data-driven regularizers. While…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Maud Biquard , Marie Chabert , Florence Genin , Christophe Latry , Thomas Oberlin

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive…

Large Language Models (LLMs) excel in natural language processing tasks but pose significant computational and memory challenges for edge deployment due to their intensive resource demands. This work addresses the efficiency of LLM…

Hardware Architecture · Computer Science 2025-07-02 Zhican Wang , Hongxiang Fan , Haroon Waris , Gang Wang , Zhenyu Li , Jianfei Jiang , Yanan Sun , Guanghui He

Despite exceptional predictive performance of Deep sequence models (DSMs), the main concern of their deployment centers around the lack of uncertainty awareness. In contrast, probabilistic models quantify the uncertainty associated with…

Machine Learning · Computer Science 2026-03-03 Wenlong Chen