English
Related papers

Related papers: Collapsed Variational Bayes Inference of Infinite …

200 papers

Concept Bottleneck Models (CBMs) map the black-box visual representations extracted by deep neural networks onto a set of interpretable concepts and use the concepts to make predictions, enhancing the transparency of the decision-making…

Machine Learning · Computer Science 2024-04-18 Chenming Shang , Shiji Zhou , Hengyuan Zhang , Xinzhe Ni , Yujiu Yang , Yuwang Wang

Bayesian neural networks (BNNs) provide a formalism to quantify and calibrate uncertainty in deep learning. Current inference approaches for BNNs often resort to few-sample estimation for scalability, which can harm predictive performance,…

Machine Learning · Computer Science 2024-02-14 Zhe Zeng , Guy Van den Broeck

Developing efficient solutions for inference problems in intelligent sensor networks is crucial for the next generation of location, tracking, and mapping services. This paper develops a scalable distributed probabilistic inference…

Machine Learning · Computer Science 2023-10-24 Parth Paritosh , Nikolay Atanasov , Sonia Martinez

This study introduces an iterative Bayesian Robbins--Monro (IBRM) sequence, which unites the classical Robbins--Monro sequence with statistical estimation for faster root-finding under noisy observations. Although the standard…

Optimization and Control · Mathematics 2025-08-19 Siwei Liu , Ke Ma , Stephan M. Goetz

Linear regression with measurement error in the covariates is a heavily studied topic, however, the statistics/econometrics literature is almost silent to estimating a multi-equation model with measurement error. This paper considers a…

Methodology · Statistics 2020-06-15 Georges Bresson , Anoop Chaturvedi , Mohammad Arshad Rahman , Shalabh

This paper provides a comprehensive analysis of variational inference in latent variable models for survival analysis, emphasizing the distinctive challenges associated with applying variational methods to survival data. We identify a…

Machine Learning · Computer Science 2025-06-05 Chuanhui Liu , Xiao Wang

Restricted Boltzmann Machine (RBM) is an importan- t generative model modeling vectorial data. While applying an RBM in practice to images, the data have to be vec- torized. This results in high-dimensional data and valu- able spatial…

Computer Vision and Pattern Recognition · Computer Science 2016-01-06 Guanglei Qi , Yanfeng Sun , Junbin Gao , Yongli Hu , Jinghua Li

Estimating time-varying reproduction numbers from epidemic incidence data is a central task in infectious disease surveillance, yet it poses an inherently ill-posed inverse problem. Existing approaches often rely on strong structural…

Machine Learning · Computer Science 2026-03-19 Lanlan Yu , Quan-Hui Liu , Haoyue Zheng , Xinfu Yang

Concept Bottleneck Models (CBMs) first map raw input(s) to a vector of human-defined concepts, before using this vector to predict a final classification. We might therefore expect CBMs capable of predicting concepts based on distinct…

Artificial Intelligence · Computer Science 2023-02-08 Jack Furby , Daniel Cunnington , Dave Braines , Alun Preece

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

A restricted Boltzmann machine (RBM) is a two-layer neural network with shared weights and has been extensively studied for dimensionality reduction, data representation and recommendation systems in the literature. The traditional RBM…

Machine Learning · Computer Science 2026-05-27 Jiangsheng You , Chun-Yen Liu

Bayesian posterior distributions naturally represent parameter uncertainty informed by data. However, when the parameter space is complex, as in many nonparametric settings where it is infinite-dimensional or combinatorially large, standard…

Methodology · Statistics 2025-12-22 Nicola Bariletto , Nhat Ho , Alessandro Rinaldo

Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) are two risk measures which are widely used in the practice of risk management. This paper deals with the problem of computing both VaR and CVaR using stochastic approximation (with…

Computational Finance · Quantitative Finance 2010-12-06 Olivier Aj Bardou , Noufel Frikha , G. Pagès

Penalized likelihood and quasi-likelihood methods dominate inference in high-dimensional linear mixed-effects models. Sampling-based Bayesian inference is less explored due to the computational bottlenecks introduced by the random effects…

Methodology · Statistics 2025-07-24 Sreya Sarkar , Kshitij Khare , Sanvesh Srivastava

Many modern data analyses benefit from explicitly modeling dependence structure in data -- such as measurements across time or space, ordered words in a sentence, or genes in a genome. A gold standard evaluation technique is structured…

Machine Learning · Statistics 2020-12-02 Soumya Ghosh , William T. Stephenson , Tin D. Nguyen , Sameer K. Deshpande , Tamara Broderick

This study investigates the efficacy of Conditional Restricted Boltzmann Machines (CRBMs) for modeling high-dimensional financial time series and detecting systemic risk regimes. We extend the classical application of static Restricted…

Statistical Finance · Quantitative Finance 2026-01-01 Siddhartha Srinivas Rentala

Deep learning representations are often difficult to interpret, which can hinder their deployment in sensitive applications. Concept Bottleneck Models (CBMs) have emerged as a promising approach to mitigate this issue by learning…

Machine Learning · Computer Science 2026-01-30 Antonio Almudévar , José Miguel Hernández-Lobato , Alfonso Ortega

In this paper we study variational inequalities (VI) defined by the conditional value-at-risk (CVaR) of uncertain functions. We introduce stochastic approximation schemes that employ an empirical estimate of the CVaR at each iteration to…

Optimization and Control · Mathematics 2020-08-28 Jasper Verbree , Ashish Cherukuri

We propose a novel unsupervised framework for \emph{Invariant Risk Minimization} (IRM), extending the concept of invariance to settings where labels are unavailable. Traditional IRM methods rely on labeled data to learn representations that…

Machine Learning · Computer Science 2026-03-05 Yotam Norman , Ron Meir

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the…

Machine Learning · Statistics 2017-12-22 Christian Donner , Manfred Opper