English
Related papers

Related papers: Comparison and Bayesian Estimation of Feature Allo…

200 papers

Feature acquisition algorithms address the problem of acquiring informative features while balancing the costs of acquisition to improve the learning performances of ML models. Previous approaches have focused on calculating the expected…

Machine Learning · Computer Science 2022-12-23 Sungsoo Lim , Diego Klabjan , Mark Shapiro

We propose a Monte Carlo algorithm to sample from high dimensional probability distributions that combines Markov chain Monte Carlo and importance sampling. We provide a careful theoretical analysis, including guarantees on robustness to…

Computation · Statistics 2019-09-18 Giacomo Zanella , Gareth Roberts

The proliferation of complex, black-box AI models has intensified the need for techniques that can explain their decisions. Feature attribution methods have become a popular solution for providing post-hoc explanations, yet the field has…

Machine Learning · Computer Science 2025-11-13 Xinpeng Li , Kai Ming Ting

In this paper we discuss policy iteration methods for approximate solution of a finite-state discounted Markov decision problem, with a focus on feature-based aggregation methods and their connection with deep reinforcement learning…

Machine Learning · Computer Science 2018-08-23 Dimitri P. Bertsekas

Policy gradient methods have had great success in solving continuous control tasks, yet the stochastic nature of such problems makes deterministic value estimation difficult. We propose an approach which instead estimates a distribution by…

Machine Learning · Computer Science 2017-12-07 Peter Henderson , Thang Doan , Riashat Islam , David Meger

Bayesian estimation of Gaussian graphical models has proven to be challenging because the conjugate prior distribution on the Gaussian precision matrix, the G-Wishart distribution, has a doubly intractable partition function. Recent…

Neurons and Cognition · Quantitative Biology 2014-09-10 Max Hinne , Alex Lenkoski , Tom Heskes , Marcel van Gerven

We present a Bayesian method for feature selection in the presence of grouping information with sparsity on the between- and within group level. Instead of using a stochastic algorithm for parameter inference, we employ expectation…

Machine Learning · Statistics 2018-09-26 Edgar Steiger , Martin Vingron

Multi-state models of cancer natural history are widely used for designing and evaluating cancer early detection strategies. Calibrating such models against longitudinal data from screened cohorts is challenging, especially when fitting…

Computation · Statistics 2025-08-14 Raphael Morsomme , Shannon Holloway , Marc Ryser , Jason Xu

Model fitting is possibly the most extended problem in science. Classical approaches include the use of least-squares fitting procedures and maximum likelihood methods to estimate the value of the parameters in the model. However, in recent…

Instrumentation and Methods for Astrophysics · Physics 2022-04-12 J. Lopez-Santiago , L. Martino , J. Miguez , M. A. Vazquez

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

Computation · Statistics 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

A wide class of Bayesian models involve unidentifiable random matrices that display rotational ambiguity, with the Gaussian factor model being a typical example. A rich variety of Markov chain Monte Carlo (MCMC) algorithms have been…

Computation · Statistics 2024-08-16 Evan Poworoznek , Niccolo Anceschi , Federico Ferrari , David Dunson

In many domains, we are interested in analyzing the structure of the underlying distribution, e.g., whether one variable is a direct parent of the other. Bayesian model-selection attempts to find the MAP model and use its structure to…

Machine Learning · Computer Science 2013-01-18 Nir Friedman , Daphne Koller

Many tasks in data mining and related fields can be formalized as matching between objects in two heterogeneous domains, including collaborative filtering, link prediction, image tagging, and web search. Machine learning techniques,…

Machine Learning · Computer Science 2014-10-24 Jingbo Shang , Tianqi Chen , Hang Li , Zhengdong Lu , Yong Yu

Markov chain Monte Carlo methods are often deemed too computationally intensive to be of any practical use for big data applications, and in particular for inference on datasets containing a large number $n$ of individual data points, also…

Methodology · Statistics 2015-05-13 Rémi Bardenet , Arnaud Doucet , Chris Holmes

We present the Bayesian consensus filter (BCF) for tracking a moving target using a networked group of sensing agents and achieving consensus on the best estimate of the probability distributions of the target's states. Our BCF framework…

Optimization and Control · Mathematics 2016-10-14 Saptarshi Bandyopadhyay , Soon-Jo Chung

Stochastic reaction network models are often used to explain and predict the dynamics of gene regulation in single cells. These models usually involve several parameters, such as the kinetic rates of chemical reactions, that are not…

Computation · Statistics 2020-01-07 Thomas A. Catanach , Huy D. Vo , Brian Munsky

Matrix factorization is a common machine learning technique for recommender systems. Despite its high prediction accuracy, the Bayesian Probabilistic Matrix Factorization algorithm (BPMF) has not been widely used on large scale data because…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-12 Tom Vander Aa , Imen Chakroun , Tom Haber

Loss functions are a cornerstone of machine learning and the starting point of most algorithms. Statistics and Bayesian decision theory have contributed, via properness, to elicit over the past decades a wide set of admissible losses in…

Machine Learning · Computer Science 2020-11-06 Christian Walder , Richard Nock

The problem of sequentially maximizing the expectation of a function seeks to maximize the expected value of a function of interest without having direct control on its features. Instead, the distribution of such features depends on a given…

Machine Learning · Statistics 2022-10-26 Diego Martinez-Taboada , Dino Sejdinovic

Markov chain Monte Carlo algorithms play a key role in the Bayesian approach to phylogenetic inference. In this paper, we present the first theoretical work analyzing the rate of convergence of several Markov chains widely used in…

Populations and Evolution · Quantitative Biology 2007-05-23 Elchanan Mossel , Eric Vigoda