English
Related papers

Related papers: Marginal and Joint Cross-Entropies & Predictives f…

200 papers

Subjective Logic (SL) is one of well-known belief models that can explicitly deal with uncertain opinions and infer unknown opinions based on a rich set of operators of fusing multiple opinions. Due to high simplicity and applicability, SL…

Machine Learning · Computer Science 2019-10-15 Xujiang Zhao , Feng Chen , Jin-Hee Cho

A novel method for estimating Bayesian network (BN) parameters from data is presented which provides improved performance on test data. Previous research has shown the value of representing conditional probability distributions (CPDs) via…

Machine Learning · Computer Science 2013-01-14 Geoff A. Jarrad

Building robust online content recommendation systems requires learning complex interactions between user preferences and content features. The field has evolved rapidly in recent years from traditional multi-arm bandit and collaborative…

Information Retrieval · Computer Science 2018-05-08 Yoel Zeldes , Stavros Theodorakis , Efrat Solodnik , Aviv Rotman , Gil Chamiel , Dan Friedman

In this paper, we study the problem of efficient online reinforcement learning in the infinite horizon setting when there is an offline dataset to start with. We assume that the offline dataset is generated by an expert but with unknown…

Machine Learning · Computer Science 2024-02-05 Dengwang Tang , Rahul Jain , Botao Hao , Zheng Wen

Model-based deep learning (MBDL) is a powerful methodology for designing deep models to solve imaging inverse problems. MBDL networks can be seen as iterative algorithms that estimate the desired image using a physical measurement model and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Chicago Y. Park , Weijie Gan , Zihao Zou , Yuyang Hu , Zhixin Sun , Ulugbek S. Kamilov

Training deep neural networks (DNNs) in large-cluster computing environments is increasingly necessary, as networks grow in size and complexity. Local memory and processing limitations require robust data and model parallelism for crossing…

Machine Learning · Computer Science 2020-06-08 Russell J. Hewett , Thomas J. Grady

There has been increasing interest in modeling survival data using deep learning methods in medical research. In this paper, we proposed a Bayesian hierarchical deep neural networks model for modeling and prediction of survival data.…

Methodology · Statistics 2021-09-20 Dai Feng , Lili Zhao

In online reinforcement learning, data scarcity creates epistemic uncertainty that makes robustness important early in learning, whereas sufficient exploration is needed to learn the true-environment optimal policy. We study this…

Machine Learning · Computer Science 2026-05-26 Meichen Song , Yuhao Wang , Enlu Zhou

Reliable uncertainty estimation has become a crucial requirement for the industrial deployment of deep learning algorithms, particularly in high-risk applications such as autonomous driving and medical diagnosis. However, mainstream…

Machine Learning · Computer Science 2024-09-10 Junyu Gao , Mengyuan Chen , Liangyu Xiang , Changsheng Xu

Predicting bioactivity and physical properties of small molecules is a central challenge in drug discovery. Deep learning is becoming the method of choice but studies to date focus on mean accuracy as the main metric. However, to replace…

Machine Learning · Computer Science 2019-07-26 Yao Zhang , Alpha A. Lee

Inference on modern Bayesian Neural Networks (BNNs) often relies on a variational inference treatment, imposing violated assumptions of independence and the form of the posterior. Traditional MCMC approaches avoid these assumptions at the…

Machine Learning · Statistics 2026-04-07 Ethan Goan , Dimitri Perrin , Kerrie Mengersen , Clinton Fookes

People believe that depth plays an important role in success of deep neural networks (DNN). However, this belief lacks solid theoretical justifications as far as we know. We investigate role of depth from perspective of margin bound. In…

Machine Learning · Computer Science 2015-12-01 Shizhao Sun , Wei Chen , Liwei Wang , Xiaoguang Liu , Tie-Yan Liu

A Bayesian framework is attractive in the context of prediction, but a fast recursive update of the predictive distribution has apparently been out of reach, in part because Monte Carlo methods are generally used to compute the predictive.…

Methodology · Statistics 2018-12-11 P. Richard Hahn , Ryan Martin , Stephen G. Walker

Accurate motion prediction of surrounding traffic participants is crucial for the safe and efficient operation of automated vehicles in dynamic environments. Marginal prediction models commonly forecast each agent's future trajectories…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Fabian Konstantinidis , Ariel Dallari Guerreiro , Raphael Trumpp , Moritz Sackmann , Ulrich Hofmann , Marco Caccamo , Christoph Stiller

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

Machine Learning · Computer Science 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling

Marginal-likelihood based model-selection, even though promising, is rarely used in deep learning due to estimation difficulties. Instead, most approaches rely on validation data, which may not be readily available. In this work, we present…

Machine Learning · Statistics 2021-06-16 Alexander Immer , Matthias Bauer , Vincent Fortuin , Gunnar Rätsch , Mohammad Emtiyaz Khan

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

Cross domain recommender system constitutes a powerful method to tackle the cold-start and sparsity problem by aggregating and transferring user preferences across multiple category domains. Therefore, it has great potential to improve…

Information Retrieval · Computer Science 2021-06-08 Pan Li , Zhichao Jiang , Maofei Que , Yao Hu , Alexander Tuzhilin

Some machine learning applications require continual learning - where data comes in a sequence of datasets, each is used for training and then permanently discarded. From a Bayesian perspective, continual learning seems straightforward:…

Machine Learning · Statistics 2019-02-19 Sebastian Farquhar , Yarin Gal

A Bayesian network is a widely used probabilistic graphical model with applications in knowledge discovery and prediction. Learning a Bayesian network (BN) from data can be cast as an optimization problem using the well-known…

Artificial Intelligence · Computer Science 2020-09-01 Zhenyu A. Liao , Charupriya Sharma , James Cussens , Peter van Beek