English
Related papers

Related papers: A Deep Bayesian Bandits Approach for Anticancer Th…

200 papers

The diagnosis of cyber-physical systems aims to detect faulty behaviour, its root cause and a mitigation or even prevention policy. Therefore, diagnosis relies on a representation of the system's functional and faulty behaviour combined…

Machine Learning · Computer Science 2021-10-13 Nicolas Olivain , Philipp Tiefenbacher , Jens Kohl

In this thesis, we introduce Bayesian filtering as a principled framework for tackling diverse sequential machine learning problems, including online (continual) learning, prequential (one-step-ahead) forecasting, and contextual bandits. To…

Machine Learning · Statistics 2025-05-13 Gerardo Duran-Martin

In healthcare, it is essential to explain the decision-making process of machine learning models to establish the trustworthiness of clinicians. This paper introduces BI-RADS-Net, a novel explainable deep learning approach for cancer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Boyu Zhang , Aleksandar Vakanski , Min Xian

Standard approaches to decision-making under uncertainty focus on sequential exploration of the space of decisions. However, \textit{simultaneously} proposing a batch of decisions, which leverages available resources for parallel…

Machine Learning · Statistics 2023-02-07 Jeffrey Chan , Aldo Pacchiano , Nilesh Tripuraneni , Yun S. Song , Peter Bartlett , Michael I. Jordan

We study the contextual linear bandit problem, a version of the standard stochastic multi-armed bandit (MAB) problem where a learner sequentially selects actions to maximize a reward which depends also on a user provided per-round context.…

Machine Learning · Computer Science 2018-10-02 Roshan Shariff , Or Sheffet

In machine learning, the notion of multi-armed bandits refers to a class of online learning problems, in which an agent is supposed to simultaneously explore and exploit a given set of choice alternatives in the course of a sequential…

Machine Learning · Computer Science 2021-07-13 Viktor Bengs , Robert Busa-Fekete , Adil El Mesaoudi-Paul , Eyke Hüllermeier

The diagnosis of prostate cancer faces a problem with overdiagnosis that leads to damaging side effects due to unnecessary treatment. Research has shown that the use of multi-parametric magnetic resonance images to conduct biopsies can…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Pedro C. Neto

The Causal Bandit is a variant of the classic Bandit problem where an agent must identify the best action in a sequential decision-making process, where the reward distribution of the actions displays a non-trivial dependence structure that…

Artificial Intelligence · Computer Science 2022-09-30 Arnoud A. W. M. de Kroon , Danielle Belgrave , Joris M. Mooij

Contextual bandits are a core technology for personalized mobile health interventions, where decision-making requires adapting to complex, non-linear user behaviors. While Thompson Sampling (TS) is a preferred strategy for these problems,…

Machine Learning · Statistics 2026-02-10 Ruizhe Deng , Bibhas Chakraborty , Ran Chen , Yan Shuo Tan

Understanding a decision-maker's priorities by observing their behavior is critical for transparency and accountability in decision processes, such as in healthcare. Though conventional approaches to policy learning almost invariably assume…

Machine Learning · Computer Science 2022-06-09 Alihan Hüyük , Daniel Jarrett , Mihaela van der Schaar

Applications of machine learning in the non-profit and public sectors often feature an iterative workflow of data acquisition, prediction, and optimization of interventions. There are four major pain points that a machine learning pipeline…

Machine Learning · Computer Science 2022-01-19 Zheyuan Ryan Shi , Zhiwei Steven Wu , Rayid Ghani , Fei Fang

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

Machine Learning · Computer Science 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Exploration policies in Bayesian bandits maximize the average reward over problem instances drawn from some distribution $\mathcal{P}$. In this work, we learn such policies for an unknown distribution $\mathcal{P}$ using samples from…

Machine Learning · Computer Science 2020-06-11 Craig Boutilier , Chih-Wei Hsu , Branislav Kveton , Martin Mladenov , Csaba Szepesvari , Manzil Zaheer

Collaborative bandit learning, i.e., bandit algorithms that utilize collaborative filtering techniques to improve sample efficiency in online interactive recommendation, has attracted much research attention as it enjoys the best of both…

Machine Learning · Computer Science 2021-04-16 Chuanhao Li , Qingyun Wu , Hongning Wang

Access points (APs) in millimeter-wave (mmWave) and sub-THz-based user-centric (UC) networks will have sleep mode functionality. As a result of this, it becomes challenging to solve the initial access (IA) problem when the sleeping APs are…

Signal Processing · Electrical Eng. & Systems 2021-10-20 Insaf Ismath , Samad Ali , Nandana Rajatheva , Matti Latva-aho

Targeted therapies on the basis of genomic aberrations analysis of the tumor have shown promising results in cancer prognosis and treatment. Regardless of tumor type, trials that match patients to targeted therapies for their particular…

Applications · Statistics 2018-04-18 Yanxun Xu , Peter Mueller , Apostolia M Tsimberidou , Donald Berry

Semantic segmentation constitutes an integral part of medical image analyses for which breakthroughs in the field of deep learning were of high relevance. The large number of trainable parameters of deep neural networks however renders them…

Computer Vision and Pattern Recognition · Computer Science 2017-02-28 Simon Kohl , David Bonekamp , Heinz-Peter Schlemmer , Kaneschka Yaqubi , Markus Hohenfellner , Boris Hadaschik , Jan-Philipp Radtke , Klaus Maier-Hein

We introduce a unified probabilistic framework for solving sequential decision making problems ranging from Bayesian optimisation to contextual bandits and reinforcement learning. This is accomplished by a probabilistic model-based approach…

The contextual duelling bandit problem models adaptive recommender systems, where the algorithm presents a set of items to the user, and the user's choice reveals their preference. This setup is well suited for implicit choices users make…

Machine Learning · Computer Science 2025-08-27 Suryanarayana Sankagiri , Jalal Etesami , Pouria Fatemi , Matthias Grossglauser

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia