English
Related papers

Related papers: Graph Neural Thompson Sampling

200 papers

Graph neural networks (GNNs) are powerful models that have been successful in various graph representation learning tasks. Whereas gradient boosted decision trees (GBDT) often outperform other machine learning methods when faced with…

Machine Learning · Computer Science 2021-04-01 Sergei Ivanov , Liudmila Prokhorenkova

Temporal action proposal generation plays an important role in video action understanding, which requires localizing high-quality action content precisely. However, generating temporal proposals with both precise boundaries and high-quality…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Yueran Bai , Yingying Wang , Yunhai Tong , Yang Yang , Qiyue Liu , Junhui Liu

Contextual bandits are a core technology for personalized mobile health interventions, where decision-making requires adapting to complex, non-linear user behaviors. While Thompson Sampling (TS) is a preferred strategy for these problems,…

Machine Learning · Statistics 2026-02-10 Ruizhe Deng , Bibhas Chakraborty , Ran Chen , Yan Shuo Tan

Graph Neural Networks (GNN) rely on graph convolutions to learn features from network data. GNNs are stable to different types of perturbations of the underlying graph, a property that they inherit from graph filters. In this paper we…

Machine Learning · Computer Science 2022-02-11 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

We study the regret of Thompson sampling (TS) algorithms for exponential family bandits, where the reward distribution is from a one-dimensional exponential family, which covers many common reward distributions including Bernoulli,…

Machine Learning · Statistics 2022-06-09 Tianyuan Jin , Pan Xu , Xiaokui Xiao , Anima Anandkumar

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Graph Neural Networks (GNNs) are a broad class of connectionist models for graph processing. Recent studies have shown that GNNs can approximate any function on graphs, modulo the equivalence relation on graphs defined by the…

Machine Learning · Computer Science 2024-08-21 Giuseppe Alessio D'Inverno , Monica Bianchini , Maria Lucia Sampoli , Franco Scarselli

A challenging aspect of the bandit problem is that a stochastic reward is observed only for the chosen arm and the rewards of other arms remain missing. The dependence of the arm choice on the past context and reward pairs compounds the…

Machine Learning · Statistics 2023-05-02 Wonyoung Kim , Gi-soo Kim , Myunghee Cho Paik

Thompson sampling is an algorithm for online decision problems where actions are taken sequentially in a manner that must balance between exploiting what is known to maximize immediate performance and investing to accumulate new information…

Machine Learning · Computer Science 2020-07-16 Daniel Russo , Benjamin Van Roy , Abbas Kazerouni , Ian Osband , Zheng Wen

Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some…

Machine Learning · Computer Science 2021-01-19 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Many score-based active learning methods have been successfully applied to graph-structured data, aiming to reduce the number of labels and achieve better performance of graph neural networks based on predefined score functions. However,…

Machine Learning · Computer Science 2023-04-25 Yinchuan Li , Zhigang Li , Wenqian Li , Yunfeng Shao , Yan Zheng , Jianye Hao

Recently, graph neural networks (GNNs)-based recommender systems have encountered great success in recommendation. As the number of GNNs approaches rises, some works have started questioning the theoretical and empirical reasons behind…

In the stochastic contextual low-rank matrix bandit problem, the expected reward of an action is given by the inner product between the action's feature matrix and some fixed, but initially unknown $d_1$ by $d_2$ matrix $\Theta^*$ with rank…

Machine Learning · Statistics 2024-01-17 Yue Kang , Cho-Jui Hsieh , Thomas C. M. Lee

We discuss a multiple-play multi-armed bandit (MAB) problem in which several arms are selected at each round. Recently, Thompson sampling (TS), a randomized algorithm with a Bayesian spirit, has attracted much attention for its empirically…

Machine Learning · Statistics 2019-03-22 Junpei Komiyama , Junya Honda , Hiroshi Nakagawa

Although graph neural networks (GNNs) have made great progress recently on learning from graph-structured data in practice, their theoretical guarantee on generalizability remains elusive in the literature. In this paper, we provide a…

Machine Learning · Computer Science 2020-06-26 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Graph Neural Networks (GNNs) have shown to be powerful tools for graph analytics. The key idea is to recursively propagate and aggregate information along edges of the given graph. Despite their success, however, the existing GNNs are…

Machine Learning · Computer Science 2020-11-16 Dongsheng Luo , Wei Cheng , Wenchao Yu , Bo Zong , Jingchao Ni , Haifeng Chen , Xiang Zhang

We consider the problem of estimating the topology of multiple networks from nodal observations, where these networks are assumed to be drawn from the same (unknown) random graph model. We adopt a graphon as our random graph model, which is…

Machine Learning · Statistics 2022-02-14 Madeline Navarro , Santiago Segarra

The design and performance analysis of bandit algorithms in the presence of stage-wise safety or reliability constraints has recently garnered significant interest. In this work, we consider the linear stochastic bandit problem under…

Machine Learning · Computer Science 2020-03-03 Ahmadreza Moradipari , Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis

This paper proposes a new algorithm -- Trading Graph Neural Network (TGNN) that can structurally estimate the impact of asset features, dealer features and relationship features on asset prices in trading networks. It combines the strength…

Trading and Market Microstructure · Quantitative Finance 2025-04-11 Xian Wu

GNNs have been proven to perform highly effective in various node-level, edge-level, and graph-level prediction tasks in several domains. Existing approaches mainly focus on static graphs. However, many graphs change over time with their…

Machine Learning · Computer Science 2022-06-22 Bahareh Najafi , Saeedeh Parsaeefard , Alberto Leon-Garcia