English
Related papers

Related papers: Graph Signal Sampling via Reinforcement Learning

200 papers

Adversarial attacks against stochastic multi-armed bandit (MAB) algorithms have been extensively studied in the literature. In this work, we focus on reward poisoning attacks and find most existing attacks can be easily detected by our…

Machine Learning · Computer Science 2024-02-22 Zhiwei Wang , Huazheng Wang , Hongning Wang

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

Information Retrieval · Computer Science 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang

Existing multi-agent coordination techniques are often fragile and vulnerable to anomalies such as agent attrition and communication disturbances, which are quite common in the real-world deployment of systems like field robotics. To better…

Multiagent Systems · Computer Science 2024-10-27 Anthony Goeckner , Yueyuan Sui , Nicolas Martinet , Xinliang Li , Qi Zhu

Multi-armed bandits (MAB) are extensively studied in various settings where the objective is to \textit{maximize} the actions' outcomes (i.e., rewards) over time. Since safety is crucial in many real-world problems, safe versions of MAB…

Machine Learning · Computer Science 2021-12-14 Ilker Demirel , Mehmet Ufuk Ozdemir , Cem Tekin

The combinatorial stochastic semi-bandit problem is an extension of the classical multi-armed bandit problem in which an algorithm pulls more than one arm at each stage and the rewards of all pulled arms are revealed. One difference with…

Machine Learning · Computer Science 2016-12-07 Rémy Degenne , Vianney Perchet

Recent advances in wireless radio frequency (RF) energy harvesting allows sensor nodes to increase their lifespan by remotely charging their batteries. The amount of energy harvested by the nodes varies depending on their ambient…

Machine Learning · Computer Science 2020-06-17 Debamita Ghosh , Arun Verma , Manjesh K. Hanawal

We consider a variant of the classic multi-armed bandit problem where the expected reward of each arm is a function of an unknown parameter. The arms are divided into different groups, each of which has a common parameter. Therefore, when…

Machine Learning · Computer Science 2018-02-23 Zhiyang Wang , Ruida Zhou , Cong Shen

Existing frameworks for evaluating and comparing generative models consider an offline setting, where the evaluator has access to large batches of data produced by the models. However, in practical scenarios, the goal is often to identify…

Machine Learning · Computer Science 2025-03-12 Xiaoyan Hu , Ho-fung Leung , Farzan Farnia

In this paper we examine the effectiveness of several multi-arm bandit algorithms when used as a trust system to select agents to delegate tasks to. In contrast to existing work, we allow for recursive delegation to occur. That is, a task…

Multiagent Systems · Computer Science 2023-11-03 Nir Oren

We study the multi-armed bandit (MAB) problem with composite and anonymous feedback. In this model, the reward of pulling an arm spreads over a period of time (we call this period as reward interval) and the player receives partial rewards…

Machine Learning · Computer Science 2020-12-16 Siwei Wang , Haoyun Wang , Longbo Huang

We propose a desigining method of a flexible sampling operator for graph signals via a difference-of-convex (DC) optimization algorithm. A fundamental challenge in graph signal processing is sampling, especially for graph signals that are…

Signal Processing · Electrical Eng. & Systems 2025-03-03 Keitaro Yamashita , Kazuki Naganuma , Shunsuke Ono

We consider the problem of signal recovery on graphs as graphs model data with complex structure as signals on a graph. Graph signal recovery implies recovery of one or multiple smooth graph signals from noisy, corrupted, or incomplete…

Social and Information Networks · Computer Science 2015-10-28 Siheng Chen , Aliaksei Sandryhaila , José M. F. Moura , Jelena Kovačević

Inspired by cognitive radio networks, we consider a setting where multiple users share several channels modeled as a multi-user multi-armed bandit (MAB) problem. The characteristics of each channel are unknown and are different for each…

Machine Learning · Computer Science 2015-12-03 Orly Avner , Shie Mannor

It has been shown (Amuru et al. 2015) that online learning algorithms can be effectively used to select optimal physical layer parameters for jamming against digital modulation schemes without a priori knowledge of the victim's transmission…

Machine Learning · Computer Science 2022-07-07 Charles E. Thornton , R. Michael Buehrer

By exploiting ultrafast and irregular time series generated by lasers with delayed feedback, we have previously demonstrated a scalable algorithm to solve multi-armed bandit (MAB) problems utilizing the time-division multiplexing of laser…

Signal Processing · Electrical Eng. & Systems 2020-05-28 Naoki Narisawa , Nicolas Chauvet , Mikio Hasegawa , Makoto Naruse

Graph signals are functions of the underlying graph. When the edge-weight between a pair of nodes is high, the corresponding signals generally have a higher correlation. As a result, the signals can be represented in terms of a graph-based…

Signal Processing · Electrical Eng. & Systems 2024-09-09 Rishabh Ravi , Kaushani Majumder , Kalp Vyas , Satish Mulleti

We present a new algorithm based on an gradient ascent for a general Active Exploration bandit problem in the fixed confidence setting. This problem encompasses several well studied problems such that the Best Arm Identification or…

Machine Learning · Statistics 2019-05-21 Pierre Ménard

We consider network topology identification subject to a signal smoothness prior on the nodal observations. A fast dual-based proximal gradient algorithm is developed to efficiently tackle a strongly convex, smoothness-regularized network…

Machine Learning · Computer Science 2021-10-20 Seyed Saman Saboksayr , Gonzalo Mateos

This paper introduces the first asymptotically optimal strategy for a multi armed bandit (MAB) model under side constraints. The side constraints model situations in which bandit activations are limited by the availability of certain…

Machine Learning · Statistics 2025-02-10 Apostolos N. Burnetas , Odysseas Kanavetas , Michael N. Katehakis

This paper focuses on building personalized player models solely from player behavior in the context of adaptive games. We present two main contributions: The first is a novel approach to player modeling based on multi-armed bandits (MABs).…

Artificial Intelligence · Computer Science 2021-02-11 Robert C. Gray , Jichen Zhu , Dannielle Arigo , Evan Forman , Santiago Ontañón