中文
相关论文

相关论文: KABB: Knowledge-Aware Bayesian Bandits for Dynamic…

200 篇论文

We consider Bayesian optimization in settings where observations can be adversarially biased, for example by an uncontrolled hidden confounder. Our first contribution is a reduction of the confounded setting to the dueling bandit model.…

机器学习 · 统计学 2021-06-10 Johannes Kirschner , Andreas Krause

In many real-world applications such as recommendation systems, multiple learning agents must balance exploration and exploitation while maintaining safety guarantees to avoid catastrophic failures. We study the stochastic linear bandit…

机器学习 · 计算机科学 2026-02-16 Amirhossein Afsharrad , Ahmadreza Moradipari , Sanjay Lall

This paper tackles a multi-agent bandit setting where $M$ agents cooperate together to solve the same instance of a $K$-armed stochastic bandit problem. The agents are \textit{heterogeneous}: each agent has limited access to a local subset…

机器学习 · 计算机科学 2022-02-18 Lin Yang , Yu-zhen Janice Chen , Mohammad Hajiesmaili , John CS Lui , Don Towsley

The combinatorial multi-armed bandit (CMAB) is a fundamental sequential decision-making framework, extensively studied over the past decade. However, existing work primarily focuses on the online setting, overlooking the substantial costs…

机器学习 · 计算机科学 2025-05-30 Xutong Liu , Xiangxiang Dai , Jinhang Zuo , Siwei Wang , Carlee Joe-Wong , John C. S. Lui , Wei Chen

We study a variant of the contextual bandit problem where an agent can intervene through a set of stochastic expert policies. Given a fixed context, each expert samples actions from a fixed conditional distribution. The agent seeks to…

机器学习 · 计算机科学 2024-10-29 Nihal Sharma , Rajat Sen , Soumya Basu , Karthikeyan Shanmugam , Sanjay Shakkottai

Recent developments in digital platforms have highlighted the prevalence of open systems, where agents can arrive and depart over time. While bandit learning in open systems has recently received initial attention, existing work imposes…

机器学习 · 计算机科学 2026-05-08 Mengfan Xu

This paper introduces a federated learning framework tailored for online combinatorial optimization with bandit feedback. In this setting, agents select subsets of arms, observe noisy rewards for these subsets without accessing individual…

机器学习 · 计算机科学 2024-05-10 Fares Fourati , Mohamed-Slim Alouini , Vaneet Aggarwal

Multi-armed bandit (MAB) algorithms are efficient approaches to reduce the opportunity cost of online experimentation and are used by companies to find the best product from periodically refreshed product catalogs. However, these algorithms…

机器学习 · 计算机科学 2024-12-19 Mohsen Bayati , Junyu Cao , Wanning Chen

We investigate top-$m$ arm identification, a basic problem in bandit theory, in a multi-agent learning model in which agents collaborate to learn an objective function. We are interested in designing collaborative learning algorithms that…

机器学习 · 计算机科学 2022-11-29 Nikolai Karpov , Qin Zhang

Multi-armed bandits (MAB) provide a principled online learning approach to attain the balance between exploration and exploitation. Due to the superior performance and low feedback learning without the learning to act in multiple…

信息检索 · 计算机科学 2022-10-25 Shenghao Xu

Large language models (LLMs) have been adopted to solve sequential decision-making tasks such as multi-armed bandits (MAB), in which an LLM is directly instructed to select the arms to pull in every iteration. However, this paradigm of…

机器学习 · 计算机科学 2025-02-04 Jiahang Sun , Zhiyong Wang , Runhan Yang , Chenjun Xiao , John C. S. Lui , Zhongxiang Dai

Large language models (LLMs) have recently been applied to dialog systems. Despite making progress, LLMs are prone to errors in knowledge-intensive scenarios. Recently, approaches based on retrieval augmented generation (RAG) and agent have…

计算与语言 · 计算机科学 2025-07-01 Yucheng Cai , Yuxuan Wu , Yi Huang , Junlan Feng , Zhijian Ou

Task-oriented dialog (TOD) agents often ground their responses on external knowledge bases (KBs). These KBs can be dynamic and may be updated frequently. Existing approaches for learning TOD agents assume the KB snapshot contemporary to…

计算与语言 · 计算机科学 2023-05-29 Vishal Vivek Saley , Rocktim Jyoti Das , Dinesh Raghu , Mausam

Multi-armed bandits (MAB) is a sequential decision-making model in which the learner controls the trade-off between exploration and exploitation to maximize its cumulative reward. Federated multi-armed bandits (FMAB) is an emerging…

机器学习 · 计算机科学 2025-02-18 Artun Saday , İlker Demirel , Yiğit Yıldırım , Cem Tekin

Large Language Models (LLMs) have achieved great success in many real-world applications, especially the one serving as the cognitive backbone of Multi-Agent Systems (MAS) to orchestrate complex workflows in practice. Since many deployment…

机器学习 · 计算机科学 2026-03-04 Zhi Hong , Qian Zhang , Jiahang Sun , Zhiwei Shang , Mingze Kong , Xiangyi Wang , Yao Shu , Zhongxiang Dai

We study the cooperative stochastic $k$-armed bandit problem, where a network of $m$ agents collaborate to find the optimal action. In contrast to most prior work on this problem, which focuses on extending a specific algorithm to the…

机器学习 · 计算机科学 2024-11-01 Benjamin Howson , Sarah Filippi , Ciara Pike-Burke

Large language model (LLM)-based multi-agent systems have emerged as a powerful paradigm for enabling autonomous agents to solve complex tasks. As these systems scale in complexity, cost becomes an important consideration for practical…

多智能体系统 · 计算机科学 2025-11-27 Liming Yang , Junyu Luo , Xuanzhe Liu , Yiling Lou , Zhenpeng Chen

This paper proposes a novel policy for a group of agents to, individually as well as collectively, solve a multi armed bandit (MAB) problem. The policy relies solely on the information that an agent has obtained through sampling of the…

机器学习 · 计算机科学 2020-02-24 Pathmanathan Pankayaraj , D. H. S. Maithripala

Database activity monitoring (DAM) systems are commonly used by organizations to protect the organizational data, knowledge and intellectual properties. In order to protect organizations database DAM systems have two main roles, monitoring…

机器学习 · 计算机科学 2019-10-25 Hagit Grushka-Cohen , Ofer Biller , Oded Sofer , Lior Rokach , Bracha Shapira

Contextual bandits (CB) are online sequential decision-making problems under partial feedback that underpin many adaptive services. There is a growing demand to deploy CB agents directly on-device, under strict constraints on memory,…

机器学习 · 计算机科学 2026-05-14 Marco Angioli , Kevin Johansson , Antonello Rosato , Amy Loutfi , Denis Kleyko