English
Related papers

Related papers: Thompson Sampling for Pursuit-Evasion Problems

200 papers

Thompson sampling (TS) is widely used in sequential decision making due to its ease of use and appealing empirical performance. However, many existing analytical and empirical results for TS rely on restrictive assumptions on reward…

Machine Learning · Computer Science 2023-06-16 Amin Karbasi , Nikki Lijing Kuang , Yi-An Ma , Siddharth Mitra

Recent advancements in robotics have transformed industries such as manufacturing, logistics, surgery, and planetary exploration. A key challenge is developing efficient motion planning algorithms that allow robots to navigate complex…

Robotics · Computer Science 2025-08-27 Liding Zhang , Kuanqi Cai , Zewei Sun , Zhenshan Bing , Chaoqun Wang , Luis Figueredo , Sami Haddadin , Alois Knoll

With the increasing use of robots in daily life, there is a growing need to provide robust collaboration protocols for robots to tackle more complicated and dynamic problems effectively. This paper presents a novel, factor graph-based…

Robotics · Computer Science 2025-10-10 Messiah Abolfazli Esfahani , Ayşe Başar , Sajad Saeedi

The multi-armed bandit problem is a popular model for studying exploration/exploitation trade-off in sequential decision problems. Many algorithms are now available for this well-studied problem. One of the earliest algorithms, given by W.…

Machine Learning · Computer Science 2012-04-10 Shipra Agrawal , Navin Goyal

Multi-UAV pursuit-evasion, where pursuers aim to capture evaders, poses a key challenge for UAV swarm intelligence. Multi-agent reinforcement learning (MARL) has demonstrated potential in modeling cooperative behaviors, but most RL-based…

Robotics · Computer Science 2025-07-09 Jiayu Chen , Chao Yu , Guosheng Li , Wenhao Tang , Shilong Ji , Xinyi Yang , Botian Xu , Huazhong Yang , Yu Wang

Thompson Sampling is one of the most widely used and studied bandit algorithms, known for its simple structure, low regret performance, and solid theoretical guarantees. Yet, in stark contrast to most other families of bandit algorithms,…

Machine Learning · Computer Science 2026-05-28 Yanlin Qu , Hongseok Namkoong , Assaf Zeevi

The problem of two-sided matching markets has a wide range of real-world applications and has been extensively studied in the literature. A line of recent works have focused on the problem setting where the preferences of one-side market…

Machine Learning · Computer Science 2022-05-03 Fang Kong , Junming Yin , Shuai Li

Active search refers to the problem of efficiently locating targets in an unknown environment by actively making data-collection decisions, and has many applications including detecting gas leaks, radiation sources or human survivors of…

Machine Learning · Computer Science 2020-06-29 Ramina Ghods , Arundhati Banerjee , Jeff Schneider

We consider a pursuit-evasion scenario involving a group of pursuers and a single evader in a two-dimensional unbounded environment. The pursuers aim to capture the evader in finite time while ensuring the evader remains enclosed within the…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Dinesh Patra , Prajakta Surve , Ashish R. Hota , Shaunak D. Bopardikar

Thompson sampling provides a solution to bandit problems in which new observations are allocated to arms with the posterior probability that an arm is optimal. While sometimes easy to implement and asymptotically optimal, Thompson sampling…

Machine Learning · Computer Science 2014-10-16 Dean Eckles , Maurits Kaptein

In this work we introduce an evolutionary strategy to solve combinatorial optimization tasks, i.e. problems characterized by a discrete search space. In particular, we focus on the Traveling Salesman Problem (TSP), i.e. a famous problem…

Disordered Systems and Neural Networks · Physics 2016-08-05 Marco Alberto Javarone

We study the effects of approximate inference on the performance of Thompson sampling in the $k$-armed bandit problems. Thompson sampling is a successful algorithm for online decision-making but requires posterior inference, which often…

Machine Learning · Computer Science 2020-01-16 My Phan , Yasin Abbasi-Yadkori , Justin Domke

We propose a new approach for solving combinatorial optimization problem by utilizing the mechanism of chases and escapes, which has a long history in mathematics. In addition to the well-used steepest descent and neighboring search, we…

Artificial Intelligence · Computer Science 2018-04-25 Toru Ohira

In this paper, we investigate a pursuit-evasion game in which a mobile observer tries to track a target in an environment containing obstacles. We formulate the game as an optimal control problem with state inequality constraint in a simple…

Optimization and Control · Mathematics 2016-11-16 Rui Zou , Hamid Emadi , Sourabh Bhattacharya

We study a pursuit-evasion problem which can be viewed as an extension of the keep-away game. In the game, pursuer(s) will attempt to intersect or catch the evader, while the evader can visit a fixed set of locations, which we denote as the…

Robotics · Computer Science 2022-06-17 Weifu Wang , Ping Li

Thompson Sampling is a well established approach to bandit and reinforcement learning problems. However its use in continuum armed bandit problems has received relatively little attention. We provide the first bounds on the regret of…

Machine Learning · Computer Science 2020-02-27 James A. Grant , David S. Leslie

The pursuit-evasion game in Smart City brings a profound impact on the Multi-vehicle Pursuit (MVP) problem, when police cars cooperatively pursue suspected vehicles. Existing studies on the MVP problems tend to set evading vehicles to move…

Multiagent Systems · Computer Science 2022-10-25 Qinwen Wang , Xinhang Li , Zheng Yuan , Yiying Yang , Chen Xu , Lin Zhang

An approach of mobile multi-agent pursuit based on application of self-organizing feature map (SOFM) and along with that reinforcement learning based on agent group role membership function (AGRMF) model is proposed. This method promotes…

Artificial Intelligence · Computer Science 2020-06-30 Muhammad Zuhair Qadir , Songhao Piao , Haiyang Jiang , Mohammed El Habib Souidi

Thompson sampling has impressive empirical performance for many multi-armed bandit problems. But current algorithms for Thompson sampling only work for the case of conjugate priors since these algorithms require to infer the posterior,…

Machine Learning · Computer Science 2017-08-17 Yichi Zhou , Jun Zhu , Jingwei Zhuo

Contextual bandits constitute a classical framework for decision-making under uncertainty. In this setting, the goal is to learn the arms of highest reward subject to contextual information, while the unknown reward parameters of each arm…

Machine Learning · Statistics 2024-02-19 Hongju Park , Mohamad Kazem Shirani Faradonbeh