中文
相关论文

相关论文: Bandit-Based Model Selection for Deformable Object…

200 篇论文

Multi-player multi-armed bandits (MMAB) study how decentralized players cooperatively play the same multi-armed bandit so as to maximize their total cumulative rewards. Existing MMAB models mostly assume when more than one player pulls the…

机器学习 · 计算机科学 2022-04-29 Xuchuang Wang , Hong Xie , John C. S. Lui

In human-computer interaction applications like hand gesture recognition, supervised learning models are often trained on a large population of users to achieve high task accuracy. However, due to individual variability in sensor signals…

人机交互 · 计算机科学 2025-09-12 Duke Lin , Michael Paskett , Ying Yang

We consider the Max $K$-Armed Bandit problem, where a learning agent is faced with several sources (arms) of items (rewards), and interested in finding the best item overall. At each time step the agent chooses an arm, and obtains a random…

机器学习 · 统计学 2015-08-25 Yahel David , Nahum Shimkin

We introduce Flickering Multi-Armed Bandits (FMAB) to model sequential decision-making in environments with changing action availability, where accessibility of the next action is restricted to a subset dependent on the agent's current…

机器学习 · 计算机科学 2026-04-28 Sourav Chakraborty , Amit Kiran Rege , Claire Monteleoni , Lijun Chen

In this report, we survey Bayesian Optimization methods focussed on the Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization". We report a small literature survey on the acquisition…

机器学习 · 计算机科学 2020-12-16 Abhilash Nandy , Chandan Kumar , Deepak Mewada , Soumya Sharma

In this paper, we presented a new method for deformation control of deformable objects, which utilizes both visual and tactile feedback. At present, manipulation of deformable objects is basically formulated by assuming positional…

机器人学 · 计算机科学 2021-06-01 Yuhao Guo , Xin Jiang , Yunhui Liu

We propose a novel formulation of group fairness with biased feedback in the contextual multi-armed bandit (CMAB) setting. In the CMAB setting, a sequential decision maker must, at each time step, choose an arm to pull from a finite set of…

机器学习 · 计算机科学 2022-02-17 Candice Schumann , Zhi Lang , Nicholas Mattei , John P. Dickerson

This paper introduces DextAIRity, an approach to manipulate deformable objects using active airflow. In contrast to conventional contact-based quasi-static manipulations, DextAIRity allows the system to apply dense forces on out-of-contact…

机器人学 · 计算机科学 2022-04-26 Zhenjia Xu , Cheng Chi , Benjamin Burchfiel , Eric Cousineau , Siyuan Feng , Shuran Song

In the Best-$K$ identification problem (Best-$K$-Arm), we are given $N$ stochastic bandit arms with unknown reward distributions. Our goal is to identify the $K$ arms with the largest means with high confidence, by drawing samples from the…

机器学习 · 计算机科学 2017-05-22 Haotian Jiang , Jian Li , Mingda Qiao

Manipulating deformable objects in robotic cells is often costly and not widely accessible. However, the use of localized pneumatic gripping systems can enhance accessibility. Current methods that use pneumatic grippers to handle deformable…

机器人学 · 计算机科学 2025-01-10 Roman Mykhailyshyn , Jonathan Lee , Mykhailo Mykhailyshyn , Kensuke Harada , Ann Majewicz Fey

The multi-armed bandit is a concise model for the problem of iterated decision-making under uncertainty. In each round, a gambler must pull one of $K$ arms of a slot machine, without any foreknowledge of their payouts, except that they are…

数据结构与算法 · 计算机科学 2007-05-23 Varsha Dani , Thomas P. Hayes

Online interactive recommender systems strive to promptly suggest to consumers appropriate items (e.g., movies, news articles) according to the current context including both the consumer and item content information. However, such context…

信息检索 · 计算机科学 2021-07-02 Qing Wang , Chunqiu Zeng , Wubai Zhou , Tao Li , Larisa Shwartz , Genady Ya. Grabarnik

We propose a novel technique for analyzing adaptive sampling called the {\em Simulator}. Our approach differs from the existing methods by considering not how much information could be gathered by any fixed sampling strategy, but how…

机器学习 · 计算机科学 2023-04-25 Max Simchowitz , Kevin Jamieson , Benjamin Recht

Standard Multi-Armed Bandit (MAB) problems assume that the arms are independent. However, in many application scenarios, the information obtained by playing an arm provides information about the remainder of the arms. Hence, in such…

机器学习 · 计算机科学 2014-10-30 Onur Atan , Cem Tekin , Mihaela van der Schaar

In this work, we propose algorithms and methods that enable learning dexterous object manipulation using simulated one- or two-armed robots equipped with multi-fingered hand end-effectors. Using a parallel GPU-accelerated physics simulator…

机器人学 · 计算机科学 2023-05-23 Aleksei Petrenko , Arthur Allshire , Gavriel State , Ankur Handa , Viktor Makoviychuk

Multi-objective multi-armed bandit (MO-MAB) problems traditionally aim to achieve Pareto optimality. However, real-world scenarios often involve users with varying preferences across objectives, resulting in a Pareto-optimal arm that may…

机器学习 · 计算机科学 2025-11-18 Linfeng Cao , Ming Shi , Ness B. Shroff

Restless multi-arm bandits (RMABs), a class of resource allocation problems with broad application in areas such as healthcare, online advertising, and anti-poaching, have recently been studied from a multi-agent reinforcement learning…

机器学习 · 计算机科学 2024-01-31 Yunfan Zhao , Nikhil Behari , Edward Hughes , Edwin Zhang , Dheeraj Nagaraj , Karl Tuyls , Aparna Taneja , Milind Tambe

The multi-armed bandit(MAB) is a classical sequential decision problem. Most work requires assumptions about the reward distribution (e.g., bounded), while practitioners may have difficulty obtaining information about these distributions to…

机器学习 · 计算机科学 2023-12-14 Han Qi , Fei Guo , Li Zhu

We study best arm identification in a variant of the multi-armed bandit problem where the learner has limited precision in arm selection. The learner can only sample arms via certain exploration bundles, which we refer to as boxes. In…

机器学习 · 计算机科学 2023-05-11 Kota Srinivas Reddy , P. N. Karthik , Nikhil Karamchandani , Jayakrishnan Nair

Reliable robotic grasping, especially with deformable objects such as fruits, remains a challenging task due to underactuated contact interactions with a gripper, unknown object dynamics and geometries. In this study, we propose a…

机器人学 · 计算机科学 2023-07-25 Yunhai Han , Kelin Yu , Rahul Batra , Nathan Boyd , Chaitanya Mehta , Tuo Zhao , Yu She , Seth Hutchinson , Ye Zhao