English
Related papers

Related papers: Mechanical Search on Shelves with Efficient Stacki…

200 papers

In recent years, attention has been focused on the relationship between black-box optimiza- tion problem and reinforcement learning problem. In this research, we propose the Mirror Descent Search (MDS) algorithm which is applicable both for…

Machine Learning · Computer Science 2018-05-15 Megumi Miyashita , Shiro Yano , Toshiyuki Kondo

The key to Black-Box Optimization is to efficiently search through input regions with potentially widely-varying numerical properties, to achieve low-regret descent and fast progress toward the optima. Monte Carlo Tree Search (MCTS) methods…

Machine Learning · Computer Science 2022-11-03 Yaoguang Zhai , Sicun Gao

We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking…

Artificial Intelligence · Computer Science 2023-08-16 Debraj Chakraborty , Damien Busatto-Gaston , Jean-François Raskin , Guillermo A. Pérez

Monte Carlo Tree Search (MCTS) is a powerful algorithm for solving complex decision-making problems. This paper presents an optimized MCTS implementation applied to the FrozenLake environment, a classic reinforcement learning task…

Artificial Intelligence · Computer Science 2024-09-26 Esteban Aldana Guerra

Efficient utilization of satellite resources in dynamic environments remains a challenging problem in satellite scheduling. This paper addresses the multi-satellite collection scheduling problem (m-SatCSP), aiming to optimize task…

Artificial Intelligence · Computer Science 2024-06-03 Justin Norman , Francois Rivest

Monte-Carlo tree search (MCTS) is an effective anytime algorithm with a vast amount of applications. It strategically allocates computational resources to focus on promising segments of the search tree, making it a very attractive search…

Artificial Intelligence · Computer Science 2024-02-14 Cedric Derstroff , Jannis Brugger , Jannis Blüml , Mira Mezini , Stefan Kramer , Kristian Kersting

We propose a novel Parallel Monte Carlo tree search with Batched Simulations (PMBS) algorithm for accelerating long-horizon, episodic robotic planning tasks. Monte Carlo tree search (MCTS) is an effective heuristic search algorithm for…

Robotics · Computer Science 2022-07-15 Baichuan Huang , Abdeslam Boularias , Jingjin Yu

In this paper, we present the tidiness score-guided Monte Carlo tree search (TSMCTS), a novel framework designed to address the tabletop tidying up problem using only an RGB-D camera. We address two major problems for tabletop tidying up…

Robotics · Computer Science 2025-02-25 Hogun Kee , Wooseok Oh , Minjae Kang , Hyemin Ahn , Songhwai Oh

Retrieving objects buried beneath multiple objects is not only challenging but also time-consuming. Performing manipulation in such environments presents significant difficulty due to complex contact relationships. Existing methods…

Robotics · Computer Science 2025-02-27 Fengshuo Bai , Yu Li , Jie Chu , Tawei Chou , Runchuan Zhu , Ying Wen , Yaodong Yang , Yuanpei Chen

This work proposes a variable neighbourhood search (FTS) that uses a fractal-based local search primarily designed for images. Searching for specific content in images is posed as an optimisation problem, where evidence elements are…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Erick O. Rodrigues , Panos Liatsis , Luiz Satoru , Aura Conci

Shelves are commonly used to store objects in homes, stores, and warehouses. We formulate the problem of Optimal Shelf Arrangement (OSA), where the goal is to optimize the arrangement of objects on a shelf for access time given an access…

Robotics · Computer Science 2022-06-20 Lawrence Yunliang Chen , Huang Huang , Michael Danielczuk , Jeffrey Ichnowski , Ken Goldberg

In collaborative human-robot order picking systems, human pickers and Autonomous Mobile Robots (AMRs) travel independently through a warehouse and meet at pick locations where pickers load items onto the AMRs. In this paper, we consider an…

Recent research has shown that non-additive image steganographic frameworks effectively improve security performance through adjusting distortion distribution. However, as far as we know, all of the existing non-additive proposals are based…

Multimedia · Computer Science 2021-08-11 Xianbo Mo , Shunquan Tan , Bin Li , Jiwu Huang

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

Machine Learning · Computer Science 2020-12-01 Elana Kozak , Scott Hottovy

We propose a novel method applicable in many scene understanding problems that adapts the Monte Carlo Tree Search (MCTS) algorithm, originally designed to learn to play games of high-state complexity. From a generated pool of proposals, our…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Sinisa Stekovic , Mahdi Rad , Alireza Moradi , Friedrich Fraundorfer , Vincent Lepetit

Non-prehensile multi-object rearrangement is a robotic task of planning feasible paths and transferring multiple objects to their predefined target poses without grasping. It needs to consider how each object reaches the target and the…

Robotics · Computer Science 2021-09-21 Fan Bai , Fei Meng , Jianbang Liu , Jiankun Wang , Max Q. -H. Meng

We address the problem of visually guided rearrangement planning with many movable objects, i.e., finding a sequence of actions to move a set of objects from an initial arrangement to a desired one, while relying on visual inputs coming…

Metaheuristics are known to be strong in solving large-scale instances of computationally hard problems. However, their efficiency still needs exploration in the context of instance structure, scale and numerical properties for many of…

Computational Engineering, Finance, and Science · Computer Science 2018-01-11 David Chalupa , Peter Nielsen

We propose a novel methodology for robotic follow-ahead applications that address the critical challenge of obstacle and occlusion avoidance. Our approach effectively navigates the robot while ensuring avoidance of collisions and occlusions…

Robotics · Computer Science 2023-10-02 Sahar Leisiazar , Edward J. Park , Angelica Lim , Mo Chen

Failure-Directed Search (FDS) is a significant complete generic search algorithm used in Constraint Programming (CP) to efficiently explore the search space, proven particularly effective on scheduling problems. This paper analyzes FDS's…

Machine Learning · Computer Science 2025-08-28 Vilém Heinz , Petr Vilím , Zdeněk Hanzálek