English
Related papers

Related papers: Active Acoustic Source Tracking Exploiting Particl…

200 papers

Leveraging planning during learning and decision-making is central to the long-term development of intelligent agents. Recent works have successfully combined tree-based search methods and self-play learning mechanisms to this end. However,…

Artificial Intelligence · Computer Science 2024-11-01 Matthew V Macfarlane , Edan Toledo , Donal Byrne , Paul Duckworth , Alexandre Laterre

The increasing use of autonomous robot systems in hazardous environments underscores the need for efficient search and rescue operations. Despite significant advancements, existing literature on object search often falls short in overcoming…

Robotics · Computer Science 2024-04-08 Matthew Collins , Jared J. Beard , Nicholas Ohi , Yu Gu

Recent advances in active noise control have enabled the development of hearables with spatial selectivity, which actively suppress undesired noise while preserving desired sound from specific directions. In this work, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-16 Tong Xiao , Simon Doclo

Decision-making under uncertainty (DMU) is present in many important problems. An open challenge is DMU in non-stationary environments, where the dynamics of the environment can change over time. Reinforcement Learning (RL), a popular…

Artificial Intelligence · Computer Science 2022-03-01 Geoffrey Pettet , Ayan Mukhopadhyay , Abhishek Dubey

Path planning in robotics often involves solving continuously valued, high-dimensional problems. Popular informed approaches include graph-based searches, such as A*, and sampling-based methods, such as Informed RRT*, which utilize informed…

Robotics · Computer Science 2025-09-01 Liding Zhang , Kuanqi Cai , Yu Zhang , Zhenshan Bing , Chaoqun Wang , Fan Wu , Sami Haddadin , Alois Knoll

We consider the problem of Active Search, where a maximum of relevant objects - ideally all relevant objects - should be retrieved with the minimum effort or minimum time. Typically, there are two main challenges to face when tackling this…

Information Retrieval · Computer Science 2018-03-23 Jean-Michel Renders

Generative Flow Networks (GFlowNets) treat sampling from distributions over compositional discrete spaces as a sequential decision-making problem, training a stochastic policy to construct objects step by step. Recent studies have revealed…

Machine Learning · Computer Science 2024-06-21 Nikita Morozov , Daniil Tiapkin , Sergey Samsonov , Alexey Naumov , Dmitry Vetrov

A novel method called mixed variable system Monte Carlo tree search (MVSMCTS) formulation is presented for optimization problems considering various types of variables with single and mixed continuous-discrete system. This method utilizes a…

Optimization and Control · Mathematics 2024-10-31 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

Active perception strategies enable an agent to selectively gather information in a way to improve its performance. In applications in which the agent does not have prior knowledge about the available information sources, it is crucial to…

Artificial Intelligence · Computer Science 2019-10-08 Mahsa Ghasemi , Ufuk Topcu

Robust Policy Search is the problem of learning policies that do not degrade in performance when subject to unseen environment model parameters. It is particularly relevant for transferring policies learned in a simulation environment to…

Machine Learning · Computer Science 2021-11-23 Sai Kiran Narayanaswami , Nandan Sudarsanam , Balaraman Ravindran

Monte Carlo Tree Search (MCTS) has been proposed as a transformative approach to join-order optimization in database query processing, with recent frameworks such as AlphaJoin and HyperQO claiming to outperform traditional methods. However,…

Complex sequential decision-making planning problems, covering infinite states' space have been shown to be solvable by AlphaZero type of algorithms. Such an approach that trains a neural model while simulating projection of futures with a…

Artificial Intelligence · Computer Science 2024-08-13 Ronit Bustin , Claudia V. Goldman

Monte Carlo Tree Search (MCTS) based methods provide promising approaches for generating synthetic data to enhance the self-training of Large Language Model (LLM) based multi-agent systems (MAS). These methods leverage Q-values to estimate…

Computation and Language · Computer Science 2026-04-27 Wentao Shi , Zichun Yu , Fuli Feng , Xiangnan He , Chenyan Xiong

Importance sampling of trajectories has proved a uniquely successful strategy for exploring rare dynamical behaviors of complex systems in an unbiased way. Carrying out this sampling, however, requires an ability to propose changes to…

Statistical Mechanics · Physics 2015-07-01 Todd R. Gingrich , Phillip L. Geissler

Planning for goal-oriented dialogue often requires simulating future dialogue interactions and estimating task progress. Many approaches thus consider training neural networks to perform look-ahead search algorithms such as A* search and…

Computation and Language · Computer Science 2023-10-23 Xiao Yu , Maximillian Chen , Zhou Yu

Recently, greedy algorithm has received much attention as a cost-effective means to reconstruct the sparse signals from compressed measurements. Much of previous work has focused on the investigation of a single candidate to identify the…

Information Theory · Computer Science 2014-09-22 Jaeseok Lee , Suhyuk Kwon , Jun Won Choi , Byonghyo Shim

We explore how a general AI algorithm can be used for 3D scene understanding to reduce the need for training data. More exactly, we propose a modification of the Monte Carlo Tree Search (MCTS) algorithm to retrieve objects and room layouts…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Shreyas Hampali , Sinisa Stekovic , Sayan Deb Sarkar , Chetan Srinivasa Kumar , Friedrich Fraundorfer , Vincent Lepetit

Monte Carlo Tree Search (MCTS) is a powerful algorithm for solving complex decision-making problems. This paper presents an optimized MCTS implementation applied to the FrozenLake environment, a classic reinforcement learning task…

Artificial Intelligence · Computer Science 2024-09-26 Esteban Aldana Guerra

In this paper, we design an information-based multi-robot source seeking algorithm where a group of mobile sensors localizes and moves close to a single source using only local range-based measurements. In the algorithm, the mobile sensors…

Robotics · Computer Science 2023-09-14 Tianpeng Zhang , Victor Qin , Yujie Tang , Na Li

Accurate tracking of underwater acoustic sources is critical for a variety of marine applications, yet remains a challenging task due to communication constraints and environmental uncertainties. In this regard, this paper addresses the…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Andrea Tiranti , Francesco Wanderlingh , Enrico Simetti , Marco Baglietto , Giovanni Indiveri , Antonio Pascoal