English
Related papers

Related papers: Monte Carlo Beam Search for Actor-Critic Reinforce…

200 papers

We consider the problem of costly feature classification, where we sequentially select the subset of features to make a balance between the classification error and the feature cost. In this paper, we first cast the task into a MDP problem…

Machine Learning · Computer Science 2021-02-16 Ziheng Chen , Jin Huang , Hongshik Ahn , Xin Ning

We propose a provably correct Monte Carlo tree search (MCTS) algorithm for solving risk-aware Markov decision processes (MDPs) with entropic risk measure (ERM) objectives. We provide a non-asymptotic analysis of our proposed algorithm,…

Machine Learning · Computer Science 2026-02-06 Pedro P. Santos , Jacopo Silvestrin , Alberto Sardinha , Francisco S. Melo

Visual language models (VLMs) have demonstrated strong performance across diverse multimodal reasoning tasks but still face challenges such as hallucinations, resulting in incorrect reasoning outcomes. Inspired by recent research on…

Multimedia · Computer Science 2025-04-16 Shuhang Liu , Zhenrong Zhang , Pengfei Hu , Jiefeng Ma , Jun Du , Qing Wang , Jianshu Zhang , Quan Liu , Jianqing Gao , Feng Ma

We propose a novel method for reconstructing floor plans from noisy 3D point clouds. Our main contribution is a principled approach that relies on the Monte Carlo Tree Search (MCTS) algorithm to maximize a suitable objective function…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Sinisa Stekovic , Mahdi Rad , Friedrich Fraundorfer , Vincent Lepetit

In the evolving landscape of urban mobility, the prospective integration of Connected and Automated Vehicles (CAVs) with Human-Driven Vehicles (HDVs) presents a complex array of challenges and opportunities for autonomous driving systems.…

Robotics · Computer Science 2024-09-09 Han Zheng , Zhongxia Yan , Cathy Wu

This paper addresses the slow policy optimization convergence of Monte Carlo Probabilistic Inference for Learning Control (MC-PILCO), a state-of-the-art model-based reinforcement learning (MBRL) algorithm, by integrating it with iterative…

Machine Learning · Computer Science 2025-06-04 Marco Calì , Giulio Giacomuzzo , Ruggero Carli , Alberto Dalla Libera

This work considers the problem of learning cooperative policies in multi-agent settings with partially observable and non-stationary environments without a communication channel. We focus on improving information sharing between agents and…

Machine Learning · Computer Science 2021-09-03 Eshagh Kargar , Ville Kyrki

Distributed learning methods have gained substantial momentum in recent years, with communication overhead often emerging as a critical bottleneck. Gradient compression techniques alleviate communication costs but involve an inherent…

Machine Learning · Computer Science 2025-07-09 Ze'ev Zukerman , Bassel Hamoud , Kfir Y. Levy

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

Model Predictive Control (MPC)-based Reinforcement Learning (RL) offers a structured and interpretable alternative to Deep Neural Network (DNN)-based RL methods, with lower computational complexity and greater transparency. However,…

Systems and Control · Electrical Eng. & Systems 2025-07-15 Hossein Nejatbakhsh Esfahani , Javad Mohammadpour Velni

Conventional multi-agent path planners typically compute an ensemble of paths while optimizing a single objective, such as path length. However, many applications may require multiple objectives, say fuel consumption and completion time, to…

Artificial Intelligence · Computer Science 2022-06-23 Zhongqiang Ren , Sivakumar Rathinam , Howie Choset

Dynamic discrete choice (DDC) models have found widespread application in marketing. However, estimating these becomes challenging in "big data" settings with high-dimensional state-action spaces. To address this challenge, this paper…

Econometrics · Economics 2026-01-06 Ahmed Khwaja , Sonal Srivastava

Medical language models face critical barriers to real-world clinical reasoning applications. However, mainstream efforts, which fall short in task coverage, lack fine-grained supervision for intermediate reasoning steps, and rely on…

Computation and Language · Computer Science 2025-11-26 Shuyang Jiang , Yusheng Liao , Zhe Chen , Ya Zhang , Yanfeng Wang , Yu Wang

Deep reinforcement learning has been successfully applied to several visual-input tasks using model-free methods. In this paper, we propose a model-based approach that combines learning a DNN-based transition model with Monte Carlo tree…

Artificial Intelligence · Computer Science 2018-03-23 Stephan Alaniz

Recent research works establish deep neural networks as high performing tools for radar target detection, especially on challenging environments (presence of clutter or interferences, multi-target scenarii...). However, the usually large…

Signal Processing · Electrical Eng. & Systems 2025-06-30 Noé Lallouet , Tristan Cazenave , Cyrille Enderli , Stéphanie Gourdin

Monte-Carlo Tree Search (MCTS) methods, such as Upper Confidence Bound applied to Trees (UCT), are instrumental to automated planning techniques. However, UCT can be slow to explore an optimal action when it initially appears inferior to…

Artificial Intelligence · Computer Science 2024-04-12 Michael Painter , Mohamed Baioumy , Nick Hawes , Bruno Lacerda

Inspired by recent successes of Monte-Carlo tree search (MCTS) in a number of artificial intelligence (AI) application domains, we propose a model-based reinforcement learning (RL) technique that iteratively applies MCTS on batches of…

Artificial Intelligence · Computer Science 2018-05-16 Daniel R. Jiang , Emmanuel Ekwedike , Han Liu

The dynamic dispatch (DD) of battery energy storage systems (BESSs) in microgrids integrated with volatile energy resources is essentially a multiperiod stochastic optimization problem (MSOP). Because the life span of a BESS is…

Systems and Control · Electrical Eng. & Systems 2020-07-07 Yuwei Shang , Wenchuan Wu , Jianbo Guo , Zhe Lv , Zhao Ma , Wanxing Sheng , Ran Chen

Cooperative trajectory planning methods for automated vehicles can solve traffic scenarios that require a high degree of cooperation between traffic participants. However, for cooperative systems to integrate into human-centered traffic,…

Machine Learning · Computer Science 2022-11-15 Karl Kurzer , Matthias Bitzer , J. Marius Zöllner

Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation…

Artificial Intelligence · Computer Science 2017-06-14 Jinzhuo Wang , Wenmin Wang , Ronggang Wang , Wen Gao