English
Related papers

Related papers: Evaluating Robustness and Adaptability in Learning…

200 papers

Downtime of industrial assets such as wind turbines and medical imaging devices is costly. To avoid such downtime costs, companies seek to initiate maintenance just before failure, which is challenging because: (i) Asset failures are…

Optimization and Control · Mathematics 2024-01-10 Peter Verleijsdonk , Willem van Jaarsveld , Stella Kapodistria

Deep Reinforcement Learning (DRL) has been a promising solution to many complex decision-making problems. Nevertheless, the notorious weakness in generalization among environments prevent widespread application of DRL agents in real-world…

Machine Learning · Computer Science 2022-05-31 Tong Sang , Hongyao Tang , Yi Ma , Jianye Hao , Yan Zheng , Zhaopeng Meng , Boyan Li , Zhen Wang

We present a scalable tree search planning algorithm for large multi-agent sequential decision problems that require dynamic collaboration. Teams of agents need to coordinate decisions in many domains, but naive approaches fail due to the…

Artificial Intelligence · Computer Science 2021-01-14 Shushman Choudhury , Jayesh K. Gupta , Peter Morales , Mykel J. Kochenderfer

Planning provides a framework for optimizing sequential decisions in complex environments. Recent advances in efficient planning in deterministic or stochastic high-dimensional domains with continuous action spaces leverage backpropagation…

Machine Learning · Computer Science 2021-06-15 Noah Patton , Jihwan Jeong , Michael Gimelfarb , Scott Sanner

We consider the joint design and control of discrete-time stochastic dynamical systems over a finite time horizon. We formulate the problem as a multi-step optimization problem under uncertainty seeking to identify a system design and a…

Machine Learning · Computer Science 2022-01-07 Adrien Bolland , Ioannis Boukas , Mathias Berger , Damien Ernst

Planning problems are hard, motion planning, for example, isPSPACE-hard. Such problems are even more difficult in the presence of uncertainty. Although, Markov Decision Processes (MDPs) provide a formal framework for such problems, finding…

Artificial Intelligence · Computer Science 2013-01-14 Carlos E. Guestrin , Dirk Ormoneit

Reinforcement learning (RL) has been successfully applied to solve the problem of finding obstacle-free paths for autonomous agents operating in stochastic and uncertain environments. However, when the underlying stochastic dynamics of the…

Machine Learning · Computer Science 2024-10-29 Sheryl Paul , Jyotirmoy V. Deshmukh

Mobile edge computing (MEC)-enabled air-ground networks are a key component of 6G, employing aerial base stations (ABSs) such as unmanned aerial vehicles (UAVs) and high-altitude platform stations (HAPS) to provide dynamic services to…

Machine Learning · Computer Science 2025-03-06 Muhammet Hevesli , Abegaz Mohammed Seid , Aiman Erbad , Mohamed Abdallah

Real-world multi-agent planning problems cannot be solved using decision-theoretic planning methods due to the exponential complexity. We approximate firefighting in rescue simulation as a spatially distributed task and model with…

Artificial Intelligence · Computer Science 2016-06-07 Okan Aşık , H. Levent Akın

Pioneering companies such as Waymo have deployed robo-taxi services in several U.S. cities. These robo-taxis are electric vehicles, and their operations require the joint optimization of ride matching, vehicle repositioning, and charging…

Artificial Intelligence · Computer Science 2025-04-29 Jim Dai , Manxi Wu , Zhanhao Zhang

Long-distance driving is an important component of planetary surface exploration. Unforeseen events often require human operators to adjust mobility plans, but this approach does not scale and will be insufficient for future missions.…

Robotics · Computer Science 2024-12-31 Olivier Lamarre , Jonathan Kelly

Existing methods for avoiding dynamic engagement zones (EZs) and minimizing risk leverage the calculus of variations to obtain optimal paths. While such methods are deterministic, they scale poorly as the number of engagement zones…

Optimization and Control · Mathematics 2024-03-11 Artur Wolek , Isaac E. Weintraub , Alexander Von Moll , David Casbeer , Satyanarayana G. Manyam

For UAV-aided wireless systems, online path planning attracts much attention recently. To better adapt to the real-time dynamic environment, we, for the first time, propose a Monte Carlo Tree Search (MCTS)-based path planning scheme. In…

Networking and Internet Architecture · Computer Science 2022-02-08 Yuwen Qian , Kexin Sheng , Chuan Ma , Jun Li , Ming Ding , Mahbub Hassan

The Pod Repositioning Problem (PRP) in Robotic Mobile Fulfillment Systems (RMFS) involves selecting optimal storage locations for pods returning from pick stations. This work presents an improved solution method that integrates Adaptive…

Robotics · Computer Science 2025-06-04 Lin Xie , Hanyi Li

Coverage path planning (CPP) is a critical problem in robotics, where the goal is to find an efficient path that covers every point in an area of interest. This work addresses the power-constrained CPP problem with recharge for…

Robotics · Computer Science 2024-10-28 Mirco Theile , Harald Bayerlein , Marco Caccamo , Alberto L. Sangiovanni-Vincentelli

This paper investigates the model-based methods in multi-agent reinforcement learning (MARL). We specify the dynamics sample complexity and the opponent sample complexity in MARL, and conduct a theoretic analysis of return discrepancy upper…

Machine Learning · Computer Science 2022-03-18 Weinan Zhang , Xihuai Wang , Jian Shen , Ming Zhou

Quick response times are paramount for minimizing downtime in spare parts networks for capital goods, such as medical and manufacturing equipment. To guarantee that the maintenance is performed in a timely fashion, strategic management of…

Optimization and Control · Mathematics 2019-10-04 Dmitrii Usanov , Anna Pechina , Peter van de Ven , Rob van der Mei

Learning control policies in simulation enables rapid, safe, and cost-effective development of advanced robotic capabilities. However, transferring these policies to the real world remains difficult due to the sim-to-real gap, where…

Robotics · Computer Science 2026-01-16 Jiahe Pan , Jiaxu Xing , Rudolf Reiter , Yifan Zhai , Elie Aljalbout , Davide Scaramuzza

Road maintenance planning is an integral part of road asset management. One of the main challenges in Maintenance and Rehabilitation (M&R) practices is to determine maintenance type and timing. This research proposes a framework using…

Machine Learning · Computer Science 2023-11-28 Moein Latifi , Fateme Golivand Darvishvand , Omid Khandel , Mobin Latifi Nowsoud

We consider the problem of learning in adversarial Markov decision processes [MDPs] with an oblivious adversary in a full-information setting. The agent interacts with an environment during $T$ episodes, each of which consists of $H$…

Machine Learning · Computer Science 2025-03-06 Daniil Tiapkin , Evgenii Chzhen , Gilles Stoltz