中文
相关论文

相关论文: Memory-based Deep Reinforcement Learning for POMDP…

200 篇论文

Motion planning of autonomous agents in partially known environments with incomplete information is a challenging problem, particularly for complex tasks. This paper proposes a model-free reinforcement learning approach to address this…

人工智能 · 计算机科学 2023-05-02 Junchao Li , Mingyu Cai , Zhen Kan , Shaoping Xiao

Here, we explore the problem of error propagation mitigation in modular digital twins as a sequential decision process. Building on a companion study that used a Hidden Markov Model (HMM) to infer latent error regimes from surrogate-physics…

机器学习 · 计算机科学 2026-04-27 Annice Najafi , Shokoufeh Mirzaei

We introduce a novel deep reinforcement learning (RL) approach called Movement Primitive-based Planning Policy (MP3). By integrating movement primitives (MPs) into the deep RL framework, MP3 enables the generation of smooth trajectories…

机器学习 · 计算机科学 2023-07-04 Fabian Otto , Hongyi Zhou , Onur Celik , Ge Li , Rudolf Lioutikov , Gerhard Neumann

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

机器人学 · 计算机科学 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

The Pickup and Delivery Problem (PDP) is a fundamental and challenging variant of the Vehicle Routing Problem, characterized by tightly coupled pickup--delivery pairs, precedence constraints, and spatial layouts that often exhibit…

机器学习 · 计算机科学 2026-03-12 Wentao Wang , Lifeng Han , Guangyu Zou

Optimal control of parametric partial differential equations (PDEs) is crucial in many applications in engineering and science. In recent years, the progress in scientific machine learning has opened up new frontiers for the control of…

机器学习 · 计算机科学 2024-10-10 Nicolò Botteghi , Urban Fasel

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

系统与控制 · 电气工程与系统科学 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Deep Reinforcement Learning (DRL) has achieved great success in solving complicated decision-making problems. Despite the successes, DRL is frequently criticized for many reasons, e.g., data inefficient, inflexible and intractable reward…

机器学习 · 计算机科学 2023-02-07 Weiqin Chen

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL,…

机器学习 · 计算机科学 2022-11-28 Tingting Zhao , Ying Wang , Wei Sun , Yarui Chen , Gang Niub , Masashi Sugiyama

Deep Reinforcement Learning (DRL) has achieved remarkable advances in sequential decision tasks. However, recent works have revealed that DRL agents are susceptible to slight perturbations in observations. This vulnerability raises concerns…

机器学习 · 计算机科学 2023-12-15 Buqing Nie , Jingtian Ji , Yangqing Fu , Yue Gao

High Power Laser's (HPL) optimal performance is essential for the success of a wide variety of experimental tasks related to light-matter interactions. Traditionally, HPL parameters are optimised in an automated fashion relying on black-box…

The traveling purchaser problem (TPP) is an important combinatorial optimization problem with broad applications. Due to the coupling between routing and purchasing, existing works on TPPs commonly address route construction and purchase…

最优化与控制 · 数学 2025-07-03 Haofeng Yuan , Rongping Zhu , Wanlu Yang , Shiji Song , Keyou You , Wei Fan , C. L. Philip Chen

In this paper, we study representation learning in partially observable Markov Decision Processes (POMDPs), where the agent learns a decoder function that maps a series of high-dimensional raw observations to a compact representation and…

机器学习 · 计算机科学 2023-06-22 Jiacheng Guo , Zihao Li , Huazheng Wang , Mengdi Wang , Zhuoran Yang , Xuezhou Zhang

Reinforcement learning (RL) approaches based on Markov Decision Processes (MDPs) are predominantly applied in the robot joint space, often relying on limited task-specific information and partial awareness of the 3D environment. In…

机器人学 · 计算机科学 2026-03-09 Bingkun Huang , Yuhe Gong , Zewen Yang , Tianyu Ren , Luis Figueredo

Partially observable Markov decision processes (POMDPs) are standard models for dynamic systems with probabilistic and nondeterministic behaviour in uncertain environments. We prove that in POMDPs with long-run average objective, the…

计算机科学与博弈论 · 计算机科学 2022-09-29 Krishnendu Chatterjee , Raimundo Saona , Bruno Ziliotto

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

机器学习 · 计算机科学 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

Reinforcementlearning(RL)folkloresuggeststhathistory-basedfunctionapproximationmethods,suchas recurrent neural nets or history-based state abstraction, perform better than their memory-less counterparts, due to the fact that function…

机器学习 · 计算机科学 2022-11-08 Gandharv Patil , Aditya Mahajan , Doina Precup

Policy-gradient methods have received increased attention recently as a mechanism for learning to act in partially observable environments. They have shown promise for problems admitting memoryless policies but have been less successful…

机器学习 · 计算机科学 2025-12-08 Douglas Aberdeen , Jonathan Baxter

Action delays degrade the performance of reinforcement learning in many real-world systems. This paper proposes a formal definition of delay-aware Markov Decision Process and proves it can be transformed into standard MDP with augmented…

机器学习 · 计算机科学 2021-05-10 Baiming Chen , Mengdi Xu , Liang Li , Ding Zhao

Deep Reinforcement Learning has shown its ability in solving complicated problems directly from high-dimensional observations. However, in end-to-end settings, Reinforcement Learning algorithms are not sample-efficient and requires long…

机器学习 · 计算机科学 2021-07-06 Nicolò Botteghi , Mannes Poel , Beril Sirmacek , Christoph Brune