English
Related papers

Related papers: Managing engineering systems with large state and …

200 papers

Owing to large industrial energy consumption, industrial production has brought a huge burden to the grid in terms of renewable energy access and power supply. Due to the coupling of multiple energy sources and the uncertainty of renewable…

Systems and Control · Electrical Eng. & Systems 2022-02-14 Dafeng Zhu , Bo Yang , Yuxiang Liu , Zhaojian Wang , Kai Ma , Xinping Guan

Reinforcement learning (RL) has gained increasing attraction in the academia and tech industry with launches to a variety of impactful applications and products. Although research is being actively conducted on many fronts (e.g., offline…

Machine Learning · Computer Science 2021-12-13 Ruiyang Xu , Zhengxing Chen

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include models such as…

Machine Learning · Computer Science 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

A sudden roadblock on highways due to many reasons such as road maintenance, accidents, and car repair is a common situation we encounter almost daily. Autonomous Vehicles (AVs) equipped with sensors that can acquire vehicle dynamics such…

Machine Learning · Computer Science 2023-09-27 Emanuel Figetakis , Yahuza Bello , Ahmed Refaey , Lei Lei , Medhat Moussa

In this paper we explore the usage of deep reinforcement learning algorithms to automatically generate consistently profitable, robust, uncorrelated trading signals in any general financial market. In order to do this, we present a novel…

Computational Finance · Quantitative Finance 2019-12-17 Souradeep Chakraborty

Reinforcement learning methods typically use Deep Neural Networks to approximate the value functions and policies underlying a Markov Decision Process. Unfortunately, DNN-based RL suffers from a lack of explainability of the resulting…

Systems and Control · Electrical Eng. & Systems 2022-05-19 Shambhuraj Sawant , Sebastien Gros

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Machine Learning · Computer Science 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

The continuous nature of belief states in POMDPs presents significant computational challenges in learning the optimal policy. In this paper, we consider an approach that solves a Partially Observable Reinforcement Learning (PORL) problem…

Machine Learning · Computer Science 2025-10-15 Ameya Anjarlekar , Rasoul Etesami , R Srikant

The stochastic and dynamic nature of renewable energy sources and power electronic devices are creating unique challenges for modern power systems. One such challenge is that the conventional mathematical systems models-based optimal active…

Optimization and Control · Mathematics 2019-09-02 Jiajun Duan , Haifeng Li , Xiaohu Zhang , Ruisheng Diao , Bei Zhang , Di Shi , Xiao Lu , Zhiwei Wang , Siqi Wang

The exponential growth of digital services has positioned data centers among the most energy-intensive infrastructures in the modern economy, raising critical concerns regarding operational costs, carbon emissions, and the sustainable…

Machine Learning · Computer Science 2026-05-05 Abderaouf Bahi , Amel Ourici , Hasan Dincer , Serhat Yuksel , Akila Djebbar

In standard Reinforcement Learning (RL) settings, the interaction between the agent and the environment is typically modeled as a Markov Decision Process (MDP), which assumes that the agent observes the system state instantaneously, selects…

Machine Learning · Computer Science 2025-06-18 John Wikman , Alexandre Proutiere , David Broman

In the domain of continuous control, deep reinforcement learning (DRL) demonstrates promising results. However, the dependence of DRL on deep neural networks (DNNs) results in the demand for extensive data and increased computational cost.…

Machine Learning · Computer Science 2025-04-15 Shiron Thalagala , Pak Kin Wong , Xiaozheng Wang , Tianang Sun

Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and…

Machine Learning · Computer Science 2020-01-31 Szilárd Aradi

This paper proposes a comprehensive hierarchical control framework for autonomous decision-making arising in robotics and autonomous systems. In a typical hierarchical control architecture, high-level decision making is often characterised…

Systems and Control · Electrical Eng. & Systems 2024-09-21 Xue-Fang Wang , Jingjing Jiang , Wen-Hua Chen

With the growth of intelligent civil infrastructure and smart cities, operation and maintenance (O&M) increasingly requires safe, efficient, and energy-conscious robotic manipulation of articulated components, including access doors,…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Xiaowen Tao , Yinuo Wang , Haitao Ding , Yuanyang Qi , Ziyu Song

Reinforcement learning (RL) has achieved remarkable success in a wide range of control and decision-making tasks. However, RL agents often exhibit unstable or degraded performance when deployed in environments subject to unexpected external…

Machine Learning · Computer Science 2026-03-13 Taeho Lee , Donghwan Lee

Power system optimal dispatch with transient security constraints is commonly represented as Transient Security-Constrained Optimal Power Flow (TSC-OPF). Deep Reinforcement Learning (DRL)-based TSC-OPF trains efficient decision-making…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Tannan Xiao , Ying Chen , Han Diao , Shaowei Huang , Chen Shen

Markov Decision Processes (MDPs) are the most common model for decision making under uncertainty in the Machine Learning community. An MDP captures non-determinism, probabilistic uncertainty, and an explicit model of action. A Reinforcement…

Artificial Intelligence · Computer Science 2025-06-10 Alena Makarova , Houssam Abbas

Recent benchmarks for memory-augmented reinforcement learning (RL) have introduced partially observable Markov decision process (POMDP) environments in which agents must use historical observations to make decisions. However, these…

Artificial Intelligence · Computer Science 2026-04-15 Yongyi Wang , Lingfeng Li , Bozhou Chen , Ang Li , Hanyu Liu , Qirui Zheng , Xionghui Yang , Wenxin Li

Sequential decision making, commonly formalized as optimization of a Markov Decision Process, is a key challenge in artificial intelligence. Two successful approaches to MDP optimization are reinforcement learning and planning, which both…

Machine Learning · Computer Science 2022-04-01 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker