English
Related papers

Related papers: Sequence Aware SAC Control for Engine Fuel Consump…

200 papers

Many optimal control problems require the simultaneous output of discrete and continuous control variables. These problems are usually formulated as mixed-integer optimal control (MIOC) problems, which are challenging to solve due to the…

Systems and Control · Electrical Eng. & Systems 2024-06-03 Jinming Xu , Nasser Lashgarian Azad , Yuan Lin

High-precision control tasks present substantial challenges for reinforcement learning (RL) algorithms, frequently resulting in suboptimal performance attributed to network approximation inaccuracies and inadequate sample quality.These…

Machine Learning · Computer Science 2025-02-05 Donghe Chen , Yubin Peng , Tengjie Zheng , Han Wang , Chaoran Qu , Lin Cheng

This paper develops energy management (EM) control for series hybrid electric vehicles (HEVs) that include an engine start-stop system (SSS). The objective of the control is to optimally split the energy between the sources of the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Boli Chen , Xiao Pan , Simos A. Evangelou

Coverage Path Planning (CPP) is a fundamental capability for agricultural robots; however, existing solutions often overlook energy constraints, resulting in incomplete operations in large-scale or resource-limited environments. This paper…

Robotics · Computer Science 2026-01-26 Beining Wu , Zihao Ding , Leo Ostigaard , Jun Huang

We present GuidedSAC, a novel reinforcement learning (RL) algorithm that facilitates efficient exploration in vast state-action spaces. GuidedSAC leverages large language models (LLMs) as intelligent supervisors that provide action-level…

Machine Learning · Computer Science 2026-03-19 Hao Ma , Zhiqiang Pu , Xiaolin Ai , Huimu Wang

Reinforcement learning is a promising model-free and adaptive controller for demand side management, as part of the future smart grid, at the district level. This paper presents the results of the algorithm that was submitted for the…

Machine Learning · Computer Science 2021-04-27 Anjukan Kathirgamanathan , Kacper Twardowski , Eleni Mangina , Donal Finn

Accurate power consumption prediction is crucial for improving efficiency and reducing environmental impact, yet traditional methods relying on specialized instruments or rigid physical models are impractical for large-scale, real-world…

Machine Learning · Computer Science 2025-08-12 Roksana Yahyaabadi , Ghazal Farhani , Taufiq Rahman , Soodeh Nikan , Abdullah Jirjees , Fadi Araji

This paper proposes an ecological adaptive cruise control (EACC) concept with the primary goal to minimize the fuel consumption in a city bus with an internal combustion engine (ICE). A hybrid model predictive control (HMPC) is implemented…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Sai Krishna Chada , Jitin Mathew Thomas , Daniel Görges , Achim Ebert , Roman Teutsch

Traffic congestion in urban road networks leads to longer trip times and higher emissions, especially during peak periods. While the Shortest Path First (SPF) algorithm is optimal for a single vehicle in a static network, it performs poorly…

Machine Learning · Computer Science 2025-10-31 Fazel Arasteh , Arian Haghparast , Manos Papagelis

In this paper, we propose an approach to designing online feedback controllers for input-saturated robotic systems evolving on Lie groups by extending the recently developed Sequential Action Control (SAC). In contrast to existing feedback…

Optimization and Control · Mathematics 2017-09-04 Taosha Fan , Todd Murphey

This work presents three computational methods for real time energy management in a hybrid hydraulic vehicle (HHV) when driver behavior and vehicle route are not known in advance. These methods, implemented in a receding horizon control…

Systems and Control · Computer Science 2018-04-25 Kyle Williams

Learning expressive stochastic policies instead of deterministic ones has been proposed to achieve better stability, sample complexity, and robustness. Notably, in Maximum Entropy Reinforcement Learning (MaxEnt RL), the policy is modeled as…

Machine Learning · Computer Science 2024-05-03 Safa Messaoud , Billel Mokeddem , Zhenghai Xue , Linsey Pang , Bo An , Haipeng Chen , Sanjay Chawla

With the increasing penetration of renewable energy sources, growing demand variability, and evolving grid control strategies, accurate and efficient load modeling has become a critical yet challenging task. Traditional methods, such as…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Ding Lin , Han Guo , Jianhui Wang , Meng Yue , Tianqiao Zhao

One of the major limitations of optimization-based strategies for allocating the power flow in hybrid powertrains is that they rely on predictions of future power demand. These predictions are inherently uncertain as they are dependent on…

Optimization and Control · Mathematics 2022-04-14 Sebastian East , Mark Cannon

Buildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Chi Zhang , Sanmukh R. Kuppannagari , Rajgopal Kannan , Viktor K. Prasanna

The recent progress in multi-agent deep reinforcement learning(MADRL) makes it more practical in real-world tasks, but its relatively poor scalability and the partially observable constraints raise challenges to its performance and…

Machine Learning · Computer Science 2021-09-07 Zhenhui Ye , Xiaohong Jiang , Guanghua Song , Bowei Yang

In recent years, the development of Artificial Intelligence (AI) has shown tremendous potential in diverse areas. Among them, reinforcement learning (RL) has proven to be an effective solution for learning intelligent control strategies. As…

Machine Learning · Computer Science 2023-05-23 Xinyang Wu , Elisabeth Wedernikow , Christof Nitsche , Marco F. Huber

The performance of deep reinforcement learning methods prone to degenerate when applied to environments with non-stationary dynamics. In this paper, we utilize the latent context recurrent encoders motivated by recent Meta-RL materials, and…

Machine Learning · Computer Science 2021-05-11 Yuan Pu , Shaochen Wang , Xin Yao , Bin Li

The widespread adoption of photovoltaic (PV), electric vehicles (EVs), and stationary energy storage systems (ESS) in households increases system complexity while simultaneously offering new opportunities for energy regulation. However,…

Systems and Control · Electrical Eng. & Systems 2026-02-05 Meng Yuan , Ye Wang , Xinghuo Yu , Torsten Wik , Changfu Zou

Automated vehicle technologies offer a promising avenue for enhancing traffic efficiency, safety, and energy consumption. Among these, Adaptive Cruise Control (ACC) systems stand out as a prevalent form of automation on today's roads, with…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Shaimaa K. El-Baklish , Anastasios Kouvelas , Michail A. Makridis