English
Related papers

Related papers: Deep Recurrent Q-learning for Energy-constrained C…

200 papers

The vehicle routing problem (VRP) is a fundamental NP-hard task in intelligent transportation systems with broad applications in logistics and distribution. Deep reinforcement learning (DRL) with Graph Neural Networks (GNNs) has shown…

Machine Learning · Computer Science 2025-11-20 Le Tung Giang , Vu Hoang Viet , Nguyen Xuan Tung , Trinh Van Chien , Won-Joo Hwang

Continuous exploration without interruption is important in scenarios such as search and rescue and precision agriculture, where consistent presence is needed to detect events over large areas. Ergodic search already derives continuous…

Robotics · Computer Science 2024-02-22 Adam Seewald , Cameron J. Lerch , Marvin Chancán , Aaron M. Dollar , Ian Abraham

This paper proposes an end-to-end deep reinforcement learning approach for mobile robot navigation with dynamic obstacles avoidance. Using experience collected in a simulation environment, a convolutional neural network (CNN) is trained to…

Robotics · Computer Science 2020-02-12 Guangda Chen , Lifan Pan , Yu'an Chen , Pei Xu , Zhiqiang Wang , Peichen Wu , Jianmin Ji , Xiaoping Chen

Coverage Path Planning (CPP) is a fundamental capability for agricultural robots; however, existing solutions often overlook energy constraints, resulting in incomplete operations in large-scale or resource-limited environments. This paper…

Robotics · Computer Science 2026-01-26 Beining Wu , Zihao Ding , Leo Ostigaard , Jun Huang

A total 19% of generation capacity in California is offered by PV units and over some months, more than 10% of this energy is curtailed. In this research, a novel approach to reduce renewable generation curtailments and increasing system…

Systems and Control · Electrical Eng. & Systems 2022-01-20 Reza Bayani , Saeed D. Manshadi , Guangyi Liu , Yawei Wang , Renchang Dai

Mobile robots are increasingly being used to assist with active pursuit and law enforcement. One major limitation for such missions is the resource (battery) allocated to the robot. Factors like nature and agility of evader, terrain over…

Robotics · Computer Science 2018-11-09 Kshitij Tiwari , Xuesu Xiao , Nak Young Chong

Many DNN-enabled vision applications constantly operate under severe energy constraints such as unmanned aerial vehicles, Augmented Reality headsets, and smartphones. Designing DNNs that can meet a stringent energy budget is becoming…

Machine Learning · Computer Science 2019-04-09 Haichuan Yang , Yuhao Zhu , Ji Liu

This paper presents a novel algorithm, called $\epsilon^*$+, for online coverage path planning of unknown environments using energy-constrained autonomous vehicles. Due to limited battery size, the energy-constrained vehicles have limited…

Robotics · Computer Science 2021-08-04 Zongyuan Shen , James P. Wilson , Shalabh Gupta

Object rearranging is one of the most common deformable manipulation tasks, where the robot needs to rearrange a deformable object into a goal configuration. Previous studies focus on designing an expert system for each specific task by…

Robotics · Computer Science 2023-02-22 Yuhong Deng , Chongkun Xia , Xueqian Wang , Lipeng Chen

Deep reinforcement learning enables algorithms to learn complex behavior, deal with continuous action spaces and find good strategies in environments with high dimensional state spaces. With deep reinforcement learning being an active area…

Machine Learning · Computer Science 2018-10-17 Winfried Lötzsch

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

The rise of electric vehicles (EVs) is unstoppable due to factors such as the decreasing cost of batteries and various policy decisions. These vehicles need to be charged and will therefore cause congestion in local distribution grids in…

Probability · Mathematics 2018-10-15 Angelos Aveklouris , Maria Vlasiou , Bert Zwart

Endowing continuum robots with compliance while it is interacting with the internal environment of the human body is essential to prevent damage to the robot and the surrounding tissues. Compared with passive compliance, active compliance…

Robotics · Computer Science 2024-01-30 David Jakes , Zongyuan Ge , Liao Wu

Multi-agent reinforcement learning (MARL) has shown wide applicability in collaborative systems such as autonomous driving and smart cities for its ability of learning through interaction. With the recent development of drone networks,…

Networking and Internet Architecture · Computer Science 2026-05-26 Changling Li , Ying Li

The Q-learning algorithm is known to be affected by the maximization bias, i.e. the systematic overestimation of action values, an important issue that has recently received renewed attention. Double Q-learning has been proposed as an…

Machine Learning · Computer Science 2021-02-03 Rong Zhu , Mattia Rigotti

With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by…

Neural and Evolutionary Computing · Computer Science 2024-05-09 Ding Chen , Peixi Peng , Tiejun Huang , Yonghong Tian

Electric Vehicle (EV) has become a preferable choice in the modern transportation system due to its environmental and energy sustainability. However, in many large cities, EV drivers often fail to find the proper spots for charging, because…

Machine Learning · Computer Science 2021-02-16 Weijia Zhang , Hao Liu , Fan Wang , Tong Xu , Haoran Xin , Dejing Dou , Hui Xiong

In this work, we propose a novel cross Q-learning algorithm, aim at alleviating the well-known overestimation problem in value-based reinforcement learning methods, particularly in the deep Q-networks where the overestimation is exaggerated…

Artificial Intelligence · Computer Science 2020-09-30 Xing Wang , Alexander Vinel

Development of navigation algorithms is essential for the successful deployment of robots in rapidly changing hazardous environments for which prior knowledge of configuration is often limited or unavailable. Use of traditional…

Robotics · Computer Science 2022-11-11 Paul Blum , Peter Crowley , George Lykotrafitis

Deep Reinforcement Learning can play a key role in addressing sustainable energy challenges. For instance, many grid systems are heavily congested, highlighting the urgent need to enhance operational efficiency. However, reinforcement…

Machine Learning · Computer Science 2025-07-03 Koen Ponse , Jan Felix Kleuker , Aske Plaat , Thomas Moerland