English
Related papers

Related papers: Deep Recurrent Q-learning for Energy-constrained C…

200 papers

We study the routing problem for vehicles with limited energy through a network of inhomogeneous charging nodes. This is substantially more complicated than the homogeneous node case studied in [1]. We seek to minimize the total elapsed…

Optimization and Control · Mathematics 2014-04-25 Sepideh Pourazarm , Christos G. Cassandras

In this work, we consider the problem of network parameter optimization for rate maximization. We frame this as a joint optimization problem of power control, beam forming, and interference cancellation. We consider the setting where…

Machine Learning · Computer Science 2023-11-14 Heasung Kim , Sravan Kumar Ankireddy

Communication bandwidth is an important consideration in multi-robot exploration, where information exchange among robots is critical. While existing methods typically aim to reduce communication throughput, they either require significant…

Robotics · Computer Science 2024-07-30 Yixiao Ma , Jingsong Liang , Yuhong Cao , Derek Ming Siang Tan , Guillaume Sartoretti

Most existing deep reinforcement learning (DRL) frameworks consider either discrete action space or continuous action space solely. Motivated by applications in computer games, we consider the scenario with discrete-continuous hybrid action…

Machine Learning · Computer Science 2018-10-16 Jiechao Xiong , Qing Wang , Zhuoran Yang , Peng Sun , Lei Han , Yang Zheng , Haobo Fu , Tong Zhang , Ji Liu , Han Liu

A wireless network operator typically divides the radio spectrum it possesses into a number of subbands. In a cellular network those subbands are then reused in many cells. To mitigate co-channel interference, a joint spectrum and power…

Signal Processing · Electrical Eng. & Systems 2020-12-22 Yasar Sinan Nasir , Dongning Guo

In this paper, we propose a federated deep reinforcement learning framework to solve a multi-objective optimization problem, where we consider minimizing the expected long-term task completion delay and energy consumption of IoT devices.…

Networking and Internet Architecture · Computer Science 2021-04-26 Sheyda Zarandi , Hina Tabassum

Electric vehicles (EVs) play a significant role in enhancing the sustainability of transportation systems. However, their widespread adoption is hindered by inadequate public charging infrastructure, particularly to support long-distance…

Quantum Physics · Physics 2025-03-12 Tina Radvand , Alireza Talebpour , Homa Khosravian

The deployment of Deep Neural Networks in energy-constrained environments, such as Energy Harvesting Wireless Sensor Networks, presents unique challenges, primarily due to the intermittent nature of power availability. To address these…

Machine Learning · Computer Science 2025-01-28 Cyan Subhra Mishra , Deeksha Chaudhary , Jack Sampson , Mahmut Taylan Knademir , Chita Das

In this paper we propose a control framework that enables robots to execute tasks persistently, i.e., over time horizons much longer than robots' battery life. This is achieved by ensuring that the energy stored in the batteries of the…

Robotics · Computer Science 2019-11-04 Gennaro Notomista , Magnus Egerstedt

The growing deployment of electric mobility calls for power system analyses to investigate to what extent the simultaneous charging of electric vehicles leads to degraded network operation and to validate the efficiency of countermeasures.…

Systems and Control · Electrical Eng. & Systems 2023-02-09 Davide del Giudice , Angelo Maurizio Brambilla , Federico Bizzarri , Daniele Linaro , Samuele Grillo

We develop a hybrid system model to describe the behavior of multiple agents cooperatively solving an optimal coverage problem under energy depletion and repletion constraints. The model captures the controlled switching of agents between…

Signal Processing · Electrical Eng. & Systems 2020-03-04 Xiangyu Meng , Arian Houshmand , Christos G. Cassandras

We address the problem of achieving persistent surveillance over an environment by using energy-constrained unmanned aerial vehicles (UAVs), which are supported by unmanned ground vehicles (UGVs) serving as mobile charging stations.…

Systems and Control · Electrical Eng. & Systems 2019-08-19 Sepehr Seyedi , Yasin Yazicioglu , Derya Aksaray

Due to the rapid growth of heterogeneous wireless networks (HWNs), where devices with diverse communication technologies coexist, there is increasing demand for efficient and adaptive multi-hop routing with multiple data flows. Traditional…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

In this paper, dynamic non-cooperative coexistence between a cognitive pulsed radar and a nearby communications system is addressed by applying nonlinear value function approximation via deep reinforcement learning (Deep RL) to develop a…

Signal Processing · Electrical Eng. & Systems 2020-08-28 Charles E. Thornton , Mark A. Kozy , R. Michael Buehrer , Anthony F. Martone , Kelly D. Sherbondy

Deep Reinforcement Learning (RL) is unquestionably a robust framework to train autonomous agents in a wide variety of disciplines. However, traditional deep and shallow model-free RL algorithms suffer from low sample efficiency and…

Machine Learning · Computer Science 2022-10-05 Per-Arne Andersen , Ole-Christoffer Granmo , Morten Goodwin

We consider the problem of mass transport cloaking using mobile robots. The robots move along a predefined curve that encloses a safe zone and carry sources that collectively counteract a chemical agent released in the environment. The goal…

Robotics · Computer Science 2020-03-10 Reza Khodayi-mehr , Michael M. Zavlanos

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms…

Machine Learning · Computer Science 2025-10-31 Sebastian Zieglmeier , Niklas Erdmann , Narada D. Warakagoda

Electrification of vehicles is a potential way of reducing fossil fuel usage and thus lessening environmental pollution. Electric Vehicles (EVs) of various types for different transport modes (including air, water, and land) are evolving.…

Machine Learning · Computer Science 2024-09-19 Mohammad Wazed Ali , Asif bin Mustafa , Md. Aukerul Moin Shuvo , Bernhard Sick

Quantum reinforcement learning (QRL) promises compact function approximators with access to vast Hilbert spaces, but its practical progress is slowed by NISQ-era constraints such as limited qubits and noise accumulation. We introduce a…

Quantum Physics · Physics 2025-09-03 Junghoon Justin Park , Huan-Hsin Tseng , Shinjae Yoo , Samuel Yen-Chi Chen , Jiook Cha

Electric Vehicles (EVs) are becoming increasingly prevalent nowadays, with studies highlighting their potential as mobile energy storage systems to provide grid support. Realising this potential requires effective charging coordination,…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Jun Kang Yap , Vishnu Monn Baskaran , Wen Shan Tan , Ze Yang Ding , Hao Wang , David L. Dowe