English
Related papers

Related papers: STDPG: A Spatio-Temporal Deterministic Policy Grad…

200 papers

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance between centralized…

Networking and Internet Architecture · Computer Science 2024-03-15 Ioannis Panitsas , Akrit Mudvari , Leandros Tassiulas

Traffic forecasting has emerged as a core component of intelligent transportation systems. However, timely accurate traffic forecasting, especially long-term forecasting, still remains an open challenge due to the highly nonlinear and…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Mingxing Xu , Wenrui Dai , Chunmiao Liu , Xing Gao , Weiyao Lin , Guo-Jun Qi , Hongkai Xiong

This letter proposes a deep neural network (DNN)-based neuro-adaptive sliding mode control (SMC) strategy for leader-follower tracking in multi-agent systems with higher-order, heterogeneous, nonlinear, and unknown dynamics under external…

Systems and Control · Electrical Eng. & Systems 2025-07-30 Khushal Chaudhari , Krishanu Nath , Manas Kumar Bera

Lane change is a challenging task which requires delicate actions to ensure safety and comfort. Some recent studies have attempted to solve the lane-change control problem with Reinforcement Learning (RL), yet the action is confined to…

Robotics · Computer Science 2019-06-07 Pin Wang , Hanhan Li , Ching-Yao Chan

Among the many variants of RL, an important class of problems is where the state and action spaces are continuous -- autonomous robots, autonomous vehicles, optimal control are all examples of such problems that can lend themselves…

Artificial Intelligence · Computer Science 2024-10-16 Rajesh Mangannavar , Gopalakrishnan Srinivasaraghavan

Spike-timing-dependent-plasticity (STDP) is an unsupervised learning algorithm for spiking neural network (SNN), which promises to achieve deeper understanding of human brain and more powerful artificial intelligence. While conventional…

Neural and Evolutionary Computing · Computer Science 2019-09-13 Xueyuan She , Yun Long , Saibal Mukhopadhyay

Message transmission and message synchronization for multicontroller interdomain routing in software-defined networking (SDN) have long adaptation times and slow convergence speeds, coupled with the shortcomings of traditional interdomain…

Networking and Internet Architecture · Computer Science 2023-03-15 Miao Ye , Linqiang Huang , Xiaofang Deng , Yong Wang , Qiuxiang Jiang , Hongbing Qiu , Peng Wen

Deep reinforcement learning (DRL)-based frameworks, featuring Transformer-style policy networks, have demonstrated their efficacy across various vehicle routing problem (VRP) variants. However, the application of these methods to the…

Artificial Intelligence · Computer Science 2025-03-07 Arash Mozhdehi , Yunli Wang , Sun Sun , Xin Wang

Multivariate time series forecasting is a challenging task because the data involves a mixture of long- and short-term patterns, with dynamic spatio-temporal dependencies among variables. Existing graph neural networks (GNN) typically model…

Machine Learning · Computer Science 2021-12-08 Zhuoling Li , Gaowei Zhang , Lingyu Xu , Jie Yu

We introduce Dynamic Planning Networks (DPN), a novel architecture for deep reinforcement learning, that combines model-based and model-free aspects for online planning. Our architecture learns to dynamically construct plans using a learned…

Machine Learning · Computer Science 2019-02-05 Norman Tasfi , Miriam Capretz

With recent advances in sensing technologies, a myriad of spatio-temporal data has been generated and recorded in smart cities. Forecasting the evolution patterns of spatio-temporal data is an important yet demanding aspect of urban…

Machine Learning · Computer Science 2023-11-27 Guangyin Jin , Yuxuan Liang , Yuchen Fang , Zezhi Shao , Jincai Huang , Junbo Zhang , Yu Zheng

Traffic Engineering (TE) is an efficient technique to balance network flows and thus improves the performance of a hybrid Software Defined Network (SDN). Previous TE solutions mainly leverage heuristic algorithms to centrally optimize link…

Networking and Internet Architecture · Computer Science 2023-08-01 Yingya Guo , Qi Tang , Yulong Ma , Han Tian , Kai Chen

In the domain of dynamic graph representation learning (DGRL), the efficient and comprehensive capture of temporal evolution within real-world networks is crucial. Spiking Neural Networks (SNNs), known as their temporal dynamics and…

Neural and Evolutionary Computing · Computer Science 2024-04-12 Dong Chen , Shuai Zheng , Muhao Xu , Zhenfeng Zhu , Yao Zhao

Reinforcement Learning (RL) is crucial for unlocking the complex reasoning capabilities of Diffusion-based Large Language Models (dLLMs). However, applying RL to dLLMs faces unique challenges in efficiency and stability. To address these…

Artificial Intelligence · Computer Science 2026-02-10 Jiawei Liu , Xiting Wang , Yuanyuan Zhong , Defu Lian , Yu Yang

Unmanned Aerial Vehicles (UAVs) possess high mobility and flexible deployment capabilities, prompting the development of UAVs for various application scenarios within the Internet of Things (IoT). The unique capabilities of UAVs give rise…

Artificial Intelligence · Computer Science 2024-12-16 Xin Tang , Qian Chen , Wenjie Weng , Binhan Liao , Jiacheng Wang , Xianbin Cao , Xiaohuan Li

End-to-End (E2E) learning-based concept has been recently introduced to jointly optimize both the transmitter and the receiver in wireless communication systems. Unfortunately, this E2E learning architecture requires a prior differentiable…

Networking and Internet Architecture · Computer Science 2023-08-08 Bolun Zhang , Nguyen Van Huynh

Deep Reinforcement Learning (DRL) has shown a dramatic improvement in decision-making and automated control problems. Consequently, DRL represents a promising technique to efficiently solve many relevant optimization problems (e.g.,…

Networking and Internet Architecture · Computer Science 2022-10-10 Paul Almasan , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

An effective understanding of the contextual environment and accurate motion forecasting of surrounding agents is crucial for the development of autonomous vehicles and social mobile robots. This task is challenging since the behavior of an…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Defu Cao , Jiachen Li , Hengbo Ma , Masayoshi Tomizuka

Traffic prediction has drawn increasing attention in AI research field due to the increasing availability of large-scale traffic data and its importance in the real world. For example, an accurate taxi demand prediction can assist taxi…

Machine Learning · Computer Science 2018-11-06 Huaxiu Yao , Xianfeng Tang , Hua Wei , Guanjie Zheng , Zhenhui Li

Spiking neural networks (SNNs) have gained significant attention for their potential to enable energy-efficient artificial intelligence. However, effective and efficient training of SNNs remains an unresolved challenge. While…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Chenxiang Ma , Xinyi Chen , Kay Chen Tan , Jibin Wu