English
Related papers

Related papers: Perimeter Control Using Deep Reinforcement Learnin…

200 papers

With the development of state-of-art deep reinforcement learning, we can efficiently tackle continuous control problems. But the deep reinforcement learning method for continuous control is based on historical data, which would make…

Robotics · Computer Science 2016-12-02 Xi Xiong , Jianqiang Wang , Fang Zhang , Keqiang Li

Reinforcement Learning is divided in two main paradigms: model-free and model-based. Each of these two paradigms has strengths and limitations, and has been successfully applied to real world domains that are appropriate to its…

Machine Learning · Computer Science 2017-10-19 Somil Bansal , Roberto Calandra , Kurtland Chua , Sergey Levine , Claire Tomlin

Ramp metering that uses traffic signals to regulate vehicle flows from the on-ramps has been widely implemented to improve vehicle mobility of the freeway. Previous studies generally update signal timings in real-time based on predefined…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Bing Liu , Yu Tang , Yuxiong Ji , Yu Shen , Yuchuan Du

Traffic congestion and collisions represent significant economic, environmental, and social challenges worldwide. Traditional traffic management approaches have shown limited success in addressing these complex, dynamic problems. To address…

Machine Learning · Computer Science 2025-06-05 Mira Nuthakki

Many recent machine learning models rely on fine-grained dynamic control flow for training and inference. In particular, models based on recurrent neural networks and on reinforcement learning depend on recurrence relations, data-dependent…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-09 Yuan Yu , Martín Abadi , Paul Barham , Eugene Brevdo , Mike Burrows , Andy Davis , Jeff Dean , Sanjay Ghemawat , Tim Harley , Peter Hawkins , Michael Isard , Manjunath Kudlur , Rajat Monga , Derek Murray , Xiaoqiang Zheng

Monitoring and patrolling large water resources is a major challenge for conservation. The problem of acquiring data of an underlying environment that usually changes within time involves a proper formulation of the information. The use of…

Robotics · Computer Science 2022-10-18 Samuel Yanes Luis , Daniel Gutiérrez Reina , Sergio Toral Marín

Recent advances in diffusion models have demonstrated their strong capabilities in generating high-fidelity samples from complex distributions through an iterative refinement process. Despite the empirical success of diffusion models in…

Robotics · Computer Science 2024-07-03 Chaoyi Pan , Zeji Yi , Guanya Shi , Guannan Qu

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

In this work the problem of path planning for an autonomous vehicle that moves on a freeway is considered. The most common approaches that are used to address this problem are based on optimal control methods, which make assumptions about…

Robotics · Computer Science 2020-02-19 Konstantinos Makantasis , Maria Kontorinaki , Ioannis Nikolos

Flow-based models learn a target distribution by modeling a marginal velocity field, defined as the average of sample-wise velocities connecting each sample from a simple prior to the target data. When sample-wise velocities conflict at the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Yeonwoo Cha , Jaehoon Yoo , Semin Kim , Yunseo Park , Jinhyeon Kwon , Seunghoon Hong

A flow control system is a critical concept for increasing the production capacity of manufacturing systems. To solve the scheduling optimization problem related to the flow control with the aim of improving productivity, existing methods…

Machine Learning · Computer Science 2023-10-13 Hwajong Lee , Chan Kim , Seong-Woo Kim

Autonomous driving systems require robust lane perception capabilities, yet existing vision-based detection methods suffer significant performance degradation when visual sensors provide insufficient cues, such as in occluded or…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yihan Xie , Han Xia , Zhen Yang

Free-flow road networks, such as suburban highways, are increasingly experiencing traffic congestion due to growing commuter inflow and limited infrastructure. Traditional control mechanisms, such as traffic signals or local heuristics, are…

Machine Learning · Computer Science 2025-06-16 Ankit Bhardwaj , Rohail Asim , Sachin Chauhan , Yasir Zaki , Lakshminarayanan Subramanian

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

Robotics · Computer Science 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

Using a stochastic cellular automaton model for urban traffic flow, we study and compare Macroscopic Fundamental Diagrams (MFDs) of arterial road networks governed by different types of adaptive traffic signal systems, under various…

Cellular Automata and Lattice Gases · Physics 2013-02-19 Lele Zhang , Timothy M. Garoni , Jan de Gier

In this paper, we leverage ideas from model-based control to address the sample efficiency problem of reinforcement learning (RL) algorithms. Accelerating learning is an active field of RL highly relevant in the context of time-varying…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

We present a data-driven numerical approach for on-the-fly active flow control and demonstrate its effectiveness for drag reduction in two-dimensional incompressible flow past a cylinder. The method is based on flow map learning (FML), a…

Numerical Analysis · Mathematics 2026-03-10 Xinyu Liu , Qifan Chen , Dongbin Xiu

Recent breakthroughs in Go play and strategic games have witnessed the great potential of reinforcement learning in intelligently scheduling in uncertain environment, but some bottlenecks are also encountered when we generalize this…

Machine Learning · Computer Science 2018-12-27 Xingxing Liang , Qi Wang , Yanghe Feng , Zhong Liu , Jincai Huang

Recent advances in supervised learning and reinforcement learning have provided new opportunities to apply related methodologies to automated driving. However, there are still challenges to achieve automated driving maneuvers in dynamically…

Machine Learning · Computer Science 2020-08-31 Fei Ye , Pin Wang , Ching-Yao Chan , Jiucai Zhang

This paper presents a mixed traffic control policy designed to optimize traffic efficiency across diverse road topologies, addressing issues of congestion prevalent in urban environments. A model-free reinforcement learning (RL) approach is…

Robotics · Computer Science 2025-01-29 Chuyang Xiao , Dawei Wang , Xinzheng Tang , Jia Pan , Yuexin Ma