English
Related papers

Related papers: Novel Actor-Critic Algorithm for Robust Decision M…

200 papers

The pursuit of autonomous agents capable of temporally coherent planning is hindered by a fundamental flaw in current vision-language models (VLMs): they lack cognitive inertia. Operating on isolated snapshots, these models cannot form a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Pei Liu , Qingtian Ning , Xinyan Lu , Haipeng Liu , Weiliang Ma , Dangen She , Peng Jia , Xianpeng Lang , Jun Ma

We study the strategic decision-making problem of assigning time windows to customers in the context of vehicle routing applications that are affected by operational uncertainty. This problem, known as the Time Window Assignment Vehicle…

Optimization and Control · Mathematics 2018-10-11 Anirudh Subramanyam , Akang Wang , Chrysanthos E. Gounaris

In this paper, we provide a general framework for studying multi-agent online learning problems in the presence of delays and asynchronicities. Specifically, we propose and analyze a class of adaptive dual averaging schemes in which agents…

Machine Learning · Computer Science 2022-04-19 Yu-Guan Hsieh , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

The blockage is a key challenge for millimeter wave communication systems, since these systems mainly work on line-of-sight (LOS) links, and the blockage can degrade the system performance significantly. It is recently found that visual…

Signal Processing · Electrical Eng. & Systems 2022-07-27 Ruijin Ding , Weihua Xu , Wanmai Yuan , Feifei Gao

Massive message transmissions, unpredictable aperiodic messages, and high-speed moving vehicles contribute to the complex wireless environment, resulting in inefficient resource collisions in Vehicle to Everything (V2X). In order to achieve…

Networking and Internet Architecture · Computer Science 2025-11-03 Shuo Zhu , Siyu Lin

The recent advancements in wireless technology enable connected autonomous vehicles (CAVs) to gather data via vehicle-to-vehicle (V2V) communication, such as processed LIDAR and camera data from other vehicles. In this work, we design an…

Robotics · Computer Science 2023-02-16 Songyang Han , Shanglin Zhou , Lynn Pepin , Jiangwei Wang , Caiwen Ding , Fei Miao

Recent advancements in Connected Vehicle (CV) technology have prompted research on leveraging CV data for more effective traffic management. Despite the low penetration rate, such detailed CV data has demonstrated great potential in…

Optimization and Control · Mathematics 2024-06-21 Chaopeng Tan , Yue Ding , Kaidi Yang , Hong Zhu , Keshuang Tang

This paper presents a LiDAR-based end-to-end autonomous driving method with Vehicle-to-Everything (V2X) communication integration, termed V2X-Lead, to address the challenges of navigating unregulated urban scenarios under mixed-autonomy…

Robotics · Computer Science 2023-09-28 Zhiyun Deng , Yanjun Shi , Weiming Shen

Efficient exploration for an agent is challenging in reinforcement learning (RL). In this paper, a novel actor-critic framework namely virtual action actor-critic (VAAC), is proposed to address the challenge of efficient exploration in RL.…

Machine Learning · Computer Science 2023-11-07 Bumgeun Park , Taeyoung Kim , Quoc-Vinh Lai-Dang , Dongsoo Har

We propose an actor-critic framework to solve the time-continuous stochastic optimal control problem. A least square temporal difference method is applied to compute the value function for the critic. The policy gradient method is…

Optimization and Control · Mathematics 2025-01-27 Mo Zhou , Jianfeng Lu

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

Machine Learning · Computer Science 2019-05-29 Shariq Iqbal , Fei Sha

In this paper, we investigate the fixed-time behavioral control problem for a team of second-order nonlinear agents, aiming to achieve a desired formation with collision/obstacle~avoidance. In the proposed approach, the two behaviors(tasks)…

Optimization and Control · Mathematics 2021-03-12 Ning Zhou , Xiaodong Cheng , Zhongqi Sun , Yuanqing Xia

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

Machine Learning · Computer Science 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

Developing autonomous vehicles (AVs) helps improve the road safety and traffic efficiency of intelligent transportation systems (ITS). Accurately predicting the trajectories of traffic participants is essential to the decision-making and…

Robotics · Computer Science 2022-12-22 Yunlong Lin , Zirui Li , Cheng Gong , Chao Lu , Xinwei Wang , Jianwei Gong

We consider the problem of joint channel assignment and power allocation in underlaid cellular vehicular-to-everything (C-V2X) systems where multiple vehicle-to-network (V2N) uplinks share the time-frequency resources with multiple…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Hung V. Vu , Mohammad Farzanullah , Zheyu Liu , Duy H. N. Nguyen , Robert Morawski , Tho Le-Ngoc

By using an automated braking system, such as the Automatic Emergency Brake (AEB), crashes can be avoided in situations where the driver is unaware of an imminent collision. However, conventional AEB systems detect potential collision…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Jan Zimmermann , Jörg Mönnich , Michael Scherl , Ignacio Llatser , Florian Wildschütte , Frank Hofmann

Vehicle-to-everything (V2X) communication enables vehicles, roadside vulnerable users, and infrastructure facilities to communicate in an ad-hoc fashion. Cellular V2X (C-V2X), which was introduced in the 3rd generation partnership project…

Networking and Internet Architecture · Computer Science 2018-10-30 Behrad Toghi , Md Saifuddin , Hossein Nourkhiz Mahjoub , M. O. Mughal , Yaser P. Fallah , Jayanthi Rao , Sushanta Das

Actor-critic (AC) methods have exhibited great empirical success compared with other reinforcement learning algorithms, where the actor uses the policy gradient to improve the learning policy and the critic uses temporal difference learning…

Machine Learning · Computer Science 2022-10-11 Yue Wu , Weitong Zhang , Pan Xu , Quanquan Gu

We study online task allocation for multi-robot, multi-queue systems with asymmetric stochastic arrivals and switching delays. We formulate the problem in discrete time: each location can host at most one robot per slot, servicing a task…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Mohammad Merati , H. M. Sabbir Ahmad , Wenchao Li , David Castañón

Deep reinforcement learning has been applied successfully to solve various real-world problems and the number of its applications in the multi-agent settings has been increasing. Multi-agent learning distinctly poses significant challenges…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Doug Creighton , Saeid Nahavandi