English
Related papers

Related papers: A Decision-Making GPT Model Augmented with Entropy…

200 papers

This paper presents a hierarchical decision-making framework for autonomous systems operating under uncertainty, demonstrated through autonomous driving as a representative application. Surrounding agents are modeled using Hybrid Markov…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Siyuan Li , Chengyuan Liu , Wen-Hua Chen

Most reinforcement learning (RL) approaches for the decision-making of autonomous driving consider safety as a reward instead of a cost, which makes it hard to balance the tradeoff between safety and other objectives. Human risk preference…

Robotics · Computer Science 2025-03-05 Yang Li , Shijie Yuan , Yuan Chang , Xiaolong Chen , Qisong Yang , Zhiyuan Yang , Hongmao Qin

Feature transformation plays a critical role in enhancing machine learning model performance by optimizing data representations. Recent state-of-the-art approaches address this task as a continuous embedding optimization problem, converting…

Machine Learning · Computer Science 2025-08-29 Yang Gao , Dongjie Wang , Scott Piersall , Ye Zhang , Liqiang Wang

Failure is inevitable for embodied navigation in complex environments. To enhance the resilience, replanning (RP) is a viable option, where the robot is allowed to fail, but is capable of adjusting plan until success. However, existing RP…

Robotics · Computer Science 2026-03-04 Guoliang Li , Ruihua Han , Chengyang Li , He Li , Shuai Wang , Wenchao Ding , Hong Zhang , Chengzhong Xu

Advanced Air Mobility (AAM) is the next generation of air transportation that includes new entrants such as electric vertical takeoff and landing (eVTOL) aircraft, increasingly autonomous flight operations, and small UAS package delivery.…

Machine Learning · Computer Science 2023-11-21 Luis E. Alvarez , Marc W. Brittain , Kara Breeden

Trajectory prediction and planning are essential for autonomous vehicles to navigate safely and efficiently in dynamic environments. Traditional approaches often treat them separately, limiting the ability for interactive planning. While…

Robotics · Computer Science 2025-07-22 Anjian Li , Sangjae Bae , David Isele , Ryne Beeson , Faizan M. Tariq

Autonomous vehicles have a great potential in the application of both civil and military fields, and have become the focus of research with the rapid development of science and economy. This article proposes a brief review on learning-based…

Robotics · Computer Science 2021-07-05 Qi Liu , Xueyuan Li , Shihua Yuan , Zirui Li

Autonomous marine vehicles play an essential role in many ocean science and engineering applications. Planning time and energy optimal paths for these vehicles to navigate in stochastic dynamic ocean environments is essential to reduce…

Artificial Intelligence · Computer Science 2021-09-21 Rohit Chowdhury , Deepak Subramani

We build a Generative Pre-trained Transformer (GPT) model from scratch to solve sequential decision making tasks arising in contexts of operations research and management science which we call OMGPT. We first propose a general sequence…

Machine Learning · Computer Science 2025-05-21 Hanzhao Wang , Guanting Chen , Kalyan Talluri , Xiaocheng Li

We consider a constrained Markov Decision Problem (CMDP) where the goal of an agent is to maximize the expected discounted sum of rewards over an infinite horizon while ensuring that the expected discounted sum of costs exceeds a certain…

Machine Learning · Computer Science 2024-11-01 Washim Uddin Mondal , Vaneet Aggarwal

Recent successes in autoregressive (AR) generation models, such as the GPT series in natural language processing, have motivated efforts to replicate this success in visual tasks. Some works attempt to extend this approach to autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Xiaotao Hu , Wei Yin , Mingkai Jia , Junyuan Deng , Xiaoyang Guo , Qian Zhang , Xiaoxiao Long , Ping Tan

As autonomous vehicles (AVs) become more common on public roads, their interaction with human-driven vehicles (HVs) in mixed traffic is inevitable. This requires new control strategies for AVs to handle the unpredictable nature of HVs. This…

Robotics · Computer Science 2024-04-03 Jie Wang , Zhihao Jiang , Yash Vardhan Pant

Behavior planning and decision-making are some of the biggest challenges for highly automated systems. A fully automated vehicle (AV) is confronted with numerous tactical and strategical choices. Most state-of-the-art AV platforms implement…

Robotics · Computer Science 2021-02-08 Piotr Franciszek Orzechowski , Christoph Burger , Martin Lauer

Transformer-based models are becoming a central paradigm in autonomous driving because they can capture long-range spatial dependencies, multi-agent interactions, and multimodal context across perception, prediction, and planning. At the…

Machine Learning · Computer Science 2026-05-13 Juan Zhong , Yuhang Shi , Zukang Xu , Xi Chen

Nowadays, autonomous taxis become a highly promising transportation mode, which helps relieve traffic congestion and avoid road accidents. However, it hinders the wide implementation of this service that traditional models fail to…

Machine Learning · Computer Science 2020-10-21 Yue Yang , Wencang Bao , Mohsen Ramezani , Zhe Xu

Reinforcement Learning (RL) methods used for solving real-world optimization problems often involve dynamic state-action spaces, larger scale, and sparse rewards, leading to significant challenges in convergence, scalability, and efficient…

Machine Learning · Computer Science 2025-09-29 Stavros Orfanoudakis , Nanda Kishor Panda , Peter Palensky , Pedro P. Vergara

Autonomous driving is a complex and highly dynamic process that ensures controlling the coupled longitudinal and lateral vehicle dynamics. Model predictive control, distinguished by its predictive feature, optimal performance, and ability…

Optimization and Control · Mathematics 2025-11-04 Yassine Kebbati , Naima Ait-Oufroukh , Dalil Ichalal , Vincent Vigneron

Understanding the interdependence between autonomous and human-operated vehicles remains an ongoing challenge, with significant implications for the safety and feasibility of autonomous driving.This interdependence arises from inherent…

Robotics · Computer Science 2024-06-21 Nouhed Naidja , Guillaume Sandou , Stéphane Font , Marc Revilloud

Planning is a critical component of end-to-end autonomous driving. However, prevailing imitation learning methods often suffer from mode collapse, failing to produce diverse trajectory hypotheses. Meanwhile, existing generative approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Lin Liu , Guanyi Yu , Ziying Song , Junqiao Li , Caiyan Jia , Feiyang Jia , Peiliang Wu , Yandan Luo

The integration of Autonomous Vehicles (AVs) into existing human-driven traffic systems poses considerable challenges, especially within environments where human and machine interactions are frequent and complex, such as at unsignalized…

Robotics · Computer Science 2024-04-05 Jiaqi Liu , Xiao Qi , Peng Hang , Jian Sun