English
Related papers

Related papers: RIFT: Group-Relative RL Fine-Tuning for Realistic …

200 papers

Human-driven vehicles (HVs) exhibit complex and diverse behaviors. Accurately modeling such behavior is crucial for validating Robot Vehicles (RVs) in simulation and realizing the potential of mixed traffic control. However, existing…

Robotics · Computer Science 2024-07-10 Bibek Poudel , Weizi Li , Shuai Li

Vision-Language-Action (VLA) models have demonstrated significant potential for generalist robotic policies; however, they struggle to generalize to long-horizon complex tasks in novel real-world domains due to distribution shifts and the…

Robotics · Computer Science 2026-02-25 Zhian Su , Weijie Kong , Haonan Dong , Huixu Dong

In the pursuit of robust autonomous driving systems, models trained on real-world datasets often struggle to adapt to new environments, particularly when confronted with corner cases such as extreme weather conditions. Collecting these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jiacheng Zuo , Haibo Hu , Zikang Zhou , Yufei Cui , Ziquan Liu , Jianping Wang , Nan Guan , Jin Wang , Chun Jason Xue

Simulation is the key to scaling up validation and verification for robotic systems such as autonomous vehicles. Despite advances in high-fidelity physics and sensor simulation, a critical gap remains in simulating realistic behaviors of…

Robotics · Computer Science 2022-08-29 Danfei Xu , Yuxiao Chen , Boris Ivanovic , Marco Pavone

Reinforcement learning has demonstrated significant potential in the field of autonomous driving. However, it suffers from defects such as training instability and unsafe action outputs when faced with autonomous racing environments…

Robotics · Computer Science 2026-03-09 Bo Leng , Weiqi Zhang , Zhuoren Li , Lu Xiong , Guizhe Jin , Ran Yu , Chen Lv

Ensuring safety in autonomous driving (AD) remains a significant challenge, especially in highly dynamic and complex traffic environments where diverse agents interact and unexpected hazards frequently emerge. Traditional reinforcement…

Robotics · Computer Science 2025-10-14 Dong Hu , Fenqing Hu , Lidong Yang , Chao Huang

Autonomous contact-based micromanipulation is challenging because surface and interfacial interactions at the microscale are difficult to model accurately, limiting the use of conventional model-based control and sim-to-real learning. We…

Robotics · Computer Science 2026-05-22 Alessandro Amici , Houari Bettahar , Veeti Jaakkola , Quan Zhou

Reinforcement Fine-Tuning (RFT) on flow-based models is crucial for preference alignment. However, they often introduce visual hallucinations like over-optimized details and semantic misalignment. This work preliminarily explores why visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Xiaofeng Tan , Jun Liu , Yuanting Fan , Bin-Bin Gao , Xi Jiang , Xiaochen Chen , Jinlong Peng , Chengjie Wang , Hongsong Wang , Feng Zheng

Learning-based approaches, particularly reinforcement learning (RL), have become widely used for developing control policies for autonomous agents, such as locomotion policies for legged robots. RL training typically maximizes a predefined…

Robotics · Computer Science 2025-04-23 Dylan Khor , Bowen Weng

Continuous-time nonlinear optimal control problems hold great promise in real-world applications. After decades of development, reinforcement learning (RL) has achieved some of the greatest successes as a general nonlinear control design…

Systems and Control · Electrical Eng. & Systems 2023-07-19 Brent A. Wallace , Jennie Si

Vision-Language-Action (VLA) models have demonstrated potential in autonomous driving. However, two critical challenges hinder their development: (1) Existing VLA architectures are typically based on imitation learning in open-loop setup…

Artificial Intelligence · Computer Science 2025-08-18 Anqing Jiang , Yu Gao , Yiru Wang , Zhigang Sun , Shuo Wang , Yuwen Heng , Hao Sun , Shichen Tang , Lijuan Zhu , Jinhao Chai , Jijun Wang , Zichong Gu , Hao Jiang , Li Sun

Latent World Models enhance scene representation through temporal self-supervised learning, presenting a perception annotation-free paradigm for end-to-end autonomous driving. However, the reconstruction-oriented representation learning…

End-to-end autonomous driving models trained solely with imitation learning (IL) often suffer from poor generalization. In contrast, reinforcement learning (RL) promotes exploration through reward maximization but faces challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Xiaoji Zheng , Ziyuan Yang , Yanhao Chen , Yuhang Peng , Yuanrong Tang , Gengyuan Liu , Bokui Chen , Jiangtao Gong

Reinforcement learning for training end-to-end autonomous driving models in closed-loop simulations is gaining growing attention. However, most simulation environments differ significantly from real-world conditions, creating a substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Chaojun Ni , Guosheng Zhao , Xiaofeng Wang , Zheng Zhu , Wenkang Qin , Xinze Chen , Guanghong Jia , Guan Huang , Wenjun Mei

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

Robotics · Computer Science 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

Simulation has played an important role in efficiently evaluating self-driving vehicles in terms of scalability. Existing methods mostly rely on heuristic-based simulation, where traffic participants follow certain human-encoded rules that…

Robotics · Computer Science 2022-08-10 Wei-Jer Chang , Yeping Hu , Chenran Li , Wei Zhan , Masayoshi Tomizuka

In recent years, motion planning for urban self-driving cars (SDV) has become a popular problem due to its complex interaction of road components. To tackle this, many methods have relied on large-scale, human-sampled data processed through…

Robotics · Computer Science 2024-10-31 Minh Tri Huynh , Duc Dung Nguyen

In recent years, control under urban intersection scenarios becomes an emerging research topic. In such scenarios, the autonomous vehicle confronts complicated situations since it must deal with the interaction with social vehicles timely…

Artificial Intelligence · Computer Science 2021-09-23 Yuqi Liu , Qichao Zhang , Dongbin Zhao

Reinforcement learning with AI feedback (RLAIF) is a popular paradigm for improving the instruction-following abilities of powerful pre-trained language models. RLAIF first performs supervised fine-tuning (SFT) using demonstrations from a…

Machine Learning · Computer Science 2024-02-20 Archit Sharma , Sedrick Keh , Eric Mitchell , Chelsea Finn , Kushal Arora , Thomas Kollar

This study introduces a novel approach to autonomous motion planning, informing an analytical algorithm with a reinforcement learning (RL) agent within a Frenet coordinate system. The combination directly addresses the challenges of…

Robotics · Computer Science 2024-07-31 Rainer Trauth , Alexander Hobmeier , Johannes Betz