English
Related papers

Related papers: Plan-R1: Safe and Feasible Trajectory Planning as …

200 papers

Large language models have demonstrated strong reasoning capabilities in complex tasks through tool integration, which is typically framed as a Markov Decision Process and optimized with trajectory-level RL algorithms such as GRPO. However,…

Human trajectory forecasting is important for intelligent multimedia systems operating in visually complex environments, such as autonomous driving and crowd surveillance. Although Conditional Flow Matching (CFM) has shown strong ability in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Xuepeng Jing , Wenhuan Lu , Hao Meng , Zhizhi Yu , Jianguo Wei

Reinforcement Learning (RL) in partially observable environments poses significant challenges due to the complexity of learning under uncertainty. While additional information, such as that available in simulations, can enhance training,…

Machine Learning · Computer Science 2026-03-16 Yueheng Li , Guangming Xie , Zongqing Lu

Reinforcement learning with verifiable rewards (RLVR) has become a practical route to improve large language model reasoning, and Group Relative Policy Optimization (GRPO) is a widely used optimizer in this setting. However, RLVR training…

Machine Learning · Computer Science 2026-05-14 Tue Le , Linh Ngo Van , Trung Le

This paper introduces a local planner that synergizes the decision making and trajectory planning modules towards autonomous driving. The decision making and trajectory planning tasks are jointly formulated as a nonlinear programming…

Robotics · Computer Science 2024-12-02 Wenru Liu , Haichao Liu , Lei Zheng , Zhenmin Huang , Jun Ma

Large multimodal reasoning models have achieved rapid progress, but their advancement is constrained by two major limitations: the absence of open, large-scale, high-quality long chain-of-thought (CoT) data, and the instability of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Sicong Leng , Jing Wang , Jiaxi Li , Hao Zhang , Zhiqiang Hu , Boqiang Zhang , Yuming Jiang , Hang Zhang , Xin Li , Lidong Bing , Deli Zhao , Wei Lu , Yu Rong , Aixin Sun , Shijian Lu

Vision-Language Navigation in Continuous Environments (VLN-CE) requires an embodied agent to navigate towards target in continuous environments, following natural language instructions. While current graph-based methods offer an efficient,…

Robotics · Computer Science 2025-12-25 Shuhao Ye , Sitong Mao , Yuxiang Cui , Xuan Yu , Shichao Zhai , Wen Chen , Shunbo Zhou , Rong Xiong , Yue Wang

Autonomous vehicles must navigate dynamically uncertain environments while balancing safety and efficiency. This challenge is exacerbated by unpredictable human-driven vehicle (HV) behaviors and perception inaccuracies, necessitating…

Robotics · Computer Science 2026-04-16 Rui Yang , Lei Zheng , Shuzhi Sam Ge , Jun Ma

Multimodal Large Language Models (MLLMs) have gained significant traction for their ability to process diverse input data types and generate coherent, contextually relevant outputs across various applications. While supervised fine-tuning…

Machine Learning · Computer Science 2025-03-31 Zhiyuan Liu , Yuting Zhang , Feng Liu , Changwang Zhang , Ying Sun , Jun Wang

One of the key challenges to deep reinforcement learning (deep RL) is to ensure safety at both training and testing phases. In this work, we propose a novel technique of unsupervised action planning to improve the safety of on-policy…

Robotics · Computer Science 2021-09-30 Hao-Lun Hsu , Qiuhua Huang , Sehoon Ha

Multimodal Large Language Models (MLLMs) excel in vision-language reasoning but often struggle with structured perception tasks requiring precise localization and robustness. We propose a reinforcement learning framework that augments Group…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Xu Jia

Reinforcement Learning (RL) robot controllers usually aggregate many task objectives into one scalar reward. While large-scale proximal policy optimisation (PPO) has enabled impressive results such as robust robot locomotion in the real…

Robotics · Computer Science 2025-09-19 Humphrey Munn , Brendan Tidd , Peter Böhm , Marcus Gallagher , David Howard

Autonomous vehicles necessitate a delicate balance between safety, efficiency, and user preferences in trajectory planning. Existing traditional or learning-based methods face challenges in adequately addressing all these aspects. In…

Robotics · Computer Science 2024-05-24 Yuejiao Xu , Ruolin Wang , Chengpeng Xu , Jianmin Ji

Reinforcement Learning from Human Feedback (RLHF) often suffers from noisy or imperfect reward supervision in real-world settings, which undermines policy stability and generalization. Such noise may cause models to lose attention on key…

Traffic Anomaly Understanding (TAU) is important for traffic safety in Intelligent Transportation Systems. Recent vision-language models (VLMs) have shown strong capabilities in video understanding. However, progress on TAU remains limited…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuqiang Lin , Kehua Chen , Sam Lockyer , Arjun Yadav , Mingxuan Sui , Shucheng Zhang , Yan Shi , Bingzhang Wang , Yuang Zhang , Markus Zarbock , Florain Stanek , Adrian Evans , Wenbin Li , Yinhai Wang , Nic Zhang

Recent advancements in reinforcement fine-tuning have significantly improved the reasoning ability of large language models (LLMs). In particular, methods such as group relative policy optimization (GRPO) have demonstrated strong…

Artificial Intelligence · Computer Science 2026-03-04 Yang Zhan , Yunhao Li , Zhang Chao , Yuxu Lu , Yan Li

Large Language Model(LLM)-based agents have shown strong capabilities in web information seeking, with reinforcement learning (RL) becoming a key optimization paradigm. However, planning remains a bottleneck, as existing methods struggle…

Computation and Language · Computer Science 2026-01-08 Xinmiao Yu , Liwen Zhang , Xiaocheng Feng , Yong Jiang , Bing Qin , Pengjun Xie , Jingren Zhou

Language models must now generalize out of the box to novel environments and work inside inference-scaling search procedures, such as AlphaEvolve, that select rollouts with a variety of task-specific reward functions. Unfortunately, the…

Recent advances in multimodal agents have improved computer-use interaction and tool-usage, yet most existing systems remain reactive, optimizing actions in isolation without reasoning about future states or long-term goals. This limits…

Artificial Intelligence · Computer Science 2026-03-18 Yongyuan Liang , Shijie Zhou , Yu Gu , Hao Tan , Gang Wu , Franck Dernoncourt , Jihyung Kil , Ryan A. Rossi , Ruiyi Zhang

Improving and understanding the training dynamics and reasoning of Large Language Models (LLMs) has become essential for their deployment in AI-based security tools, such as software vulnerability detection. In this work, we present an…

Cryptography and Security · Computer Science 2025-07-08 Marco Simoni , Aleksandar Fontana , Giulio Rossolini , Andrea Saracino