English
Related papers

Related papers: Orchestrate, Generate, Reflect: A VLM-Based Multi-…

200 papers

The rise of multi-modal large language models(MLLMs) has spurred their applications in autonomous driving. Recent MLLM-based methods perform action by learning a direct mapping from perception to action, neglecting the dynamics of the world…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Julong Wei , Shanshuai Yuan , Pengfei Li , Qingda Hu , Zhongxue Gan , Wenchao Ding

Ramp merging is one of the bottlenecks in traffic systems, which commonly cause traffic congestion, accidents, and severe carbon emissions. In order to address this essential issue and enhance the safety and efficiency of connected and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Senkang Hu , Zhengru Fang , Zihan Fang , Yiqin Deng , Xianhao Chen , Yuguang Fang , Sam Kwong

Recent advancements in Reinforcement Learning with Verifiable Rewards (RLVR) have significantly improved Large Language Model (LLM) reasoning, yet models often struggle to explore novel trajectories beyond their initial policy distribution.…

Artificial Intelligence · Computer Science 2026-05-28 Xinyu Ma , Mingzhou Xu , Xuebo Liu , Chang Jin , Qiang Wang , Derek F. Wong , Min Zhang

Offline multi-agent reinforcement learning (MARL) aims to learn the optimal joint policy from pre-collected datasets, requiring a trade-off between maximizing global returns and mitigating distribution shift from offline data. Recent…

Machine Learning · Computer Science 2026-04-10 Teng Pang , Zhiqiang Dong , Yan Zhang , Rongjian Xu , Guoqiang Wu , Yilong Yin

Reinforcement learning (RL) in autonomous driving employs a trial-and-error mechanism, enhancing robustness in unpredictable environments. However, crafting effective reward functions remains challenging, as conventional approaches rely…

Machine Learning · Computer Science 2025-06-02 Yongming Chen , Miner Chen , Liewen Liao , Mingyang Jiang , Xiang Zuo , Hengrui Zhang , Yuchen Xi , Songan Zhang

Although Multi-Agent Reinforcement Learning (MARL) is effective for complex multi-robot tasks, it suffers from low sample efficiency and requires iterative manual reward tuning. Large Language Models (LLMs) have shown promise in…

Robotics · Computer Science 2025-06-04 Guobin Zhu , Rui Zhou , Wenkang Ji , Shiyu Zhao

Multi-agent reinforcement learning (MARL) faces two critical bottlenecks distinct from single-agent RL: credit assignment in cooperative tasks and partial observability of environmental states. We propose LERO, a framework integrating Large…

Machine Learning · Computer Science 2025-03-31 Yuan Wei , Xiaohan Shan , Jianmin Li

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

Artificial Intelligence · Computer Science 2024-08-20 Ruiqi Zhang , Jing Hou , Florian Walter , Shangding Gu , Jiayi Guan , Florian Röhrbein , Yali Du , Panpan Cai , Guang Chen , Alois Knoll

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

Artificial Intelligence · Computer Science 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

In this work, we present CollabVLA, a self-reflective vision-language-action framework that transforms a standard visuomotor policy into a collaborative assistant. CollabVLA tackles key limitations of prior VLAs, including domain…

Robotics · Computer Science 2025-09-19 Nan Sun , Yongchang Li , Chenxu Wang , Huiying Li , Huaping Liu

The Open Digital Rights Language (ODRL) is a pivotal standard for automating data rights management. However, the inherent logical complexity of authorization policies, combined with the scarcity of high-quality "Natural Language-to-ODRL"…

Multiagent Systems · Computer Science 2025-12-02 Wanle Zhong , Keman Huang , Xiaoyong Du

Personalized driving refers to an autonomous vehicle's ability to adapt its driving behavior or control strategies to match individual users' preferences and driving styles while maintaining safety and comfort standards. However, existing…

Large Language Models (LLMs) agents are increasingly pivotal for addressing complex tasks in interactive environments. Existing work mainly focuses on enhancing performance through behavior cloning from stronger experts, yet such approaches…

Artificial Intelligence · Computer Science 2025-03-25 Siyu Yuan , Zehui Chen , Zhiheng Xi , Junjie Ye , Zhengyin Du , Jiecao Chen

Vision-Language-Action (VLA) models are emerging as highly effective planning models for end-to-end autonomous driving systems. However, current works mostly rely on imitation learning from sparse trajectory annotations and under-utilize…

Recent advances in large-scale language models (LLMs) have made multi-agent architectures attractive for challenging reasoning tasks. However, many existing systems rely on stochastic routing or ad-hoc heuristics, making their behavior…

Artificial Intelligence · Computer Science 2026-02-03 Hanlin Zhou , Huah Yong Chan

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

Robotics · Computer Science 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

Autonomous Vehicles (AVs) have entered the commercialization stage, but their limited ability to interact and express intentions still poses challenges in interactions with Human-driven Vehicles (HVs). Recent advances in large language…

Robotics · Computer Science 2025-03-04 Shiyu Fang , Jiaqi Liu , Chengkai Xu , Chen Lv , Peng Hang , Jian Sun

Traditional recommendation systems suffer from inconsistency in multi-stage optimization objectives. Generative Recommendation (GR) mitigates them through an end-to-end framework; however, existing methods still rely on matching mechanisms…

Although Deep Reinforcement Learning (DRL) and Large Language Models (LLMs) each show promise in addressing decision-making challenges in autonomous driving, DRL often suffers from high sample complexity, while LLMs have difficulty ensuring…

Artificial Intelligence · Computer Science 2025-02-21 Chengkai Xu , Jiaqi Liu , Shiyu Fang , Yiming Cui , Dong Chen , Peng Hang , Jian Sun

Document Visual Question Answering (DocVQA) remains challenging for existing Vision-Language Models (VLMs), especially under complex reasoning and multi-step workflows. Current approaches struggle to decompose intricate questions into…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Aymen Lassoued , Mohamed Ali Souibgui , Yousri Kessentini