English
Related papers

Related papers: DynVLA: Learning World Dynamics for Action Reasoni…

200 papers

In autonomous driving tasks, trajectory prediction in complex traffic environments requires adherence to real-world context conditions and behavior multimodalities. Existing methods predominantly rely on prior assumptions or generative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yiming Xu , Hao Cheng , Monika Sester

Recent advances in Vision-Language-Action (VLA) models have enabled robotic agents to integrate multimodal understanding with action execution. However, our empirical analysis reveals that current VLAs struggle to allocate visual attention…

At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Jiaqi Liu , Mingyu Ding , Yiming Cui , Chen Lv , Peng Hang , Jian Sun

Vision-Language-Action (VLA) tasks require reasoning over complex visual scenes and executing adaptive actions in dynamic environments. While recent studies on reasoning VLAs show that explicit chain-of-thought (CoT) can improve…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Chi-Pin Huang , Yunze Man , Zhiding Yu , Min-Hung Chen , Jan Kautz , Yu-Chiang Frank Wang , Fu-En Yang

Drivers' visual attention provides critical cues for anticipating latent hazards and directly shapes decision-making and control maneuvers, where its absence can compromise traffic safety. To emulate drivers' perception patterns and advance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Weimin Liu , Qingkun Li , Jiyuan Qiu , Wenjun Wang , Joshua H. Meng

Urban micromobility applications, such as delivery robots, demand reliable navigation across large-scale urban environments while following long-horizon route instructions. This task is particularly challenging due to the dynamic and…

Robotics · Computer Science 2025-10-28 Anqi Li , Zhiyong Wang , Jiazhao Zhang , Minghan Li , Yunpeng Qi , Zhibo Chen , Zhizheng Zhang , He Wang

The advent of autonomous vehicles (AVs) alongside human-driven vehicles (HVs) has ushered in an era of mixed traffic flow, presenting a significant challenge: the intricate interaction between these entities within complex driving…

Robotics · Computer Science 2023-09-19 Jiaqi Liu , Donghao Zhou , Peng Hang , Ying Ni , Jian Sun

World models are essential for autonomous robotic planning. However, the substantial computational overhead of existing dense Transformerbased models significantly hinders real-time deployment. To address this efficiency-performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shicheng Yin , Kaixuan Yin , Weixing Chen , Yang Liu , Guanbin Li , Liang Lin

Predictive foresight is important to intelligent embodied agents. Since the motor execution of a robot is intrinsically constrained by its visual perception of environmental geometry, effectively anticipating the future requires capturing…

Robotics · Computer Science 2026-03-12 Xiaoxu Xu , Hao Li , Jinhui Ye , Yilun Chen , Jia Zeng , Xinyi Chen , Linning Xu , Dahua Lin , Weixin Li , Jiangmiao Pang

Evaluating robotics policies across thousands of environments and thousands of tasks is infeasible with existing approaches. This motivates the need for a new methodology for scalable robotics policy evaluation. In this paper, we propose…

Robotics · Computer Science 2026-04-27 Yaxuan Li , Zhongyi Zhou , Yefei Chen , Yaokai Xue , Yichen Zhu

Recent progress in Vision-Language-Action (VLA) models has enabled embodied agents to interpret multimodal instructions and perform complex tasks. However, existing VLAs are mostly confined to short-horizon, table-top manipulation, lacking…

While recent vision-language-action models trained on diverse robot datasets exhibit promising generalization capabilities with limited in-domain data, their reliance on compact action heads to predict discretized or continuous actions…

End-to-end autonomous driving has evolved from the conventional paradigm based on sparse perception into vision-language-action (VLA) models, which focus on learning language descriptions as an auxiliary task to facilitate planning. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Hanbing Li , Long Chen , Zhi-Xin Yang , Jiwen Lu

Autoregressive vision-language-action (VLA) models have recently demonstrated strong capabilities in robotic manipulation. However, their core process of action tokenization often involves a trade-off between reconstruction fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Yicheng Liu , Shiduo Zhang , Zibin Dong , Baijun Ye , Tianyuan Yuan , Xiaopeng Yu , Linqi Yin , Chenhao Lu , Junhao Shi , Luca Jiang-Tao Yu , Liangtao Zheng , Tao Jiang , Jingjing Gong , Xipeng Qiu , Hang Zhao

Robotic foundation models achieve strong generalization by leveraging internet-scale vision-language representations, but their massive computational cost creates a fundamental bottleneck: high inference latency. In dynamic environments,…

Robotics · Computer Science 2026-02-17 Noriaki Hirose , Catherine Glossop , Dhruv Shah , Sergey Levine

Autonomous Vehicles (AVs), furnished with sensors capable of capturing essential vehicle dynamics such as speed, acceleration, and precise location, possess the capacity to execute intelligent maneuvers, including lane changes, in…

Machine Learning · Computer Science 2024-06-28 Emanuel Figetakis , Yahuza Bello , Ahmed Refaey , Abdallah Shami

Visual navigation requires agents to reach goals in complex environments through perception and planning. World models address this task by simulating action-conditioned state transitions to predict future observations. Current navigation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mingkun Zhang , Wangtian Shen , Fan Zhang , Haijian Qin , Zihao Pei , Ziyang Meng

Learning robust robotic control policies remains a major challenge due to the high cost of collecting labeled data, limited generalization to unseen environments, and difficulties in planning over long horizons. While Vision-Language-Action…

Robotics · Computer Science 2025-10-07 Ayudh Saxena , Harsh Shah , Sandeep Routray , Rishi Rajesh Shah , Esha Pahwa

Robots deployed in dynamic environments must be able to not only follow diverse language instructions but flexibly adapt when user intent changes mid-execution. While recent Vision-Language-Action (VLA) models have advanced multi-task…

Robotics · Computer Science 2025-06-05 Meng Li , Zhen Zhao , Zhengping Che , Fei Liao , Kun Wu , Zhiyuan Xu , Pei Ren , Zhao Jin , Ning Liu , Jian Tang

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…