English
Related papers

Related papers: CrowdVLA: Embodied Vision-Language-Action Agents f…

200 papers

Recent advances in Vision-Language-Action (VLA) models have enabled robotic agents to integrate multimodal understanding with action execution. However, our empirical analysis reveals that current VLAs struggle to allocate visual attention…

Vision-Language-Action (VLA) models have recently attracted growing attention in end-to-end autonomous driving for their strong reasoning capabilities and rich world knowledge. However, existing VLAs often suffer from limited numerical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhaohui Wang , Tengbo Yu , Hao Tang

Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generalization across tasks, environments, and robot embodiments. In…

Developing robust and general-purpose manipulation policies represents a fundamental objective in robotics research. While Vision-Language-Action (VLA) models have demonstrated promising capabilities for end-to-end robot control, existing…

In this work, we propose a framework that creates a lively virtual dynamic scene with contextual motions of multiple humans. Generating multi-human contextual motion requires holistic reasoning over dynamic relationships among human-human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Donggeun Lim , Jinseok Bae , Inwoo Hwang , Seungmin Lee , Hwanhee Lee , Young Min Kim

Conventional end-to-end (E2E) driving models are effective at generating physically plausible trajectories, but often fail to generalize to long-tail scenarios due to the lack of essential world knowledge to understand and reason about…

Robotics · Computer Science 2025-11-05 Yu Gao , Anqing Jiang , Yiru Wang , Wang Jijun , Hao Jiang , Zhigang Sun , Heng Yuwen , Wang Shuo , Hao Zhao , Sun Hao

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiaodong Mei , Diankun Zhang , Hongwei Xie , Guang Chen , Hangjun Ye , Dan Xu

Vision-Language-Action (VLA) models provide a promising paradigm for robot learning by integrating visual perception with language-guided policy learning. However, most existing approaches rely on 2D visual inputs to perform actions in 3D…

Robotics · Computer Science 2025-12-16 Yicheng Feng , Wanpeng Zhang , Ye Wang , Hao Luo , Haoqi Yuan , Sipeng Zheng , Zongqing Lu

Navigating human-populated environments without causing discomfort is a critical capability for socially-aware agents. While rule-based approaches offer interpretability through predefined psychological principles, they often lack…

Artificial Intelligence · Computer Science 2025-11-17 Yitian Kou , Yihe Gu , Chen Zhou , DanDan Zhu , Shuguang Kuai

Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak…

Robotics · Computer Science 2026-05-29 Zhongyu Xia , Yousen Tang , Bingqing Wei , Yongtao Wang

Recent work has begun to equip vision-language-action (VLA) policies with explicit intermediate reasoning. In embodied control, however, textual chain-of-thought is a poor fit: irrelevant or weakly textual information can interfere with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Mingjian Gao , Wenqiao Zhang , Yuqian Yuan , Yang Dai , Binhe Yu , Zheqi Lv , Haoyu Zheng , Jiaqi Zhu , Zhiqi Ge , Zixuan Wan , Siliang Tang , Yueting Zhuang

Vision-Language-Action (VLA) models commonly adapt pretrained Vision-Language Models (VLMs) to robot control by mapping visual observations and language instructions to continuous actions. Existing approaches typically take an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xuan Wang , Yinan Wu , Haoran Duan , Jungong Han

Autonomous agents operating in public spaces must consider how their behaviors might affect the humans around them, even when not directly interacting with them. To this end, it is often beneficial to be predictable and appear naturalistic.…

Multiagent Systems · Computer Science 2025-05-06 Hamzah I. Khan , David Fridovich-Keil

While leveraging abundant human videos and simulated robot data poses a scalable solution to the scarcity of real-world robot data, the generalization capability of existing vision-language-action models (VLAs) remains limited by mismatches…

Thanks to the diffusion of the Internet of Things, nowadays it is possible to sense human mobility almost in real time using unconventional methods (e.g., number of bikes in a bike station). Due to the diffusion of such technologies, the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Marco Cardia , Massimiliano Luca , Luca Pappalardo

Current Vision-Language-Action (VLA) models are often constrained by a rigid, static interaction paradigm, which lacks the ability to see, hear, speak, and act concurrently as well as handle real-time user interruptions dynamically. This…

Vision-Language-Action (VLA) models have emerged as a generalist robotic agent. However, existing VLAs are hindered by excessive parameter scales, prohibitive pre-training requirements, and limited applicability to diverse embodiments. To…

This paper presents UnderwaterVLA, a novel framework for autonomous underwater navigation that integrates multimodal foundation models with embodied intelligence systems. Underwater operations remain difficult due to hydrodynamic…

In robotics, Vision-Language-Action (VLA) models that integrate diverse multimodal signals from multi-view inputs have emerged as an effective approach. However, most prior work adopts static fusion that processes all visual inputs…

Robotics · Computer Science 2026-02-18 Young-Chae Son , Jung-Woo Lee , Yoon-Ji Choi , Dae-Kwan Ko , Soo-Chul Lim

Social robot navigation in crowded public spaces such as university campuses, restaurants, grocery stores, and hospitals, is an increasingly important area of research. One of the core strategies for achieving this goal is to understand…

Robotics · Computer Science 2025-03-28 Rohan Chandra , Haresh Karnan , Negar Mehr , Peter Stone , Joydeep Biswas