English
Related papers

Related papers: CaP-X: A Framework for Benchmarking and Improving …

200 papers

Vision-language-action (VLA) models hold promise as generalist robotics solutions by translating visual and linguistic inputs into robot actions, yet they lack reliability due to their black-box nature and sensitivity to environmental…

Robotics · Computer Science 2025-02-10 Hong Lu , Hengxu Li , Prithviraj Singh Shahani , Stephanie Herbers , Matthias Scheutz

End-to-end learning directly maps sensory inputs to actions, creating highly integrated and efficient policies for complex robotics tasks. However, such models often struggle to generalize beyond their training scenarios, limiting…

Robotics · Computer Science 2025-05-19 Makram Chahine , Alex Quach , Alaa Maalouf , Tsun-Hsuan Wang , Daniela Rus

Agent-based modeling (ABM) is a principal approach for studying complex systems. By decomposing a system into simpler, interacting agents, agent-based modeling (ABM) allows researchers to observe the emergence of complex phenomena.…

Multiagent Systems · Computer Science 2025-10-17 Siddharth Chaturvedi , Ahmed El-Gazzar , Marcel van Gerven

Foundation models, including large language models (LLMs) and vision-language models (VLMs), have recently enabled novel approaches to robot autonomy and human-robot interfaces. In parallel, vision-language-action models (VLAs) or large…

Despite remarkable progress in Vision--Language--Action (VLA) models, a central bottleneck remains underexamined: the data infrastructure that underlies embodied learning. In this survey, we argue that future advances in VLA will depend…

Robotic research is inherently challenging, requiring expertise in diverse environments and control algorithms. Adapting algorithms to new environments often poses significant difficulties, compounded by the need for extensive…

Robotics · Computer Science 2025-04-10 Halid Abdulrahim Kadi , Kasim Terzić

We introduce Being-H0, a dexterous Vision-Language-Action model (VLA) trained on large-scale human videos. Existing VLAs struggle with complex manipulation tasks requiring high dexterity and generalize poorly to novel scenarios and tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Hao Luo , Yicheng Feng , Wanpeng Zhang , Sipeng Zheng , Ye Wang , Haoqi Yuan , Jiazheng Liu , Chaoyi Xu , Qin Jin , Zongqing Lu

One promise that Vision-Language-Action (VLA) models hold over traditional imitation learning for robotics is to leverage the broad generalization capabilities of large Vision-Language Models (VLMs) to produce versatile, "generalist" robot…

Robotics · Computer Science 2025-06-12 Irving Fang , Juexiao Zhang , Shengbang Tong , Chen Feng

Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov…

Machine Learning · Computer Science 2026-04-13 Lei Xiao , Jifeng Li , Juntao Gao , Feiyang Ye , Yan Jin , Jingjing Qian , Jing Zhang , Yong Wu , Xiaoyuan Yu

Vision-Language-Action (VLA) models provide a promising paradigm for robot learning by integrating visual perception with language-guided policy learning. However, most existing approaches rely on 2D visual inputs to perform actions in 3D…

Robotics · Computer Science 2025-12-16 Yicheng Feng , Wanpeng Zhang , Ye Wang , Hao Luo , Haoqi Yuan , Sipeng Zheng , Zongqing Lu

Agents for computer use (ACUs) are an emerging class of systems capable of executing complex tasks on digital devices -- such as desktops, mobile phones, and web platforms -- given instructions in natural language. These agents can automate…

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Teaching robots desired skills in real-world environments remains challenging, especially for non-experts. A key bottleneck is that collecting robotic data often requires expertise or specialized hardware, limiting accessibility and…

Robotics · Computer Science 2025-05-13 Gi-Cheon Kang , Junghyun Kim , Kyuhwan Shim , Jun Ki Lee , Byoung-Tak Zhang

Deep reinforcement learning is actively used for training autonomous car policies in a simulated driving environment. Due to the large availability of various reinforcement learning algorithms and the lack of their systematic comparison…

Artificial Intelligence · Computer Science 2023-03-24 Aizaz Sharif , Dusica Marijan

The advancement of large Vision-Language-Action (VLA) models has significantly improved robotic manipulation in terms of language-guided task execution and generalization to unseen scenarios. While existing VLAs adapted from pretrained…

Vision-Language-Action (VLA) models have gained popularity for learning robotic manipulation tasks that follow language instructions. State-of-the-art VLAs, such as OpenVLA and $\pi_{0}$, were trained on large-scale, manually labeled action…

Robotics · Computer Science 2025-09-24 Bahey Tharwat , Yara Nasser , Ali Abouzeid , Ian Reid

The development of reinforcement learning (RL) algorithms has been largely driven by ambitious challenge tasks and benchmarks. Games have dominated RL benchmarks because they present relevant challenges, are inexpensive to run and easy to…

Vision-language-action models (VLAs) have become increasingly popular in robot manipulation for their end-to-end design and remarkable performance. However, existing VLAs rely heavily on vision-language models (VLMs) that only support…

Robotics · Computer Science 2025-02-24 Wei Zhao , Pengxiang Ding , Min Zhang , Zhefei Gong , Shuanghao Bai , Han Zhao , Donglin Wang

Pre-trained vision-language-action (VLA) models offer a promising foundation for generalist robot policies, but often produce brittle behaviors or unsafe failures when deployed zero-shot in out-of-distribution scenarios. We present…

Robotics · Computer Science 2025-11-14 Cyrus Neary , Omar G. Younis , Artur Kuramshin , Ozgur Aslan , Glen Berseth

Autonomous agentic AI systems powered by vision-language models (VLMs) are rapidly advancing toward real-world deployment, yet their cross-modal reasoning capabilities introduce new attack surfaces for adversarial manipulation that exploit…

Artificial Intelligence · Computer Science 2025-11-25 Hangoo Kang , Jehyeok Yeon , Gagandeep Singh