English
Related papers

Related papers: HMVLA: Hyperbolic Multimodal Fusion for Vision-Lan…

200 papers

Vision-Language-Action (VLA) models have achieved remarkable progress in robotic manipulation by mapping multimodal observations and instructions directly to actions. However, they typically mimic expert trajectories without predictive…

Modern Vision--Language--Action models often suffer from critical instruction-following failures in high-density manipulation environments, where task-irrelevant visual clutter dilutes attention, corrupts grounding, and substantially…

Robotics · Computer Science 2026-03-10 Zhen Liu , Xinyu Ning , Zhe Hu , XinXin Xie , Yitong Liu , Zhongzhu Pu

Vision-Language-Action (VLA) models have demonstrated significant advantages in robotic manipulation. However, their reliance on vision and language often leads to suboptimal performance in tasks involving visual occlusion, fine-grained…

While Vision-Language-Action (VLA) models have demonstrated remarkable success in robotic manipulation, their application has largely been confined to low-degree-of-freedom end-effectors performing simple, vision-guided pick-and-place…

Robotics · Computer Science 2026-03-10 Tutian Tang , Xingyu Ji , Wanli Xing , Ce Hao , Wenqiang Xu , Lin Shao , Cewu Lu , Qiaojun Yu , Jiangmiao Pang , Kaifeng Zhang

Moving beyond the traditional paradigm of adapting internet-pretrained models to physical tasks, we present DM0, an Embodied-Native Vision-Language-Action (VLA) framework designed for Physical AI. Unlike approaches that treat physical…

Recent advancements in multimodal fusion have witnessed the remarkable success of vision-language (VL) models, which excel in various multimodal applications such as image captioning and visual question answering. However, building VL…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Zhiwei Hao , Jianyuan Guo , Li Shen , Yong Luo , Han Hu , Yonggang Wen

The field of computer vision has experienced significant advancements through scalable vision encoders and multimodal pre-training frameworks. However, existing approaches often treat vision encoders and large language models (LLMs) as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Eugene Lee , Ting-Yu Chang , Jui-Huang Tsai , Jiajie Diao , Chen-Yi Lee

Vision-Language-Action (VLA) models enable instruction-following embodied control, but their large compute and memory footprints hinder deployment on resource-constrained robots and edge platforms. While reducing weights to 1-bit precision…

Machine Learning · Computer Science 2026-02-17 Xin Yan , Zhenglin Wan , Feiyang Ye , Xingrui Yu , Hangyu Du , Yang You , Ivor Tsang

Real-world embodied agents face long-horizon tasks, characterized by high-level goals demanding multi-step solutions beyond single actions. Successfully navigating these requires both high-level task planning (i.e., decomposing goals into…

Robotics · Computer Science 2025-06-03 Yi Yang , Jiaxuan Sun , Siqi Kou , Yihan Wang , Zhijie Deng

Achieving robot transparency is a critical step toward effective human-robot collaboration. To be transparent, a robot's natural language communication must be consistent with its actions and explicitly grounded in the task and environment.…

Robotics · Computer Science 2026-04-08 Theodor Wulff , Federico Tavella , Rahul Singh Maharjan , Manith Adikari , Angelo Cangelosi

Vision-Language-Action models have emerged as a promising paradigm for robotic manipulation by unifying perception, language grounding, and action generation. However, they often struggle in scenarios requiring precise spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tao Lin , Yuxin Du , Jiting Liu , Nuobei Zhu , Yunhe Li , Yuqian Fu , Yinxinyu Chen , Hongyi Cai , Zewei Ye , Bing Cheng , Kai Ye , Yiran Mao , Yilei Zhong , MingKang Dong , Junchi Yan , Gen Li , Bo Zhao

Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yiye Chen , Yanan Jian , Xiaoyi Dong , Shuxin Cao , Jing Wu , Patricio Vela , Benjamin E. Lundell , Dongdong Chen

Multimodal large language models (MLLMs) have seen substantial progress in recent years. However, their ability to represent multimodal information in the acoustic domain remains underexplored. In this work, we introduce Vela, a novel…

Information Retrieval · Computer Science 2025-06-18 Ruofan Hu , Yan Xia , Minjie Hong , Jieming Zhu , Bo Chen , Xiaoda Yang , Minghui Fang , Tao Jin

The rapid evolution of Embodied AI has enabled Vision-Language-Action (VLA) models to excel in multimodal perception and task execution. However, applying Reinforcement Learning (RL) to these massive models in large-scale distributed…

Artificial Intelligence · Computer Science 2026-05-15 Yucheng Guo , Yongjian Guo , Zhong Guan , Wen Huang , Haoran Sun , Haodong Yue , Xiaolong Xiang , Shuai Di , Zhen Sun , Luqiao Wang , Junwu Xiong , Yicheng Gong

Robotic manipulation in open-world environments requires reasoning across semantics, geometry, and long-horizon action dynamics. Existing hierarchical Vision-Language-Action (VLA) frameworks typically use 2D representations to connect…

Vision-Language-Action (VLA) models are a promising path to realizing generalist embodied agents that can quickly adapt to new tasks, modalities, and environments. However, methods for interpreting and steering VLAs fall far short of…

Robotics · Computer Science 2025-09-03 Bear Häon , Kaylene Stocking , Ian Chuang , Claire Tomlin

The capability of performing long-horizon, language-guided robotic manipulation tasks critically relies on leveraging historical information and generating coherent action sequences. However, such capabilities are often overlooked by…

Robotics · Computer Science 2025-12-24 Xiaofan Wang , Xingyu Gao , Jianlong Fu , Zuolei Li , Dean Fortier , Galen Mullins , Andrey Kolobov , Baining Guo

Vision-language-action (VLA) models achieve strong in-distribution performance but degrade sharply under novel camera viewpoints and visual perturbations. We show that this brittleness primarily arises from misalignment in Spatial Modeling,…

Robotics · Computer Science 2026-04-01 Weiqi Li , Quande Zhang , Ruifeng Zhai , Liang Lin , Guangrun Wang

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for generalist robotic control. Built upon vision-language model (VLM) architectures, VLAs predict actions conditioned on visual observations and language…

Robotics · Computer Science 2026-05-26 Weikang Qiu , Huashuo Lei , Tinglin Huang , Rex Ying

Vision-Language-Action (VLA) models have shown remarkable generalization by mapping web-scale knowledge to robotic control, yet they remain blind to physical contact. Consequently, they struggle with contact-rich manipulation tasks that…

Robotics · Computer Science 2026-05-07 Guo Ye , Zexi Zhang , Xu Zhao , Shang Wu , Haoran Lu , Shihan Lu , Han Liu
‹ Prev 1 8 9 10 Next ›