English
Related papers

Related papers: Tactile-VLA: Unlocking Vision-Language-Action Mode…

200 papers

Vision-Language-Action (VLA) models built upon Chain-of-Thought (CoT) have achieved remarkable success in advancing general-purpose robotic agents, owing to its significant perceptual comprehension. Recently, since text-only CoT struggles…

Robotics · Computer Science 2026-01-30 Xiangkai Ma , Lekai Xing , Han Zhang , Wenzhong Li , Sanglu Lu

Tactile perception is vital, especially when distinguishing visually similar objects. We propose an approach to incorporate tactile data into a Vision-Language Model (VLM) for visuo-tactile zero-shot object recognition. Our approach…

Robotics · Computer Science 2024-09-17 Shiori Ueda , Atsushi Hashimoto , Masashi Hamaya , Kazutoshi Tanaka , Hideo Saito

Tactile sensing is essential for robots to achieve human-like gentle manipulation. However, existing Vision-Language-Action (VLA) models struggle to exploit tactile feedback for gentle manipulation due to scarce aligned…

Robotics · Computer Science 2026-05-28 Qiwei Wu , Rui Zhang , Xin Xiang , Tao Li , Weihua Zhang , Junjie Lai , Renjing Xu

Vision-based robotic policies often struggle with even minor viewpoint changes, underscoring the need for view-invariant visual representations. This challenge becomes more pronounced in real-world settings, where viewpoint variability is…

Robotics · Computer Science 2026-01-07 Youngjoon Jeong , Junha Chun , Taesup Kim

Vision-Language-Action (VLA) models are a promising paradigm for generalist robotic manipulation by grounding high-level semantic instructions into executable physical actions. However, prevailing approaches typically adopt a monolithic…

Robotics · Computer Science 2026-04-29 Yifei Wei , Linqing Zhong , Yi Liu , Yuxiang Lu , Xindong He , Maoqing Yao , Guanghui Ren

Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak…

Robotics · Computer Science 2026-05-29 Zhongyu Xia , Yousen Tang , Bingqing Wei , Yongtao Wang

Robots deployed in dynamic environments must be able to not only follow diverse language instructions but flexibly adapt when user intent changes mid-execution. While recent Vision-Language-Action (VLA) models have advanced multi-task…

Robotics · Computer Science 2025-06-05 Meng Li , Zhen Zhao , Zhengping Che , Fei Liao , Kun Wu , Zhiyuan Xu , Pei Ren , Zhao Jin , Ning Liu , Jian Tang

We introduce Green-VLA, a staged Vision-Language-Action (VLA) framework for real-world deployment on the Green humanoid robot while maintaining generalization across diverse embodiments. Green-VLA follows a five stage curriculum: (L0)…

Pre-trained Vision-Language-Action (VLA) models have achieved remarkable success in improving robustness and generalization for end-to-end robotic manipulation. However, these models struggle with long-horizon tasks due to their lack of…

Robotics · Computer Science 2025-11-13 Runhao Li , Wenkai Guo , Zhenyu Wu , Changyuan Wang , Haoyuan Deng , Zhenyu Weng , Yap-Peng Tan , Ziwei Wang

Vision-language-action (VLA) models have shown strong generalization for robotic action prediction through large-scale vision-language pretraining. However, most existing models rely solely on RGB cameras, limiting their perception and,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Heyu Guo , Shanmu Wang , Ruichun Ma , Shiqi Jiang , Yasaman Ghasempour , Omid Abari , Baining Guo , Lili Qiu

Recent advances in Vision-Language-Action (VLA) models have shown strong potential for general-purpose robotic manipulation. However, the visual representations of most VLA models are often dominated by global object appearance and struggle…

Robotics · Computer Science 2026-05-19 Weijie Kong , Zhian Su , Wei Yu , Huixu Dong

The application of artificial intelligence (AI) in industry is accelerating the shift from traditional automation to intelligent systems with perception and cognition. Vision language-action (VLA) models have been a key paradigm in AI to…

Artificial Intelligence · Computer Science 2025-09-30 Shuai Li , Chen Yizhe , Li Dong , Liu Sichao , Lan Dapeng , Liu Yu , Zhibo Pang

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

Robotics · Computer Science 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

Multi-task ``vision-language-action'' (VLA) models have recently demonstrated increasing promise as generalist foundation models for robotics, achieving non-trivial performance out of the box on new tasks in new environments. However, for…

Robotics · Computer Science 2025-08-05 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , Insup Lee

Vision-language-action (VLA) models are emerging as embodied foundation models for robotic manipulation, but their deployment introduces a new unlearning challenge: removing unsafe, spurious, or privacy-sensitive behaviors without degrading…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Ravi Ranjan , Agoritsa Polyzou

Video-Action Models (VAMs) have emerged as a promising framework for embodied intelligence, learning implicit world dynamics from raw video streams to produce temporally consistent action predictions. Although such models demonstrate strong…

We propose a CompliantVLA-adaptor that augments the state-of-the-art Vision-Language-Action (VLA) models with vision-language model (VLM)-informed context-aware variable impedance control (VIC) to improve the safety and effectiveness of…

Vision-Language-Action (VLA) models have recently made significant advance in multi-task, end-to-end robotic control, due to the strong generalization capabilities of Vision-Language Models (VLMs). A fundamental challenge in developing such…

Robotics · Computer Science 2025-06-17 Yuqing Wen , Kefan Gu , Haoxuan Liu , Yucheng Zhao , Tiancai Wang , Haoqiang Fan , Xiaoyan Sun

Learning real-world robotic manipulation is challenging, particularly when limited demonstrations are available. Existing methods for few-shot manipulation often rely on simulation-augmented data or pre-built modules like grasping and pose…