中文
相关论文

相关论文: TA-VLA: Elucidating the Design Space of Torque-awa…

200 篇论文

Recent vision-language-action (VLA) models for multi-task robot manipulation often rely on fixed camera setups and shared visual encoders, which limit their performance under occlusions and during cross-task transfer. To address these…

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic control, with test-time scaling (TTS) gaining attention to enhance robustness beyond training. However, existing TTS methods for VLAs…

机器人学 · 计算机科学 2026-02-05 Hyeonbeom Choi , Daechul Ahn , Youhan Lee , Taewook Kang , Seongwon Cho , Jonghyun Choi

Robots in dynamic, human-centric environments must follow language instructions while maintaining real-time reactive control. Vision-language-action (VLA) models offer a promising framework, but they assume temporally aligned reasoning and…

机器人学 · 计算机科学 2026-02-03 Zhiyu Huang , Yun Zhang , Johnson Liu , Rui Song , Chen Tang , Jiaqi Ma

Vision-language-action (VLA) models perform well on training-seen robotic tasks but struggle to generalize to unseen scenes and objects. A key limitation lies in their implicit visual representations, which entangle object appearance,…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Hanyu Zhou , Chuanhao Ma , Gim Hee Lee

The important manifestation of robot intelligence is the ability to naturally interact and autonomously make decisions. Traditional approaches to robot control often compartmentalize perception, planning, and decision-making, simplifying…

机器人学 · 计算机科学 2025-02-05 Pengxiang Ding , Han Zhao , Wenjie Zhang , Wenxuan Song , Min Zhang , Siteng Huang , Ningxi Yang , Donglin Wang

While Vision-Language-Action (VLA) models show strong promise for generalist robot control, it remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics, where training data is…

Vision-Language-Action (VLA) models trained on large robot datasets promise general-purpose, robust control across diverse domains and embodiments. However, existing approaches often fail out-of-the-box when deployed in novel environments,…

机器人学 · 计算机科学 2025-10-21 Ruihan Zhao , Tyler Ingebrand , Sandeep Chinchali , Ufuk Topcu

Vision-language-action (VLA) models have shown strong potential for generalist robot manipulation, yet they remain limited by insufficient spatial reasoning, particularly in determining where to interact in complex visual scenes. While…

机器人学 · 计算机科学 2026-05-26 Runze Wang , Yuqian Fu , Yu Li , Tao Lin , Tianwen Qian , Mohamed Elhoseiny , Bo Zhao , Yanwei Fu , Yu-Gang Jiang , Xiangyang Xue

We propose a CompliantVLA-adaptor that augments the state-of-the-art Vision-Language-Action (VLA) models with vision-language model (VLM)-informed context-aware variable impedance control (VIC) to improve the safety and effectiveness of…

机器人学 · 计算机科学 2026-03-18 Heng Zhang , Wei-Hsing Huang , Qiyi Tong , Gokhan Solak , Puze Liu , Kaidi Zhang , Sheng Liu , Jan Peters , Yu She , Arash Ajoudani

Despite advances in Vision-Language-Action (VLA) models, robotic manipulation struggles with fine-grained tasks because current models lack mechanisms for active visual attention allocation. Human gaze naturally encodes intent, planning,…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Anupam Pani , Yanchao Yang

Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate visual perception is crucial for precise action prediction…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Cheng Yang , Jianhao Jiao , Lingyi Huang , Jinqi Xiao , Zhexiang Tang , Yu Gong , Yibiao Ying , Yang Sui , Jintian Lin , Wen Huang , Bo Yuan

Current Vision-Language-Action (VLA) models rely primarily on RGB perception, preventing them from capturing modalities such as thermal signals that are imperceptible to conventional visual sensors. Moreover, end-to-end generative policies…

机器人学 · 计算机科学 2026-03-09 Dian Yu , Qingchuan Zhou , Bingkun Huang , Majid Khadiv , Zewen Yang

Robotic systems are increasingly expected to operate in human-centered, unstructured environments where safety, adaptability, and generalization are essential. Vision-Language-Action (VLA) models have been proposed as a language guided…

机器人学 · 计算机科学 2025-10-21 Haochen Su , Cristian Meo , Francesco Stella , Andrea Peirone , Kai Junge , Josie Hughes

Vision-Language-Action (VLA) models aim to predict robotic actions based on visual observations and language instructions. Existing approaches require fine-tuning pre-trained visionlanguage models (VLMs) as visual and language features are…

机器人学 · 计算机科学 2026-01-01 Huang Huang , Fangchen Liu , Letian Fu , Tingfan Wu , Mustafa Mukadam , Jitendra Malik , Ken Goldberg , Pieter Abbeel

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

机器人学 · 计算机科学 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

Vision-Language-Action (VLA) models are receiving increasing attention for their ability to enable robots to perform complex tasks by integrating visual context with linguistic commands. However, achieving efficient real-time performance…

机器人学 · 计算机科学 2024-10-22 ByungOk Han , Jaehong Kim , Jinhyeok Jang

We adapt a pre-trained Vision-Language-Action (VLA) model (Open-VLA) for dexterous human-robot collaboration with minimal language prompting. Our approach adds (i) FiLM conditioning to visual backbones for task-aware perception, (ii) an…

机器人学 · 计算机科学 2025-10-30 Boshi An , Chenyu Yang , Robert Katzschmann

Recent advances in robot manipulation have leveraged pre-trained vision-language models (VLMs) and explored integrating 3D spatial signals into these models for effective action prediction, giving rise to the promising…

机器人学 · 计算机科学 2026-01-14 Zhenyang Liu , Yongchong Gu , Yikai Wang , Xiangyang Xue , Yanwei Fu

While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) leads to semantic-perceptual decoupling and perceptual-symbolic…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Yuechen Luo , Fang Li , Shaoqing Xu , Yang Ji , Zehan Zhang , Bing Wang , Yuannan Shen , Jianwei Cui , Long Chen , Guang Chen , Hangjun Ye , Zhi-Xin Yang , Fuxi Wen

Vision-Language-Action (VLA) models have emerged as promising solutions for robotic manipulation, yet their robustness to real-world physical variations remains critically underexplored. To bridge this gap, we propose Eva-VLA, the first…

机器人学 · 计算机科学 2026-03-17 Hanqing Liu , Shouwei Ruan , Jiahuan Long , Junqi Wu , Jiacheng Hou , Huili Tang , Tingsong Jiang , Weien Zhou , Wen Yao