English
Related papers

Related papers: Beyond Success: Refining Elegant Robot Manipulatio…

200 papers

VLA architectures that pair a pretrained VLM with a flow-matching action expert have emerged as a strong paradigm for language-conditioned manipulation. Yet the VLM, optimized for semantic abstraction and typically conditioned on static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zezhou Zhang , Songxin Zhang , Xiao Xiong , Junjie Zhang , Zejian Xie , Jingyi Xi , Zunyao Mao , Zan Mao , Zhixin Mai , Zhuoyang Song , Jiaxing Zhang

Robots deployed in dynamic environments must be able to not only follow diverse language instructions but flexibly adapt when user intent changes mid-execution. While recent Vision-Language-Action (VLA) models have advanced multi-task…

Robotics · Computer Science 2025-06-05 Meng Li , Zhen Zhao , Zhengping Che , Fei Liao , Kun Wu , Zhiyuan Xu , Pei Ren , Zhao Jin , Ning Liu , Jian Tang

Large Vision-Language-Action (VLA) models, leveraging powerful pre trained Vision-Language Models (VLMs) backends, have shown promise in robotic control due to their impressive generalization ability. However, the success comes at a cost.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Jianke Zhang , Yanjiang Guo , Xiaoyu Chen , Yen-Jen Wang , Yucheng Hu , Chengming Shi , Jianyu Chen

The important manifestation of robot intelligence is the ability to naturally interact and autonomously make decisions. Traditional approaches to robot control often compartmentalize perception, planning, and decision-making, simplifying…

Robotics · Computer Science 2025-02-05 Pengxiang Ding , Han Zhao , Wenjie Zhang , Wenxuan Song , Min Zhang , Siteng Huang , Ningxi Yang , Donglin Wang

The Logical Execution Time (LET) programming model has recently received considerable attention, particularly because of its timing and dataflow determinism. In LET, task computation appears always to take the same amount of time (called…

Systems and Control · Electrical Eng. & Systems 2024-03-11 Sen Wang , Dong Li , Ashrarul H. Sifat , Shao-Yu Huang , Xuanliang Deng , Changhee Jung , Ryan Williams , Haibo Zeng

The Visual-Language-Action (VLA) models can follow text instructions according to visual observations of the surrounding environment. This ability to map multimodal inputs to actions is derived from the training of the VLA model on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jinyue Bian , Zhaoxing Zhang , Zhengyu Liang , Shiwei Zheng , Shengtao Zhang , Rong Shen , Chen Yang , Anzhou Hou

While large language models (LLMs) have exhibited impressive instruction-following capabilities, it is still unclear whether and to what extent they can respond to explicit constraints that might be entailed in various instructions. As a…

Computation and Language · Computer Science 2024-01-02 Yihan Chen , Benfeng Xu , Quan Wang , Yi Liu , Zhendong Mao

Vision-Language-Action (VLA) models empower robots to understand and execute tasks described by natural language instructions. However, a key challenge lies in their ability to generalize beyond the specific environments and conditions they…

We present, to our knowledge, the first sign language-driven Vision-Language-Action (VLA) framework for intuitive and inclusive human-robot interaction. Unlike conventional approaches that rely on gloss annotations as intermediate…

Achieving general-purpose robotics requires empowering robots to adapt and evolve based on their environment and feedback. Traditional methods face limitations such as extensive training requirements, difficulties in cross-task…

Robotics · Computer Science 2026-04-23 Jianzong Wang , Botao Zhao , Yayun He , Junqing Peng , Xulong Zhang

Class-incremental learning (CIL) with pre-trained models (PTMs) faces a critical trade-off between efficient adaptation and long-term stability. While analytic learning enables rapid, recursive closed-form updates, its efficacy is often…

Machine Learning · Computer Science 2026-05-08 Binyu Zhao , Wei Zhang , Xingrui Yu , Zhaonian Zou , Ivor Tsang

Large language models (LLMs) can generate long-form and coherent text, yet they often hallucinate facts, which undermines their reliability. To mitigate this issue, inference-time methods steer LLM representations toward the "truthful…

Computation and Language · Computer Science 2024-06-10 Farima Fatahi Bayat , Xin Liu , H. V. Jagadish , Lu Wang

Vision-Language-Action (VLA) models have recently shown impressive generalization and language-guided manipulation capabilities. However, their performance degrades on tasks requiring precise spatial reasoning due to limited spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Tianyuan Yuan , Yicheng Liu , Chenhao Lu , Zhuoguang Chen , Tao Jiang , Hang Zhao

Large-scale generative models are shown to be useful for sampling meaningful candidate solutions, yet they often overlook task constraints and user preferences. Their full power is better harnessed when the models are coupled with external…

Artificial Intelligence · Computer Science 2024-08-13 Lin Guan , Yifan Zhou , Denis Liu , Yantian Zha , Heni Ben Amor , Subbarao Kambhampati

Lifelong learning is critical for embodied agents in open-world environments, where reinforcement learning fine-tuning has emerged as an important paradigm to enable Vision-Language-Action (VLA) models to master dexterous manipulation…

Artificial Intelligence · Computer Science 2026-02-04 Qixin Zeng , Shuo Zhang , Hongyin Zhang , Renjie Wang , Han Zhao , Libang Zhao , Runze Li , Donglin Wang , Chao Huang

The long-standing vision of general-purpose robots hinges on their ability to understand and act upon natural language instructions. Vision-Language-Action (VLA) models have made remarkable progress toward this goal, yet their generated…

Robotics · Computer Science 2026-02-19 Jacky Kwok , Xilun Zhang , Mengdi Xu , Yuejiang Liu , Azalia Mirhoseini , Chelsea Finn , Marco Pavone

Vision-Language-Action (VLA) models have emerged as a promising paradigm for robot learning, but their representations are still largely inherited from static image-text pretraining, leaving physical dynamics to be learned from…

Robotics · Computer Science 2026-03-24 Teli Ma , Jia Zheng , Zifan Wang , Chunli Jiang , Andy Cui , Junwei Liang , Shuo Yang

Vision-Language-Action (VLA) models show strong generalization for robotic control, but finetuning them with reinforcement learning (RL) is constrained by the high cost and safety risks of real-world interaction. Training VLA models in…

Robotics · Computer Science 2026-03-24 Zhilong Zhang , Haoxiang Ren , Yihao Sun , Yifei Sheng , Haonan Wang , Haoxin Lin , Zhichao Wu , Pierre-Luc Bacon , Yang Yu

Robotic manipulation in 3D requires effective computation of N degree-of-freedom joint-space trajectories that enable precise and robust control. To achieve this, robots must integrate semantic understanding with visual perception to…

Robotics · Computer Science 2026-03-31 Vineet Bhat , Yu-Hsiang Lan , Prashanth Krishnamurthy , Ramesh Karri , Farshad Khorrami

Vision-Language-Action (VLA) models, as large foundation models for embodied control, have shown strong performance in manipulation tasks. However, their performance comes at high inference cost. To improve efficiency, recent methods adopt…

Robotics · Computer Science 2026-04-06 Zihua Wang , Zhitao Lin , Ruibo Li , Yu Zhang , Xu Yang , Siya Mi , Xiu-Shen Wei
‹ Prev 1 8 9 10 Next ›