English
Related papers

Related papers: HiVLA: A Visual-Grounded-Centric Hierarchical Embo…

200 papers

Prevailing Vision-Language-Action Models (VLAs) for robotic manipulation are built upon vision-language backbones pretrained on large-scale, but disconnected static web data. As a result, despite improved semantic generalization, the policy…

Robotics · Computer Science 2025-12-22 Jonas Pai , Liam Achenbach , Victoriano Montesinos , Benedek Forrai , Oier Mees , Elvis Nava

Automating disassembly of critical components from end-of-life (EoL) desktops, such as high-value items like RAM modules and CPUs, as well as sensitive parts like hard disk drives, remains challenging due to the inherent variability and…

Robotics · Computer Science 2025-12-05 Chang Liu , Sibo Tian , Sara Behdad , Xiao Liang , Minghui Zheng

Vision-Language-Action models (VLAs) are emerging as powerful tools for learning generalizable visuomotor control policies. However, current VLAs are mostly trained on large-scale image-text-action data and remain limited in two key ways:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenqi Liang , Gan Sun , Yao He , Jiahua Dong , Suyan Dai , Ivan Laptev , Salman Khan , Yang Cong

Deep Learning has revolutionized our ability to solve complex problems such as Vision-and-Language Navigation (VLN). This task requires the agent to navigate to a goal purely based on visual sensory inputs given natural language…

Robotics · Computer Science 2021-04-22 Muhammad Zubair Irshad , Chih-Yao Ma , Zsolt Kira

In embodied AI, visual perception should be active rather than passive: the system must decide where to look and at what scale to sense to acquire maximally informative data under pixel and spatial budget constraints. Existing vision models…

Robotics · Computer Science 2026-04-06 Jiashu Yang , Yifan Han , Yucheng Xie , Ning Guo , Wenzhao Lian

Vision-Language-Action (VLA) models are increasingly expected to not only complete robot tasks, but also follow human instructions about how those tasks should be executed. However, existing robot datasets usually pair trajectories with…

Vision-Language-Action (VLA) models have emerged as a popular paradigm for learning robot manipulation policies that can follow language instructions and generalize to novel scenarios. Recent works have begun to explore the incorporation of…

We propose Bilateral Control-Based Imitation Learning via Vision-Language Fusion for Action Generation (Bi-VLA), a novel framework that extends bilateral control-based imitation learning to handle more than one task within a single model.…

Robotics · Computer Science 2025-09-24 Masato Kobayashi , Thanpimon Buamanee

Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically…

Humans act with context and intention, with reasoning playing a central role. While internet-scale data has enabled broad reasoning capabilities in AI systems, grounding these abilities in physical action remains a major challenge. We…

Robotics · Computer Science 2025-12-11 Peijun Tang , Shangjin Xie , Binyan Sun , Baifu Huang , Kuncheng Luo , Haotian Yang , Weiqi Jin , Jianan Wang

Humans possess a unified cognitive ability to perceive, comprehend, and interact with the physical world. Why can't large language models replicate this holistic understanding? Through a systematic analysis of existing training paradigms in…

Vision-language-action models (VLAs) trained on large-scale robotic datasets have demonstrated strong performance on manipulation tasks, including bimanual tasks. However, because most public datasets focus on single-arm demonstrations,…

Robotics · Computer Science 2026-02-24 Hokyun Im , Euijin Jeong , Andrey Kolobov , Jianlong Fu , Youngwoon Lee

Instruction-following agents must ground language into their observation and action spaces. Learning to ground language is challenging, typically requiring domain-specific engineering or large quantities of human interaction data. To…

Artificial Intelligence · Computer Science 2023-06-16 Theodore Sumers , Kenneth Marino , Arun Ahuja , Rob Fergus , Ishita Dasgupta

We introduce iFlyBot-VLA, a large-scale Vision-Language-Action (VLA) model trained under a novel framework. The main contributions are listed as follows: (1) a latent action model thoroughly trained on large-scale human and robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yuan Zhang , Chenyu Xue , Wenjie Xu , Chao Ji , Jiajia wu , Jia Pan

Vision-language pre-training (VLP) has recently proven highly effective for various uni- and multi-modal downstream applications. However, most existing end-to-end VLP methods use high-resolution image-text box data to perform well on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shraman Pramanick , Li Jing , Sayan Nag , Jiachen Zhu , Hardik Shah , Yann LeCun , Rama Chellappa

Vision-Language-Action (VLA) models align vision and language with embodied control, but their object referring ability remains limited when relying solely on text prompt, especially in cluttered or out-of-distribution (OOD) scenes. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Hang Yu , Juntu Zhao , Yufeng Liu , Kaiyu Li , Cheng Ma , Di Zhang , Yingdong Hu , Guang Chen , Junyuan Xie , Junliang Guo , Junqiao Zhao , Yang Gao

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for embodied intelligence, enabling robots to perform tasks based on natural language instructions and current visual input. However, existing VLA models struggle with…

The expansion of instruction-tuning data has enabled foundation language models to exhibit improved instruction adherence and superior performance across diverse downstream tasks. Semantically-rich 3D human motion is being progressively…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Lei Hu , Yongjing Ye , Shihong Xia

Language-guided long-horizon manipulation of deformable objects presents significant challenges due to high degrees of freedom, complex dynamics, and the need for accurate vision-language grounding. In this work, we focus on multi-step…

Vision Language Models (VLMs) provide rich semantic priors but are underexplored in Semi supervised Semantic Segmentation. Recent attempts to integrate VLMs to inject high level semantics overlook the semantic misalignment between visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Numair Nadeem , Saeed Anwar , Muhammad Hamza Asad , Abdul Bais