中文
相关论文

相关论文: GLaD: Geometric Latent Distillation for Vision-Lan…

200 篇论文

Knowledge distillation (KD), a technique widely employed in computer vision, has emerged as a de facto standard for improving the performance of small neural networks. However, prevailing KD-based approaches in video tasks primarily focus…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Guiqin Wang , Peng Zhao , Yanjiang Shi , Cong Zhao , Shusen Yang

Vision-Language-Action (VLA) models typically bridge the gap between perceptual and action spaces by pre-training a large-scale Vision-Language Model (VLM) on robotic data. While this approach greatly enhances performance, it also incurs…

Vision-Language-Action models (VLAs) represent a significant frontier in embodied intelligence, aiming to bridge digital knowledge with physical-world interaction. Despite their remarkable performance, foundational VLAs are hindered by the…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Zhaoshu Yu , Bo Wang , Pengpeng Zeng , Haonan Zhang , Ji Zhang , Zheng Wang , Lianli Gao , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Progress in 3D vision-language learning has been hindered by the scarcity of large-scale 3D datasets. We introduce UniVLG, a unified architecture for 2D and 3D vision-language understanding that bridges the gap between existing 2D-centric…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Ayush Jain , Alexander Swerdlow , Yuzhou Wang , Sergio Arnaud , Ada Martin , Alexander Sax , Franziska Meier , Katerina Fragkiadaki

Vision-Language-Action (VLA) models have shown remarkable achievements, driven by the rich implicit knowledge of their vision-language components. However, achieving generalist robotic agents demands precise grounding into physical…

机器人学 · 计算机科学 2025-07-15 Jialei Huang , Shuo Wang , Fanqi Lin , Yihang Hu , Chuan Wen , Yang Gao

We propose LCLA (Language-Conditioned Latent Alignment), a framework for vision-language navigation that learns modular perception-action interfaces by aligning sensory observations to a latent representation of an expert policy. The expert…

机器人学 · 计算机科学 2026-02-11 Nitesh Subedi , Adam Haroon , Samuel Tetteh , Prajwal Koirala , Cody Fleming , Soumik Sarkar

Vision-Language-Action (VLA) models have emerged as powerful generalist policies for robotic control, yet their performance scaling across model architectures and hardware platforms, as well as their associated power budgets, remain poorly…

人工智能 · 计算机科学 2026-01-27 Amir Taherin , Juyi Lin , Arash Akbari , Arman Akbari , Pu Zhao , Weiwei Chen , David Kaeli , Yanzhi Wang

We aim at advancing open-vocabulary object detection, which detects objects described by arbitrary text inputs. The fundamental challenge is the availability of training data. It is costly to further scale up the number of classes contained…

计算机视觉与模式识别 · 计算机科学 2022-05-13 Xiuye Gu , Tsung-Yi Lin , Weicheng Kuo , Yin Cui

Currently, inspired by the success of vision-language models (VLMs), an increasing number of researchers are focusing on improving VLMs and have achieved promising results. However, most existing methods concentrate on optimizing the…

计算机视觉与模式识别 · 计算机科学 2024-09-23 Dawei Yan , Pengcheng Li , Yang Li , Hao Chen , Qingguo Chen , Weihua Luo , Wei Dong , Qingsen Yan , Haokui Zhang , Chunhua Shen

Recent advances in Vision-Language-Action (VLA) models have enabled robotic agents to integrate multimodal understanding with action execution. However, our empirical analysis reveals that current VLAs struggle to allocate visual attention…

Vision-Language-Action (VLA) models aim to predict robotic actions based on visual observations and language instructions. Existing approaches require fine-tuning pre-trained visionlanguage models (VLMs) as visual and language features are…

机器人学 · 计算机科学 2026-01-01 Huang Huang , Fangchen Liu , Letian Fu , Tingfan Wu , Mustafa Mukadam , Jitendra Malik , Ken Goldberg , Pieter Abbeel

Achieving consistent and high-fidelity geometry and appearance reconstruction of 3D digital humans from a single RGB image is inherently a challenging task. Existing studies typically resort to decoupled pipelines for geometry estimation…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Yingzhi Tang , Qijian Zhang , Junhui Hou

We introduce \textbf{LaMP}, a dual-expert Vision-Language-Action framework that embeds dense 3D scene flow as a latent motion prior for robotic manipulation. Existing VLA models regress actions directly from 2D semantic visual features,…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Xinkai Wang , Chenyi Wang , Yifu Xu , Mingzhe Ye , Fu-Cheng Zhang , Jialin Tian , Xinyu Zhan , Lifeng Zhu , Cewu Lu , Lixin Yang

Vision-Language-Action (VLA) models offer a compelling framework for tackling complex robotic manipulation tasks, but they are often expensive to train. In this paper, we propose a novel VLA approach that leverages the competitive…

机器人学 · 计算机科学 2025-12-23 Max Argus , Jelena Bratulic , Houman Masnavi , Maxim Velikanov , Nick Heppert , Abhinav Valada , Thomas Brox

Efficient Multimodal Large Language Models (MLLMs) compress vision tokens to reduce resource consumption, but the loss of visual information can degrade comprehension capabilities. Although some priors introduce Knowledge Distillation to…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Ze Feng , Sen Yang , Boqiang Duan , Wankou Yang , Jingdong Wang

Knowledge distillation (KD) is a highly promising method for mitigating the computational problems of pre-trained language models (PLMs). Among various KD approaches, Intermediate Layer Distillation (ILD) has been a de facto standard KD…

计算与语言 · 计算机科学 2023-02-06 Jongwoo Ko , Seungjoon Park , Minchan Jeong , Sukjin Hong , Euijai Ahn , Du-Seong Chang , Se-Young Yun

Deep learning has shown its efficacy in extracting useful features to solve various computer vision tasks. However, when the structure of the data is complex and noisy, capturing effective information to improve performance is very…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Eun Som Jeon , Rahul Khurana , Aishani Pathak , Pavan Turaga

Vision-language-action models (VLAs) have shown generalization capabilities in robotic manipulation tasks by inheriting from vision-language models (VLMs) and learning action generation. Most VLA models focus on interpreting vision and…

Teaching robots dexterous skills from human videos remains challenging due to the reliance on low-level trajectory imitation, which fails to generalize across object types, spatial layouts, and manipulator configurations. We propose…

机器人学 · 计算机科学 2026-02-10 Shunlei Li , Longsen Gao , Jin Wang , Chang Che , Xi Xiao , Jiuwen Cao , Yingbai Hu , Hamid Reza Karimi

Vision--language--action (VLA) models are typically built by fine-tuning a pretrained vision--language model (VLM) on action data. However, we show that this standard recipe systematically erodes the VLM's multimodal competence, a side…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Jianke Zhang , Yuanfei Luo , Yucheng Hu , Xiaoyu Chen , Yanjiang Guo , Ziyang Liu , Hongbin Xu , Tian Lan , Jianyu Chen