English
Related papers

Related papers: GST-VLA: Structured Gaussian Spatial Tokens for 3D…

200 papers

Self-supervised learning (SSL) for point cloud pre-training has become a cornerstone for many 3D vision tasks, enabling effective learning from large-scale unannotated data. At the scene level, existing SSL methods often incorporate volume…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Keyi Liu , Weidong Yang , Ben Fei , Ying He

Vision-Language-Action (VLA) models exhibit strong generalization in robotic manipulation, yet reinforcement learning (RL) fine-tuning often degrades robustness under spatial distribution shifts. For flow-matching VLA policies, this…

Robotics · Computer Science 2026-02-03 Xu Pan , Zhenglin Wan , Xingrui Yu , Xianwei Zheng , Youkai Ke , Ming Sun , Rui Wang , Ziwei Wang , Ivor Tsang

Recent improvements in the performance of state-of-the-art (SOTA) methods for Graph Representational Learning (GRL) have come at the cost of significant computational resource requirements for training, e.g., for calculating gradients via…

Machine Learning · Computer Science 2021-11-12 Sami Abu-El-Haija , Hesham Mostafa , Marcel Nassar , Valentino Crespi , Greg Ver Steeg , Aram Galstyan

Recent advances in 3D Gaussian Splatting (3DGS) have achieved remarkable success in high-fidelity Novel View Synthesis (NVS), yet the optimization process inevitably introduces noisy Gaussian primitives due to the sparse and incomplete…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Qingyuan Zhou , Xinyi Liu , Weidong Yang , Ning Wang , Shuquan Ye , Ben Fei , Ying He , Wanli Ouyang

Understanding 4D point cloud videos is essential for enabling intelligent agents to perceive dynamic environments. However, temporal scale bias across varying frame rates and distributional uncertainty in irregular point clouds make it…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiayi Tian , Jiaze Wang

Robotic manipulation in 3D requires effective computation of N degree-of-freedom joint-space trajectories that enable precise and robust control. To achieve this, robots must integrate semantic understanding with visual perception to…

Robotics · Computer Science 2026-03-31 Vineet Bhat , Yu-Hsiang Lan , Prashanth Krishnamurthy , Ramesh Karri , Farshad Khorrami

This paper tackles spatial perception and manipulation challenges in Vision-Language-Action (VLA) models. To address depth ambiguity from monocular input, we leverage a pre-trained multi-view diffusion model to synthesize latent novel views…

Generative Zero-shot learning (ZSL) learns a generator to synthesize visual samples for unseen classes, which is an effective way to advance ZSL. However, existing generative methods rely on the conditions of Gaussian noise and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Wenjin Hou , Shiming Chen , Shuhuang Chen , Ziming Hong , Yan Wang , Xuetao Feng , Salman Khan , Fahad Shahbaz Khan , Xinge You

Vision-Language-Action (VLA) models provide a promising paradigm for robot learning by integrating visual perception with language-guided policy learning. However, most existing approaches rely on 2D visual inputs to perform actions in 3D…

Robotics · Computer Science 2025-12-16 Yicheng Feng , Wanpeng Zhang , Ye Wang , Hao Luo , Haoqi Yuan , Sipeng Zheng , Zongqing Lu

Visual Geometry Grounded Transformer (VGGT) delivers state-of-the-art feed-forward 3D reconstruction, yet its global self-attention layer suffers from a drastic collapse phenomenon when the input sequence exceeds a few hundred frames:…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Huan Li , Longjun Luo , Yuling Shi , Xiaodong Gu

Vision-Language-Action (VLA) models built on pretrained Vision-Language Models (VLMs) show strong potential but are limited in practicality due to their large parameter counts. To mitigate this issue, using a lightweight VLM has been…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Chaojun Ni , Cheng Chen , Xiaofeng Wang , Zheng Zhu , Wenzhao Zheng , Boyuan Wang , Tianrun Chen , Guosheng Zhao , Haoyun Li , Zhehao Dong , Qiang Zhang , Yun Ye , Yang Wang , Guan Huang , Wenjun Mei

While 3D Gaussian Splatting (3DGS) has revolutionized real-time photorealistic view synthesis, its fundamental reliance on symmetric Gaussian distributions introduces visual artifacts that hinder accurate spatial data exploration.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Beizhen Zhao , Yifan Zhou , Gaochao Song , Ziran Yin , Hao Wang

Vision-Language-Action (VLA) models achieve strong generalization in robotic manipulation but remain largely reactive and 2D-centric, making them unreliable in tasks that require precise 3D reasoning. We propose GeoPredict, a geometry-aware…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Jingjing Qian , Boyao Han , Chen Shi , Lei Xiao , Long Yang , Shaoshuai Shi , Li Jiang

We present an approach that combines appearance and semantic information for 2D image-based localization (2D-VL) across large perceptual changes and time lags. Compared to appearance features, the semantic layout of a scene is generally…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Zachary Seymour , Karan Sikka , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

Guided depth super-resolution (GDSR) is a multi-modal approach for depth map super-resolution that relies on a low-resolution depth map and a high-resolution RGB image to restore finer structural details. However, the misleading color and…

Image and Video Processing · Electrical Eng. & Systems 2026-04-07 Tayyab Nasir , Daochang Liu , Ajmal Mian

Vision-Language-Action (VLA) models benefit from chain-of-thought (CoT) reasoning, but existing approaches incur high inference overhead and rely on discrete reasoning representations that mismatch continuous perception and control. We…

Reconstructing photo-realistic and topology-aware animatable human avatars from monocular videos remains challenging in computer vision and graphics. Recently, methods using 3D Gaussians to represent the human body have emerged, offering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haoyu Zhao , Chen Yang , Hao Wang , Xingyue Zhao , Wei Shen

Recently, Vision Transformers (ViTs) have attracted a lot of attention in the field of computer vision. Generally, the powerful representative capacity of ViTs mainly benefits from the self-attention mechanism, which has a high computation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Deli Yu , Teng Xi , Jianwei Li , Baopu Li , Gang Zhang , Haocheng Feng , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang

Vision-Language-Action (VLA) models typically map visual observations and linguistic instructions directly to control signals. This "black-box" mapping forces a single forward pass to simultaneously handle instruction interpretation,…

Robotics · Computer Science 2026-05-12 Zixuan Wang , Yuxin Chen , Yuqi Liu , Jinhui Ye , Pengguang Chen , Changsheng Lu , Shu Liu , Bei Yu , Jiaya Jia

We propose GALA, a novel representation of 3D shapes that (i) excels at capturing and reproducing complex geometry and surface details, (ii) is computationally efficient, and (iii) lends itself to 3D generative modelling with modern,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Dingdong Yang , Yizhi Wang , Konrad Schindler , Ali Mahdavi Amiri , Hao Zhang