English
Related papers

Related papers: VersaQ-3D: A Reconfigurable Accelerator Enabling F…

200 papers

Foundation models for 3D vision have recently demonstrated remarkable capabilities in 3D perception. However, extending these models to large-scale RGB stream 3D reconstruction remains challenging due to memory limitations. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Kai Deng , Zexin Ti , Jiawei Xu , Jian Yang , Jin Xie

Vector quantization (VQ) underpins modern generative and representation models by turning continuous latents into discrete tokens. Yet hard nearest-neighbor assignments are non-differentiable and are typically optimized with heuristic…

Machine Learning · Computer Science 2026-02-03 Haochen You , Heng Zhang , Hongyang He , Yuqi Li , Baojing Liu

Despite its significant achievements in large-scale scene reconstruction, 3D Gaussian Splatting still faces substantial challenges, including slow processing, high computational costs, and limited geometric accuracy. These core issues arise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuanyuan Gao , Hao Li , Jiaqi Chen , Zhengyu Zou , Zhihang Zhong , Dingwen Zhang , Xiao Sun , Junwei Han

Reconstructing dynamic 4D scenes from monocular videos is a fundamental yet challenging task. While recent 3D foundation models provide strong geometric priors, their performance significantly degrades in dynamic environments. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ying Zang , Xuanyi Liu , Yidong Han , Deyi Ji , Chaotao Ding , Yuanqi Hu , Qi Zhu , Xuanfu Li , Jin Ma , Lingyun Sun , Tianrun Chen , Lanyun Zhu

Vector Quantized Variational Autoencoders (VQ-VAEs) are fundamental models that compress continuous visual data into discrete tokens. Existing methods have tried to improve the quantization strategy for better reconstruction quality,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Mingkai Jia , Wei Yin , Xiaotao Hu , Jiaxin Guo , Xiaoyang Guo , Qian Zhang , Xiao-Xiao Long , Ping Tan

End-to-end autonomous driving has evolved from the conventional paradigm based on sparse perception into vision-language-action (VLA) models, which focus on learning language descriptions as an auxiliary task to facilitate planning. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Hanbing Li , Long Chen , Zhi-Xin Yang , Jiwen Lu

Current multi-view indoor 3D object detectors rely on sensor geometry that is costly to obtain (i.e., precisely calibrated multi-view camera poses) to fuse multi-view information into a global scene representation, limiting deployment in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yang Cao , Feize Wu , Dave Zhenyu Chen , Yingji Zhong , Lanqing Hong , Dan Xu

Vector quantization(VQ) is a hardware-friendly DNN compression method that can reduce the storage cost and weight-loading datawidth of hardware accelerators. However, conventional VQ techniques lead to significant accuracy loss because the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Shuaiting Li , Chengxuan Wang , Juncan Deng , Zeyu Wang , Zewen Ye , Zongsheng Wang , Haibin Shen , Kejie Huang

Recent advances in vision foundation models have revolutionized geometry reconstruction and semantic understanding. Yet, most of the existing approaches treat these capabilities in isolation, leading to redundant pipelines and compounded…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Chaoyi Zhou , Run Wang , Feng Luo , Mert D. Pesé , Zhiwen Fan , Yiqi Zhong , Siyu Huang

We introduce VGGT-SLAM++, a complete visual SLAM system that leverages the geometry-rich outputs of the Visual Geometry Grounded Transformer (VGGT). The system comprises a visual odometry (front-end) fusing the VGGT feed-forward transformer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Avilasha Mandal , Rajesh Kumar , Sudarshan Sunil Harithas , Chetan Arora

Recent advances in auto-regressive transformers have achieved remarkable success in generative modeling. However, text-to-3D generation remains challenging, primarily due to bottlenecks in learning discrete 3D representations. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zongcheng Han , Dongyan Cao , Haoran Sun , Yu Hong

Novel view synthesis (NVS) is increasingly relevant for edge robotics, where compact and incrementally updatable 3D scene models are needed for SLAM, navigation, and inspection under tight memory and latency budgets. Variational Bayesian…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ivan Zaino , Matteo Risso , Daniele Jahier Pagliari , Miguel de Prado , Toon Van de Maele , Alessio Burrello

Despite recent progress in calibration-free monocular SLAM via 3D vision foundation models, scale drift remains severe on long sequences. Motion-agnostic partitioning breaks contextual coherence and causes zero-motion drift, while…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Zhuang Xiong , Chen Zhang , Qingshan Xu , Wenbing Tao

Vision transformers (ViTs) are emerging with significantly improved accuracy in computer vision tasks. However, their complex architecture and enormous computation/storage demand impose urgent needs for new hardware accelerator design…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Zhengang Li , Mengshu Sun , Alec Lu , Haoyu Ma , Geng Yuan , Yanyue Xie , Hao Tang , Yanyu Li , Miriam Leeser , Zhangyang Wang , Xue Lin , Zhenman Fang

Large scale 3D scene reconstruction is important for applications such as virtual reality and simulation. Existing neural rendering approaches (e.g., NeRF, 3DGS) have achieved realistic reconstructions on large scenes, but optimize per…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yun Chen , Jingkang Wang , Ze Yang , Sivabalan Manivasagam , Raquel Urtasun

Feedforward Gaussian Splatting has recently emerged as an efficient paradigm for 4D reconstruction in autonomous driving. However, in unstructured off-road scenes, its performance degrades due to high-frequency geometry, ego-motion jitter,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Shuo Wang , Jilin Mei , Fuyang Liu , Wenfei Guan , Fanjie Kong , Zhihua Zhao , Shuai Wang , Chen Min , Yu Hu

Transformer-based general visual geometry frameworks have shown promising performance in camera pose estimation and 3D scene understanding. Recent advancements in Visual Geometry Grounded Transformer (VGGT) models have shown great promise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yangfan Xu , Lilian Zhang , Xiaofeng He , Pengdong Wu , Wenqi Wu , Jun Mao

We present SceneVGGT, a spatio-temporal 3D scene understanding framework that combines SLAM with semantic mapping for autonomous and assistive navigation. Built on VGGT, our method scales to long video streams via a sliding-window pipeline.…

Reconstructing coherent 3D geometry and appearance from unposed multi-view images is a fundamental yet challenging problem in computer vision. Most existing visual geometry foundation models predict explicit geometry by regressing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yuqi Wu , Tianyu Hu , Wenzhao Zheng , Yuanhui Huang , Haowen Sun , Jie Zhou , Jiwen Lu

Compressing large language models (LLMs) for deployment on commodity GPUs remains challenging: conventional scalar quantization is limited to fixed bit-widths (e.g., 8/4/3-bit), offers only a few discrete compression points, and typically…

Machine Learning · Computer Science 2026-05-07 Ye Qiao , Yian Wang , Zhiheng Chen , Hyoukjun Kwon , Sitao Huang