English
Related papers

Related papers: Versatile Video Tokenization with Generative 2D Ga…

200 papers

In this study, we present an end-to-end pipeline capable of converting drone-captured video streams into high-fidelity 3D reconstructions with minimal latency. Unmanned aerial vehicles (UAVs) are extensively used in aerial real-time…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Christos Maikos , Georgios Angelidis , Georgios Th. Papadopoulos

Capturing and reconstructing high-speed dynamic 3D scenes has numerous applications in computer graphics, vision, and interdisciplinary fields such as robotics, aerodynamics, and evolutionary biology. However, achieving this using a single…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Zihao Zou , Ziyuan Qu , Xi Peng , Vivek Boominathan , Adithya Pediredla , Praneeth Chakravarthula

In recent years, the results of view-based 3D shape recognition methods have saturated, and models with excellent performance cannot be deployed on memory-limited devices due to their huge size of parameters. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Lixiang Xu , Qingzhe Cui , Richang Hong , Wei Xu , Enhong Chen , Xin Yuan , Chenglong Li , Yuanyan Tang

3D Gaussian Splatting (3DGS) has shown remarkable success in synthesizing novel views given multiple views of a static scene. Yet, 3DGS faces challenges when applied to dynamic scenes because 3D Gaussian parameters need to be updated per…

Graphics · Computer Science 2024-07-08 Kai Katsumata , Duc Minh Vo , Hideki Nakayama

3D Gaussian Splatting (3DGS) is a highly deployable real-time method for novel view synthesis. In practice, it requires a universal, consistent control mechanism that adjusts the trade-off between rendering quality and model compression…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Fengdi Zhang , Yibao Sun , Hongkun Cao , Ruqi Huang

Constructing photo-realistic Free-Viewpoint Videos (FVVs) of dynamic scenes from multi-view videos remains a challenging endeavor. Despite the remarkable advancements achieved by current neural rendering techniques, these methods generally…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Jiakai Sun , Han Jiao , Guangyuan Li , Zhanjie Zhang , Lei Zhao , Wei Xing

Generating a coherent 3D scene representation from multi-view images is a fundamental yet challenging task. Existing methods often struggle with multi-view fusion, leading to fragmented 3D representations and sub-optimal performance. To…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Junho Kim , Seongwon Lee

Single-image 3D scene reconstruction presents significant challenges due to its inherently ill-posed nature and limited input constraints. Recent advances have explored two promising directions: multiview generative models that train on 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Junlin Hao , Peiheng Wang , Haoyang Wang , Xinggong Zhang , Zongming Guo

As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and…

Human-Computer Interaction · Computer Science 2024-05-07 Ying Jiang , Chang Yu , Tianyi Xie , Xuan Li , Yutao Feng , Huamin Wang , Minchen Li , Henry Lau , Feng Gao , Yin Yang , Chenfanfu Jiang

We present a novel compression framework for 3D Gaussian splatting (3DGS) data that leverages transform coding tools originally developed for point clouds. Contrary to existing 3DGS compression methods, our approach can produce compressed…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Chenjunjie Wang , Shashank N. Sridhara , Eduardo Pavez , Antonio Ortega , Cheng Chang

Dynamic 3D scene reconstruction is essential for immersive media such as VR, MR, and XR, yet remains challenging for long multi-view sequences with large-scale motion. Existing dynamic Gaussian approaches are either Frame-Stream, offering…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Jie Liang , Jiahao Wu , Chao Wang , Jiayu Yang , Xiaoyun Zheng , Kaiqiang Xiong , Zhanke Wang , Jinbo Yan , Feng Gao , Ronggang Wang

We present an approach for high-quality dynamic Gaussian Splatting from monocular videos. To this end, we in this work go one step further beyond previous methods to explicitly model continuous position and orientation deformation of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Xuankai Zhang , Junjin Xiao , Shangwei Huang , Wei-shi Zheng , Qing Zhang

Recent advances in 3D Gaussian Splatting (3DGS) have enabled fast, photorealistic rendering of dynamic 3D scenes, showing strong potential in immersive communication. However, in digital human encoding and transmission, the compression…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Haocheng Tang , Ruoke Yan , Xinhui Yin , Qi Zhang , Xinfeng Zhang , Siwei Ma , Wen Gao , Chuanmin Jia

Dynamic extensions of 3D Gaussian Splatting (3DGS) achieve high-quality reconstructions through neural motion fields, but per-Gaussian neural inference makes these models computationally expensive. Building on DeformableGS, we introduce…

Graphics · Computer Science 2026-03-31 Allen Tu , Haiyang Ying , Alex Hanson , Yonghan Lee , Tom Goldstein , Matthias Zwicker

3D Gaussian Splatting has demonstrated remarkable real-time rendering capabilities and superior visual quality in novel view synthesis for static scenes. Building upon these advantages, researchers have progressively extended 3D Gaussians…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Han Jiao , Jiakai Sun , Lei Zhao , Zhanjie Zhang , Wei Xing , Huaizhong Lin

Event cameras offer a high temporal resolution over traditional frame-based cameras, which makes them suitable for motion and structure estimation. However, it has been unclear how event-based 3D Gaussian Splatting (3DGS) approaches could…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Kai Kohyama , Yoshimitsu Aoki , Guillermo Gallego , Shintaro Shiba

4D Gaussian Splatting (4DGS) has recently emerged as a promising technique for capturing complex dynamic 3D scenes with high fidelity. It utilizes a 4D Gaussian representation and a GPU-friendly rasterizer, enabling rapid rendering speeds.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xinjie Zhang , Zhening Liu , Yifan Zhang , Xingtong Ge , Dailan He , Tongda Xu , Yan Wang , Zehong Lin , Shuicheng Yan , Jun Zhang

We propose GGS, a Generalizable Gaussian Splatting method for Autonomous Driving which can achieve realistic rendering under large viewpoint changes. Previous generalizable 3D gaussian splatting methods are limited to rendering novel views…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Huasong Han , Kaixuan Zhou , Xiaoxiao Long , Yusen Wang , Chunxia Xiao

With 3D Gaussian Splatting (3DGS) advancing real-time and high-fidelity rendering for novel view synthesis, storage requirements pose challenges for their widespread adoption. Although various compression techniques have been proposed,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yihang Chen , Qianyi Wu , Mengyao Li , Weiyao Lin , Mehrtash Harandi , Jianfei Cai

Generating high-quality novel view renderings of 3D Gaussian Splatting (3DGS) in scenes featuring transient objects is challenging. We propose a novel hybrid representation, termed as HybridGS, using 2D Gaussians for transient objects per…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jingyu Lin , Jiaqi Gu , Lubin Fan , Bojian Wu , Yujing Lou , Renjie Chen , Ligang Liu , Jieping Ye