English
Related papers

Related papers: GaussianGPT: Towards Autoregressive 3D Gaussian Sc…

200 papers

3D Gaussian Splatting (3DGS) has shown convincing performance in rendering speed and fidelity, yet the generation of Gaussian Splatting remains a challenge due to its discreteness and unstructured nature. In this work, we propose DiffGS, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junsheng Zhou , Weiqi Zhang , Yu-Shen Liu

Neural scene representations, such as 3D Gaussian Splatting (3DGS), have enabled high-quality neural rendering; however, their large storage and transmission costs hinder deployment in resource-constrained environments. Existing compression…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiaqi Chen , Xinhao Ji , Yuanyuan Gao , Hao Li , Yuning Gong , Yifei Liu , Dan Xu , Zhihang Zhong , Dingwen Zhang , Xiao Sun

4D content generation has achieved remarkable progress recently. However, existing methods suffer from long optimization times, a lack of motion controllability, and a low quality of details. In this paper, we introduce DreamGaussian4D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiawei Ren , Liang Pan , Jiaxiang Tang , Chi Zhang , Ang Cao , Gang Zeng , Ziwei Liu

We present SketchGPT, a flexible framework that employs a sequence-to-sequence autoregressive model for sketch generation, and completion, and an interpretation case study for sketch recognition. By mapping complex sketches into simplified…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Adarsh Tiwari , Sanket Biswas , Josep Lladós

Recent advancements in 3D generation have leveraged synthetic datasets with ground truth 3D assets and predefined cameras. However, the potential of adopting real-world datasets, which can produce significantly more realistic 3D scenes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xinyang Li , Zhangyu Lai , Linning Xu , Yansong Qu , Liujuan Cao , Shengchuan Zhang , Bo Dai , Rongrong Ji

Feed-forward 3D reconstruction offers substantial runtime advantages over per-scene optimization, which remains slow at inference and often fragile under sparse views. However, existing feed-forward methods still have potential for further…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Tianyu Chen , Wei Xiang , Kang Han , Yu Lu , Di Wu , Gaowen Liu , Ramana Rao Kompella

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiaxiang Tang , Jiawei Ren , Hang Zhou , Ziwei Liu , Gang Zeng

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

Graphics · Computer Science 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan

Over the past year, 3D Gaussian Splatting (3DGS) has received significant attention for its ability to represent 3D scenes in a perceptually accurate manner. However, it can require a substantial amount of storage since each splat's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Brent Zoomers , Maarten Wijnants , Ivan Molenaers , Joni Vanherck , Jeroen Put , Lode Jorissen , Nick Michiels

Recent advances in text-to-image diffusion models have been driven by the increasing availability of paired 2D data. However, the development of 3D diffusion models has been hindered by the scarcity of high-quality 3D data, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Tiange Xiang , Kai Li , Chengjiang Long , Christian Häne , Peihong Guo , Scott Delp , Ehsan Adeli , Li Fei-Fei

We introduce AutoPartGen, a model that generates objects composed of 3D parts in an autoregressive manner. This model can take as input an image of an object, 2D masks of the object's parts, or an existing 3D object, and generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Minghao Chen , Jianyuan Wang , Roman Shapovalov , Tom Monnier , Hyunyoung Jung , Dilin Wang , Rakesh Ranjan , Iro Laina , Andrea Vedaldi

The field of novel-view synthesis has recently witnessed the emergence of 3D Gaussian Splatting, which represents scenes in a point-based manner and renders through rasterization. This methodology, in contrast to Radiance Fields that rely…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Fengyi Zhang , Yadan Luo , Tianjun Zhang , Lin Zhang , Zi Huang

We introduce AvatarPointillist, a novel framework for generating dynamic 4D Gaussian avatars from a single portrait image. At the core of our method is a decoder-only Transformer that autoregressively generates a point cloud for 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Hongyu Liu , Xuan Wang , Zijian Wu , Yating Wang , Ziyu Wan , Yue Ma , Runtao Liu , Boyao Zhou , Yujun Shen , Qifeng Chen

With the widespread use of virtual reality applications, 3D scene generation has become a new challenging research frontier. 3D scenes have highly complex structures and need to ensure that the output is dense, coherent, and contains all…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Xiaolu Hou , Mingcheng Li , Dingkang Yang , Jiawei Chen , Ziyun Qian , Xiao Zhao , Yue Jiang , Jinjie Wei , Qingyao Xu , Lihua Zhang

The generation of quadrilateral-dominant meshes is a cornerstone of professional 3D content creation. However, existing generative models generate quad meshes by first generating triangle meshes and then merging triangles into…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jian Liu , Chunshi Wang , Song Guo , Haohan Weng , Zhen Zhou , Zhiqi Li , Jiaao Yu , Yiling Zhu , Jing Xu , Biwen Lei , Zhuo Chen , Chunchao Guo

Despite recent successes in novel view synthesis using 3D Gaussian Splatting (3DGS), modeling scenes with sparse inputs remains a challenge. In this work, we address two critical yet overlooked issues in real-world sparse-input modeling:…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Yingji Zhong , Zhihao Li , Dave Zhenyu Chen , Lanqing Hong , Dan Xu

In this work, we introduce a generative approach for pose-free (without camera parameters) reconstruction of 360 scenes from a sparse set of 2D images. Pose-free scene reconstruction from incomplete, pose-free observations is usually…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Soumava Paul , Prakhar Kaushik , Alan Yuille

Generating realistic 3D objects from single-view images requires natural appearance, 3D consistency, and the ability to capture multiple plausible interpretations of unseen regions. Existing approaches often rely on fine-tuning pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Pufan Li , Bi'an Du , Wei Hu

Text-to-3D synthesis has recently seen intriguing advances by combining the text-to-image priors with 3D representation methods, e.g., 3D Gaussian Splatting (3D GS), via Score Distillation Sampling (SDS). However, a hurdle of existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Lutao Jiang , Xu Zheng , Yuanhuiyi Lyu , Jiazhou Zhou , Lin Wang

Symbolic regression refers to the task of finding a closed-form mathematical expression to fit a set of data points. Genetic programming based techniques are the most common algorithms used to tackle this problem, but recently,…

Machine Learning · Computer Science 2025-10-10 Ryan T. Tymkow , Benjamin D. Schnapp , Mojtaba Valipour , Ali Ghodshi