English
Related papers

Related papers: LGM: Large Multi-View Gaussian Model for High-Reso…

200 papers

Text- or image-to-3D generators and 3D scanners can now produce 3D assets with high-quality shapes and textures. These assets typically consist of a single, fused representation, like an implicit neural field, a Gaussian mixture, or a mesh,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minghao Chen , Roman Shapovalov , Iro Laina , Tom Monnier , Jianyuan Wang , David Novotny , Andrea Vedaldi

We present InstantMesh, a feed-forward framework for instant 3D mesh generation from a single image, featuring state-of-the-art generation quality and significant training scalability. By synergizing the strengths of an off-the-shelf…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jiale Xu , Weihao Cheng , Yiming Gao , Xintao Wang , Shenghua Gao , Ying Shan

Human motion generation, a cornerstone technique in animation and video production, has widespread applications in various tasks like text-to-motion and music-to-dance. Previous works focus on developing specialist models tailored for each…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mingyuan Zhang , Daisheng Jin , Chenyang Gu , Fangzhou Hong , Zhongang Cai , Jingfang Huang , Chongzhi Zhang , Xinying Guo , Lei Yang , Ying He , Ziwei Liu

Single-image 3D reconstruction remains a fundamental challenge in computer vision due to inherent geometric ambiguities and limited viewpoint information. Recent advances in Latent Video Diffusion Models (LVDMs) offer promising 3D priors…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yabo Chen , Chen Yang , Jiemin Fang , Xiaopeng Zhang , Lingxi Xie , Wei Shen , Wenrui Dai , Hongkai Xiong , Qi Tian

We introduce the Deformable Gaussian Splats Large Reconstruction Model (DGS-LRM), the first feed-forward method predicting deformable 3D Gaussian splats from a monocular posed video of any dynamic scene. Feed-forward scene reconstruction…

Attaining a high degree of user controllability in visual generation often requires intricate, fine-grained inputs like layouts. However, such inputs impose a substantial burden on users when compared to simple text inputs. To address the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Weixi Feng , Wanrong Zhu , Tsu-jui Fu , Varun Jampani , Arjun Akula , Xuehai He , Sugato Basu , Xin Eric Wang , William Yang Wang

Seeing clearly with high resolution is a foundation of Large Multimodal Models (LMMs), which has been proven to be vital for visual perception and reasoning. Existing works usually employ a straightforward resolution upscaling method, where…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yi-Fan Zhang , Qingsong Wen , Chaoyou Fu , Xue Wang , Zhang Zhang , Liang Wang , Rong Jin

It is desirable but challenging to generate content-rich long videos in the scale of minutes. Autoregressive large language models (LLMs) have achieved great success in generating coherent and long sequences of tokens in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yuqing Wang , Tianwei Xiong , Daquan Zhou , Zhijie Lin , Yang Zhao , Bingyi Kang , Jiashi Feng , Xihui Liu

Large-scale diffusion models have achieved remarkable success in generating high-quality images from textual descriptions, gaining popularity across various applications. However, the generation of layered content, such as transparent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yusuf Dalva , Yijun Li , Qing Liu , Nanxuan Zhao , Jianming Zhang , Zhe Lin , Pinar Yanardag

Generating sewing patterns in garment design is receiving increasing attention due to its CG-friendly and flexible-editing nature. Previous sewing pattern generation methods have been able to produce exquisite clothing, but struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Shengqi Liu , Yuhao Cheng , Zhuo Chen , Xingyu Ren , Wenhan Zhu , Lincheng Li , Mengxiao Bi , Xiaokang Yang , Yichao Yan

Reconstructing high-quality 3D models from sparse 2D images has garnered significant attention in computer vision. Recently, 3D Gaussian Splatting (3DGS) has gained prominence due to its explicit representation with efficient training speed…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Keng-Wei Chang , Zi-Ming Wang , Shang-Hong Lai

With the success of 2D diffusion models, 2D AIGC content has already transformed our lives. Recently, this success has been extended to 3D AIGC, with state-of-the-art methods generating textured 3D models from single images or text.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Junhao Chen , Xiang Li , Xiaojun Ye , Chao Li , Zhaoxin Fan , Hao Zhao

Large Language Model (LLM)-driven digital humans have sparked a series of recent studies on co-speech gesture generation systems. However, existing approaches struggle with real-time synthesis and long-text comprehension. This paper…

Graphics · Computer Science 2025-06-03 Yueqian Guo , Tianzhao Li , Xin Lyu , Jiehaolin Chen , Zhaohan Wang , Sirui Xiao , Yurun Chen , Yezi He , Helin Li , Fan Zhang

The advancement of real-time 3D scene reconstruction and novel view synthesis has been significantly propelled by 3D Gaussian Splatting (3DGS). However, effectively training large-scale 3DGS and rendering it in real-time across various…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Yang Liu , He Guan , Chuanchen Luo , Lue Fan , Naiyan Wang , Junran Peng , Zhaoxiang Zhang

Generating lifelike human motions from descriptive texts has experienced remarkable research focus in the recent years, propelled by the emerging requirements of digital humans.Despite impressive advances, existing approaches are often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuan Wang , Di Huang , Yaqi Zhang , Wanli Ouyang , Jile Jiao , Xuetao Feng , Yan Zhou , Pengfei Wan , Shixiang Tang , Dan Xu

We present GALA3D, generative 3D GAussians with LAyout-guided control, for effective compositional text-to-3D generation. We first utilize large language models (LLMs) to generate the initial layout and introduce a layout-guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xiaoyu Zhou , Xingjian Ran , Yajiao Xiong , Jinlin He , Zhiwei Lin , Yongtao Wang , Deqing Sun , Ming-Hsuan Yang

Fine-grained alignment between videos and text is challenging due to complex spatial and temporal dynamics in videos. Existing video-based Large Multimodal Models (LMMs) handle basic conversations but struggle with precise pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Shehan Munasinghe , Hanan Gani , Wenqi Zhu , Jiale Cao , Eric Xing , Fahad Shahbaz Khan , Salman Khan

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan

We propose the first Large Reconstruction Model (LRM) that predicts the 3D model of an object from a single input image within just 5 seconds. In contrast to many previous methods that are trained on small-scale datasets such as ShapeNet in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yicong Hong , Kai Zhang , Jiuxiang Gu , Sai Bi , Yang Zhou , Difan Liu , Feng Liu , Kalyan Sunkavalli , Trung Bui , Hao Tan