中文
相关论文

相关论文: HexaGen3D: StableDiffusion is just one step away f…

200 篇论文

Diffusion models have exhibited substantial success in text-to-image generation. However, they often encounter challenges when dealing with complex and dense prompts involving multiple objects, attribute binding, and long descriptions. In…

计算机视觉与模式识别 · 计算机科学 2024-08-28 Mushui Liu , Yuhang Ma , Yang Zhen , Jun Dan , Yunlong Yu , Zeng Zhao , Zhipeng Hu , Bai Liu , Changjie Fan

We tackle the problem of text-driven 3D generation from a geometry alignment perspective. Given a set of text prompts, we aim to generate a collection of objects with semantically corresponding parts aligned across them. Recent methods…

We present DIRECT-3D, a diffusion-based 3D generative model for creating high-quality 3D assets (represented by Neural Radiance Fields) from text prompts. Unlike recent 3D generative models that rely on clean and well-aligned 3D data,…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Qihao Liu , Yi Zhang , Song Bai , Adam Kortylewski , Alan Yuille

This paper explores the burgeoning field of 3D content generation within the landscape of Artificial Intelligence Generated Content (AIGC) and large-scale models. It investigates innovative methods like Text-to-3D and Image-to-3D, which…

图形学 · 计算机科学 2024-05-27 Ke Zhao , Andreas Larsen

Recent advances in large reconstruction and generative models have significantly improved scene reconstruction and novel view generation. However, due to compute limitations, each inference with these large models is confined to a small…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Shangjin Zhai , Zhichao Ye , Jialin Liu , Weijian Xie , Jiaqi Hu , Zhen Peng , Hua Xue , Danpeng Chen , Xiaomeng Wang , Lei Yang , Nan Wang , Haomin Liu , Guofeng Zhang

With the onset of diffusion-based generative models and their ability to generate text-conditioned images, content generation has received a massive invigoration. Recently, these models have been shown to provide useful guidance for the…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Alexander Vilesov , Pradyumna Chari , Achuta Kadambi

While generative artificial intelligence has advanced significantly across text, image, audio, and video domains, 3D generation remains comparatively underdeveloped due to fundamental challenges such as data scarcity, algorithmic…

In this work, we introduce FlexGen, a flexible framework designed to generate controllable and consistent multi-view images, conditioned on a single-view image, or a text prompt, or both. FlexGen tackles the challenges of controllable…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Xinli Xu , Wenhang Ge , Jiantao Lin , Jiawei Feng , Lie Xu , HanFeng Zhao , Shunsi Zhang , Ying-Cong Chen

Despite diffusion models having shown powerful abilities to generate photorealistic images, generating videos that are realistic and diverse still remains in its infancy. One of the key reasons is that current methods intertwine spatial…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Zhiwu Qing , Shiwei Zhang , Jiayu Wang , Xiang Wang , Yujie Wei , Yingya Zhang , Changxin Gao , Nong Sang

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

计算机视觉与模式识别 · 计算机科学 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Large-scale diffusion generative models are greatly simplifying image, video and 3D asset creation from user-provided text prompts and images. However, the challenging problem of text-to-4D dynamic 3D scene generation with diffusion…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Yufeng Zheng , Xueting Li , Koki Nagano , Sifei Liu , Karsten Kreis , Otmar Hilliges , Shalini De Mello

Text-to-3D generation has shown promising results, yet common challenges such as the Multi-face Janus problem and extended generation time for high-quality assets. In this paper, we address these issues by introducing a novel three-stage…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Trapoom Ukarapol , Kevin Pruvost

We present GenesisTex, a novel method for synthesizing textures for 3D geometries from text descriptions. GenesisTex adapts the pretrained image diffusion model to texture space by texture space sampling. Specifically, we maintain a latent…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Chenjian Gao , Boyan Jiang , Xinghui Li , Yingpeng Zhang , Qian Yu

Inspired by generative paradigms in image and video, 3D shape generation has made notable progress, enabling the rapid synthesis of high-fidelity 3D assets from a single image. However, current methods still face challenges, including the…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Yangguang Li , Xianglong He , Zi-Xin Zou , Zexiang Liu , Wanli Ouyang , Ding Liang , Yan-Pei Cao

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

Text-to-3D synthesis has recently emerged as a new approach to sampling 3D models by adopting pretrained text-to-image models as guiding visual priors. An intriguing but underexplored problem with existing text-to-3D methods is that 3D…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Uy Dieu Tran , Minh Luu , Phong Ha Nguyen , Khoi Nguyen , Binh-Son Hua

We introduce TurboPortrait3D: a method for low-latency novel-view synthesis of human portraits. Our approach builds on the observation that existing image-to-3D models for portrait generation, while capable of producing renderable 3D…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Emily Kim , Julieta Martinez , Timur Bagautdinov , Jessica Hodgins

Text-to-3D generation has achieved significant success by incorporating powerful 2D diffusion models, but insufficient 3D prior knowledge also leads to the inconsistency of 3D geometry. Recently, since large-scale multi-view datasets have…

计算机视觉与模式识别 · 计算机科学 2024-05-03 Junyoung Seo , Susung Hong , Wooseok Jang , Inès Hyeonsu Kim , Minseop Kwak , Doyup Lee , Seungryong Kim

We present EucliDreamer, a simple and effective method to generate textures for 3D models given text prompts and meshes. The texture is parametrized as an implicit function on the 3D surface, which is optimized with the Score Distillation…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Cindy Le , Congrui Hetang , Chendi Lin , Ang Cao , Yihui He

We introduce Imagen 3, a latent diffusion model that generates high quality images from text prompts. We describe our quality and responsibility evaluations. Imagen 3 is preferred over other state-of-the-art (SOTA) models at the time of…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Imagen-Team-Google , : , Jason Baldridge , Jakob Bauer , Mukul Bhutani , Nicole Brichtova , Andrew Bunner , Lluis Castrejon , Kelvin Chan , Yichang Chen , Sander Dieleman , Yuqing Du , Zach Eaton-Rosen , Hongliang Fei , Nando de Freitas , Yilin Gao , Evgeny Gladchenko , Sergio Gómez Colmenarejo , Mandy Guo , Alex Haig , Will Hawkins , Hexiang Hu , Huilian Huang , Tobenna Peter Igwe , Christos Kaplanis , Siavash Khodadadeh , Yelin Kim , Ksenia Konyushkova , Karol Langner , Eric Lau , Rory Lawton , Shixin Luo , Soňa Mokrá , Henna Nandwani , Yasumasa Onoe , Aäron van den Oord , Zarana Parekh , Jordi Pont-Tuset , Hang Qi , Rui Qian , Deepak Ramachandran , Poorva Rane , Abdullah Rashwan , Ali Razavi , Robert Riachi , Hansa Srinivasan , Srivatsan Srinivasan , Robin Strudel , Benigno Uria , Oliver Wang , Su Wang , Austin Waters , Chris Wolff , Auriel Wright , Zhisheng Xiao , Hao Xiong , Keyang Xu , Marc van Zee , Junlin Zhang , Katie Zhang , Wenlei Zhou , Konrad Zolna , Ola Aboubakar , Canfer Akbulut , Oscar Akerlund , Isabela Albuquerque , Nina Anderson , Marco Andreetto , Lora Aroyo , Ben Bariach , David Barker , Sherry Ben , Dana Berman , Courtney Biles , Irina Blok , Pankil Botadra , Jenny Brennan , Karla Brown , John Buckley , Rudy Bunel , Elie Bursztein , Christina Butterfield , Ben Caine , Viral Carpenter , Norman Casagrande , Ming-Wei Chang , Solomon Chang , Shamik Chaudhuri , Tony Chen , John Choi , Dmitry Churbanau , Nathan Clement , Matan Cohen , Forrester Cole , Mikhail Dektiarev , Vincent Du , Praneet Dutta , Tom Eccles , Ndidi Elue , Ashley Feden , Shlomi Fruchter , Frankie Garcia , Roopal Garg , Weina Ge , Ahmed Ghazy , Bryant Gipson , Andrew Goodman , Dawid Górny , Sven Gowal , Khyatti Gupta , Yoni Halpern , Yena Han , Susan Hao , Jamie Hayes , Jonathan Heek , Amir Hertz , Ed Hirst , Emiel Hoogeboom , Tingbo Hou , Heidi Howard , Mohamed Ibrahim , Dirichi Ike-Njoku , Joana Iljazi , Vlad Ionescu , William Isaac , Reena Jana , Gemma Jennings , Donovon Jenson , Xuhui Jia , Kerry Jones , Xiaoen Ju , Ivana Kajic , Christos Kaplanis , Burcu Karagol Ayan , Jacob Kelly , Suraj Kothawade , Christina Kouridi , Ira Ktena , Jolanda Kumakaw , Dana Kurniawan , Dmitry Lagun , Lily Lavitas , Jason Lee , Tao Li , Marco Liang , Maggie Li-Calis , Yuchi Liu , Javier Lopez Alberca , Matthieu Kim Lorrain , Peggy Lu , Kristian Lum , Yukun Ma , Chase Malik , John Mellor , Thomas Mensink , Inbar Mosseri , Tom Murray , Aida Nematzadeh , Paul Nicholas , Signe Nørly , João Gabriel Oliveira , Guillermo Ortiz-Jimenez , Michela Paganini , Tom Le Paine , Roni Paiss , Alicia Parrish , Anne Peckham , Vikas Peswani , Igor Petrovski , Tobias Pfaff , Alex Pirozhenko , Ryan Poplin , Utsav Prabhu , Yuan Qi , Matthew Rahtz , Cyrus Rashtchian , Charvi Rastogi , Amit Raul , Ali Razavi , Sylvestre-Alvise Rebuffi , Susanna Ricco , Felix Riedel , Dirk Robinson , Pankaj Rohatgi , Bill Rosgen , Sarah Rumbley , Moonkyung Ryu , Anthony Salgado , Tim Salimans , Sahil Singla , Florian Schroff , Candice Schumann , Tanmay Shah , Eleni Shaw , Gregory Shaw , Brendan Shillingford , Kaushik Shivakumar , Dennis Shtatnov , Zach Singer , Evgeny Sluzhaev , Valerii Sokolov , Thibault Sottiaux , Florian Stimberg , Brad Stone , David Stutz , Yu-Chuan Su , Eric Tabellion , Shuai Tang , David Tao , Kurt Thomas , Gregory Thornton , Andeep Toor , Cristian Udrescu , Aayush Upadhyay , Cristina Vasconcelos , Alex Vasiloff , Andrey Voynov , Amanda Walker , Luyu Wang , Miaosen Wang , Simon Wang , Stanley Wang , Qifei Wang , Yuxiao Wang , Ágoston Weisz , Olivia Wiles , Chenxia Wu , Xingyu Federico Xu , Andrew Xue , Jianbo Yang , Luo Yu , Mete Yurtoglu , Ali Zand , Han Zhang , Jiageng Zhang , Catherine Zhao , Adilet Zhaxybay , Miao Zhou , Shengqi Zhu , Zhenkai Zhu , Dawn Bloxwich , Mahyar Bordbar , Luis C. Cobo , Eli Collins , Shengyang Dai , Tulsee Doshi , Anca Dragan , Douglas Eck , Demis Hassabis , Sissie Hsiao , Tom Hume , Koray Kavukcuoglu , Helen King , Jack Krawczyk , Yeqing Li , Kathy Meier-Hellstern , Andras Orban , Yury Pinsky , Amar Subramanya , Oriol Vinyals , Ting Yu , Yori Zwols