English
Related papers

Related papers: Idea23D: Collaborative LMM Agents Enable 3D Model …

200 papers

The ability to generate diverse 3D articulated head avatars is vital to a plethora of applications, including augmented reality, cinematography, and education. Recent work on text-guided 3D object generation has shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Alexander W. Bergman , Wang Yifan , Gordon Wetzstein

With the growing demands of AI-generated content (AIGC), the need for high-quality, diverse, and scalable data has become increasingly crucial. However, collecting large-scale real-world data remains costly and time-consuming, hindering the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Kunyu Feng , Yue Ma , Xinhua Zhang , Boshi Liu , Yikuang Yuluo , Yinhan Zhang , Runtao Liu , Hongyu Liu , Zhiyuan Qin , Shanhui Mo , Qifeng Chen , Zeyu Wang

Development of multimodal interactive systems is hindered by the lack of rich, multimodal (text, images) conversational data, which is needed in large quantities for LLMs. Previous approaches augment textual dialogues with retrieved images,…

Computation and Language · Computer Science 2024-10-04 Hossein Aboutalebi , Hwanjun Song , Yusheng Xie , Arshit Gupta , Justin Sun , Hang Su , Igor Shalyminov , Nikolaos Pappas , Siffi Singh , Saab Mansour

Multimodal learning has rapidly advanced visual understanding, largely via multimodal large language models (MLLMs) that use powerful LLMs as cognitive cores. In visual generation, however, these powerful core models are typically reduced…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Han Lin , Xichen Pan , Ziqi Huang , Ji Hou , Jialiang Wang , Weifeng Chen , Zecheng He , Felix Juefei-Xu , Junzhe Sun , Zhipeng Fan , Ali Thabet , Mohit Bansal , Chu Wang

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Due to massive computational demands of large generative models, AI-Generated Content (AIGC) can organize collaborative Mobile AIGC Service Providers (MASPs) at network edges to provide ubiquitous and customized content generation for…

Networking and Internet Architecture · Computer Science 2025-02-18 Yinqiu Liu , Ruichen Zhang , Jiacheng Wang , Dusit Niyato , Xianbin Wang , Dong In Kim , Hongyang Du

Text-to-3D (T23D) generation has emerged as a crucial visual generation task, aiming at synthesizing 3D content from textual descriptions. Studies of this task are currently shifting from per-scene T23D, which requires optimization of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xiao Cai , Sitong Su , Jingkuan Song , Pengpeng Zeng , Ji Zhang , Qinhong Du , Mengqi Li , Heng Tao Shen , Lianli Gao

Generating 3D models has traditionally been a complex task requiring specialized expertise. While recent advances in generative AI have sought to automate this process, existing methods produce non-editable representation, such as meshes or…

Graphics · Computer Science 2026-01-21 Fadlullah Raji , Stefano Petrangeli , Matheus Gadelha , Yu Shen , Uttaran Bhattacharya , Gang Wu

Recently, 3D understanding has become popular to facilitate autonomous agents to perform further decisionmaking. However, existing 3D datasets and methods are often limited to specific tasks. On the other hand, recent progress in Large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mingsheng Li , Xin Chen , Chi Zhang , Sijin Chen , Hongyuan Zhu , Fukun Yin , Gang Yu , Tao Chen

Real-world multimodal applications often require any-to-any capabilities, enabling both understanding and generation across modalities including text, image, audio, and video. However, integrating the strengths of autoregressive language…

Machine Learning · Computer Science 2025-08-15 Jiulin Li , Ping Huang , Yexin Li , Shuo Chen , Juewen Hu , Ye Tian

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is…

Graphics · Computer Science 2024-12-20 Pei Chen , Fudong Wang , Yixuan Tong , Jingdong Chen , Ming Yang , Minghui Yang

To address the challenges of digital intelligence in the digital economy, artificial intelligence-generated content (AIGC) has emerged. AIGC uses artificial intelligence to assist or replace manual content generation by generating content…

Artificial Intelligence · Computer Science 2023-04-14 Jiayang Wu , Wensheng Gan , Zefeng Chen , Shicheng Wan , Hong Lin

The rapid advancement of AI-generated image (AIGI) models presents new challenges for evaluating image quality, particularly across three aspects: perceptual quality, prompt correspondence, and authenticity. To address these challenges, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Chuan Cui , Kejiang Chen , Zhihua Wei , Wen Shen , Weiming Zhang , Nenghai Yu

Large-scale Text-to-image Generation Models (LTGMs) (e.g., DALL-E), self-supervised deep learning models trained on a huge dataset, have demonstrated the capacity for generating high-quality open-domain images from multi-modal input.…

Human-Computer Interaction · Computer Science 2023-02-17 Hyung-Kwon Ko , Gwanmo Park , Hyeon Jeon , Jaemin Jo , Juho Kim , Jinwook Seo

Generative recommendation based on Large Language Models (LLMs) have transformed the traditional ranking-based recommendation style into a text-to-text generation paradigm. However, in contrast to standard NLP tasks that inherently operate…

Information Retrieval · Computer Science 2024-05-20 Juntao Tan , Shuyuan Xu , Wenyue Hua , Yingqiang Ge , Zelong Li , Yongfeng Zhang

Recent text-to-image generation models have shown promising results in generating high-fidelity photo-realistic images. In parallel, the problem of data scarcity has brought a growing interest in employing AIGC technology for high-quality…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Qifan Yu , Juncheng Li , Wentao Ye , Siliang Tang , Yueting Zhuang

3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Lukas Höllein , Aljaž Božič , Norman Müller , David Novotny , Hung-Yu Tseng , Christian Richardt , Michael Zollhöfer , Matthias Nießner

AI models excel at creating content, but typically render it with static, predefined interfaces. Specifically, the output of LLMs is often a markdown "wall of text". Generative UI is a long standing promise, where the model generates not…

Web 3.0 represents the next generation of the Internet, which is widely recognized as a decentralized ecosystem that focuses on value expression and data ownership. By leveraging blockchain and artificial intelligence technologies, Web 3.0…

Artificial Intelligence · Computer Science 2025-10-07 Jinbo Wen , Jiawen Kang , Linfeng Zhang , Xiaoying Tang , Jianhang Tang , Yang Zhang , Zhaohui Yang , Dusit Niyato

In recent times, the generation of 3D assets from text prompts has shown impressive results. Both 2D and 3D diffusion models can help generate decent 3D objects based on prompts. 3D diffusion models have good 3D consistency, but their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Taoran Yi , Jiemin Fang , Junjie Wang , Guanjun Wu , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Qi Tian , Xinggang Wang