English
Related papers

Related papers: Idea23D: Collaborative LMM Agents Enable 3D Model …

200 papers

Artificial intelligence generated content (AIGC), a rapidly advancing technology, is transforming content creation across domains, such as text, images, audio, and video. Its growing potential has attracted more and more researchers and…

Artificial Intelligence · Computer Science 2026-03-03 Chengzhang Zhu , Luobin Cui , Ying Tang , Jiacun Wang

Recent Multimodal Large Language Models (MLLMs) have shown high potential for spatial reasoning within 3D scenes. However, they typically rely on computationally expensive 3D representations like point clouds or reconstructed Bird's-Eye…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Shuyao Shi , Kang G. Shin

MLLMs have been widely studied for video question answering recently. However, most existing assessments focus on natural videos, overlooking synthetic videos, such as AI-generated content (AIGC). Meanwhile, some works in video generation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Tingyu Song , Tongyan Hu , Guo Gan , Yilun Zhao

Most AI systems today are designed to manage tasks and execute predefined steps. This makes them effective for process coordination but limited in their ability to engage in joint problem-solving with humans or contribute new ideas. We…

Human-Computer Interaction · Computer Science 2026-02-03 Kexin Quan , Dina Albassam , Mengke Wu , Zijian Ding , Jessie Chin

While previous approaches to 3D human motion generation have achieved notable success, they often rely on extensive training and are limited to specific tasks. To address these challenges, we introduce Motion-Agent, an efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Qi Wu , Yubo Zhao , Yifan Wang , Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

3D generation guided by text-to-image diffusion models enables the creation of visually compelling assets. However previous methods explore generation based on image or text. The boundaries of creativity are limited by what can be expressed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Sandeep Mishra , Oindrila Saha , Alan C. Bovik

The rapid advancement of Artificial Intelligence Generated Content (AIGC) techniques has unlocked opportunities in generating diverse and compelling advertising images based on referenced product images and textual scene descriptions. This…

Graphics · Computer Science 2025-08-19 Yiyun Chen , Weikai Yang

Effective feedback, including critique and evaluation, helps designers develop design concepts and refine their ideas, supporting informed decision-making throughout the iterative design process. However, in studio-based design courses,…

Human-Computer Interaction · Computer Science 2025-12-03 Hyunseung Lim , Dasom Choi , DaEun Choi , Sooyohn Nam , Hwajung Hong

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore…

Human-Computer Interaction · Computer Science 2024-04-18 Faraz Faruqi , Yingtao Tian , Vrushank Phadnis , Varun Jampani , Stefanie Mueller

The burgeoning field of Artificial Intelligence Generated Content (AIGC) is witnessing rapid advancements, particularly in video generation. This paper introduces AIGCBench, a pioneering comprehensive and scalable benchmark designed to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Fanda Fan , Chunjie Luo , Wanling Gao , Jianfeng Zhan

With the rapid evolution of AI Generated Content (AIGC), forged images produced through this technology are inherently more deceptive and require less human intervention compared to traditional Computer-generated Graphics (CG). However,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Ziyi Xi , Wenmin Huang , Kangkang Wei , Weiqi Luo , Peijia Zheng

Recent advances in Large Multimodal Models (LMM) have made it possible for various applications in human-machine interactions. However, developing LMMs that can comprehend, reason, and plan in complex and diverse 3D environments remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Sijin Chen , Xin Chen , Chi Zhang , Mingsheng Li , Gang Yu , Hao Fei , Hongyuan Zhu , Jiayuan Fan , Tao Chen

The rapid advancement of large language models (LLMs) and artificial intelligence-generated content (AIGC) has accelerated AI-native applications, such as AI-based storybooks that automate engaging story production for children. However,…

Computation and Language · Computer Science 2025-03-10 Xuenan Xu , Jiahao Mei , Chenliang Li , Yuning Wu , Ming Yan , Shaopeng Lai , Ji Zhang , Mengyue Wu

Large language models (LLMs) have exhibited remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. Despite the recent success, current LLMs are not capable of processing…

In recent years, the rapid advancement of Artificial Intelligence Generated Content (AIGC) has attracted widespread attention. Among the AIGC, AI generated omnidirectional images hold significant potential for Virtual Reality (VR) and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Liu Yang , Huiyu Duan , Long Teng , Yucheng Zhu , Xiaohong Liu , Menghan Hu , Xiongkuo Min , Guangtao Zhai , Patrick Le Callet

Though recent advances in vision-language models (VLMs) have achieved remarkable progress across a wide range of multimodal tasks, understanding 3D spatial relationships from limited views remains a significant challenge. Previous reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zhangquan Chen , Manyuan Zhang , Xinlei Yu , Xufang Luo , Mingze Sun , Zihao Pan , Xiang An , Yan Feng , Peng Pei , Xunliang Cai , Ruqi Huang

As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future design of immersive…

Human-Computer Interaction · Computer Science 2026-04-09 Junlong Chen , Jens Grubert , Per Ola Kristensson

In the era of Artificial Intelligence Generated Content (AIGC), conditional multimodal synthesis technologies (e.g., text-to-image, text-to-video, text-to-audio, etc) are gradually reshaping the natural content in the real world. The key to…

Artificial Intelligence · Computer Science 2024-01-04 Weijian Mai , Jian Zhang , Pengfei Fang , Zhijun Zhang

Recent advancements in multi-modal 3D pre-training methods have shown promising efficacy in learning joint representations of text, images, and point clouds. However, adopting point clouds as 3D representation fails to fully capture the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Haoyuan Li , Yanpeng Zhou , Tao Tang , Jifei Song , Yihan Zeng , Michael Kampffmeyer , Hang Xu , Xiaodan Liang

This paper aims to design a unified Computer-Aided Design (CAD) generation system that can easily generate CAD models based on the user's inputs in the form of textual description, images, point clouds, or even a combination of them.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jingwei Xu , Chenyu Wang , Zibo Zhao , Wen Liu , Yi Ma , Shenghua Gao