English
Related papers

Related papers: MagicCraft: Natural Language-Driven Generation of …

200 papers

We explore the intersection of human and machine creativity by generating sculptural objects through machine learning. This research raises questions about both the technical details of automatic art generation and the interaction between…

Machine Learning · Computer Science 2019-08-22 Songwei Ge , Austin Dill , Eunsu Kang , Chun-Liang Li , Lingyao Zhang , Manzil Zaheer , Barnabas Poczos

I-nteract is a cyber-physical system that enables real-time interaction with both virtual and real artifacts to design 3D models for additive manufacturing by leveraging on mixed reality technologies. This paper presents novel advances in…

Human-Computer Interaction · Computer Science 2020-10-22 Ammar Malik , Hugo Lhachemi , Robert Shorten

Digital creators, from indie filmmakers to animation studios, face a persistent bottleneck: translating their creative vision into precise camera movements. Despite significant progress in computer vision and artificial intelligence,…

Recent advances in AIGC (Artificial Intelligence Generated Content) models have enabled significant progress in image and video generation. However, users still struggle to obtain content that aligns with their preferences due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Zitong Xu , Dake Shen , Yaosong Du , Kexiang Hao , Jinghan Huang , Xiande Huang

The generation of high-quality 3D environments is crucial for industries such as gaming, virtual reality, and cinema, yet remains resource-intensive due to the reliance on manual processes. This study performs a systematic review of…

Graphics · Computer Science 2025-06-09 Miguel Silva , Alexandre Valle de Carvalho

In recent years, the demand for 3D content has grown exponentially with the intelligent upgrade of interactive media, extended reality (XR), and Metaverse industries. In order to overcome the limitations of traditional manual modeling…

Graphics · Computer Science 2025-12-23 Xiang Tang , Ruotong Li , Xiaopeng Fan

Character customization, or 'face crafting,' is a vital feature in role-playing games (RPGs), enhancing player engagement by enabling the creation of personalized avatars. Existing automated methods often struggle with generalizability…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Suzhen Wang , Weijie Chen , Wei Zhang , Minda Zhao , Lincheng Li , Rongsheng Zhang , Zhipeng Hu , Xin Yu

Spatial intelligence is foundational to AI systems that interact with the physical world, particularly in 3D scene generation and spatial comprehension. Current methodologies for 3D scene generation often rely heavily on predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Libin Liu , Shen Chen , Sen Jia , Jingzhe Shi , Zhongyu Jiang , Can Jin , Wu Zongkai , Jenq-Neng Hwang , Lei Li

Human emotions are essentially molded by lived experiences, from which we construct personalised meaning. The engagement in such meaning-making process has been practiced as an intervention in various psychotherapies to promote wellness.…

Human-Computer Interaction · Computer Science 2024-03-06 Qian Wan , Xin Feng , Yining Bei , Zhiqi Gao , Zhicong Lu

We introduce AvatarForge, a framework for generating animatable 3D human avatars from text or image inputs using AI-driven procedural generation. While diffusion-based methods have made strides in general 3D object generation, they struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

This research presents Spiritus, an AI-assisted creation tool designed to streamline 2D character animation creation while enhancing creative flexibility. By integrating natural language processing and diffusion models, users can…

Human-Computer Interaction · Computer Science 2025-03-13 Qirui Sun , Yunyi Ni , Teli Yuan , Jingjing Zhang , Fan Yang , Zhihao Yao , Haipeng Mi

The automated generation of interactive 3D cities is a critical challenge with broad applications in autonomous driving, virtual reality, and embodied intelligence. While recent advances in generative models and procedural techniques have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Zishan Liu , Zecong Tang , RuoCheng Wu , Xinzhe Zheng , Jingyu Hu , Ka-Hei Hui , Haoran Xie , Bo Dai , Zhengzhe Liu

Recent neural generation systems have demonstrated the potential for procedurally generating game content, images, stories, and more. However, most neural generation algorithms are "uncontrolled" in the sense that the user has little say in…

Artificial Intelligence · Computer Science 2022-08-08 Zhiyu Lin , Rohan Agarwal , Mark Riedl

Visual blends combine elements from two distinct visual concepts into a single, integrated image, with the goal of conveying ideas through imaginative and often thought-provoking visuals. Communicating abstract concepts through visual…

Human-Computer Interaction · Computer Science 2025-02-25 Zhida Sun , Zhenyao Zhang , Yue Zhang , Min Lu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Designing 3D scenes is currently a creative task that requires significant expertise and effort in using complex 3D design interfaces. This effortful design process starts in stark contrast to the easiness with which people can use language…

Graphics · Computer Science 2017-03-02 Angel X. Chang , Mihail Eric , Manolis Savva , Christopher D. Manning

Automatic 3D content creation seeks to replace labor-intensive modeling and scanning pipelines with systems that can synthesize or recover 3D assets directly from text or images. Its applications span video games, virtual reality, robotics,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jiahao Li

We introduce $\textit{InteractiveVideo}$, a user-centric framework for video generation. Different from traditional generative approaches that operate based on user-provided images or text, our framework is designed for dynamic interaction,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Yiyuan Zhang , Yuhao Kang , Zhixin Zhang , Xiaohan Ding , Sanyuan Zhao , Xiangyu Yue

Recent developments in natural language generation (NLG) using neural language models have brought us closer than ever to the goal of building AI-powered creative writing tools. However, most prior work on human-AI collaboration in the…

Human-Computer Interaction · Computer Science 2022-11-10 Daphne Ippolito , Ann Yuan , Andy Coenen , Sehmon Burnam

We introduce WavCraft, a collective system that leverages large language models (LLMs) to connect diverse task-specific models for audio content creation and editing. Specifically, WavCraft describes the content of raw audio materials in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-13 Jinhua Liang , Huan Zhang , Haohe Liu , Yin Cao , Qiuqiang Kong , Xubo Liu , Wenwu Wang , Mark D. Plumbley , Huy Phan , Emmanouil Benetos

With the rise of short video platforms represented by TikTok, the trend of users expressing their creativity through photos and videos has increased dramatically. However, ordinary users lack the professional skills to produce high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Sixiao Zheng , Jingyang Huo , Yu Wang , Yanwei Fu