English
Related papers

Related papers: MagicCraft: Natural Language-Driven Generation of …

200 papers

Artificial Intelligence Generated Content (AIGC) has shown remarkable progress in generating realistic images. However, in this paper, we take a step "backward" and address AIGC for the most rudimentary visual modality of human sketches.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zhiyu Qu , Tao Xiang , Yi-Zhe Song

We present MagicInfinite, a novel diffusion Transformer (DiT) framework that overcomes traditional portrait animation limitations, delivering high-fidelity results across diverse character types-realistic humans, full-body figures, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hongwei Yi , Tian Ye , Shitong Shao , Xuancheng Yang , Jiantong Zhao , Hanzhong Guo , Terrance Wang , Qingyu Yin , Zeke Xie , Lei Zhu , Wei Li , Michael Lingelbach , Daquan Zhou

MetaDesigner introduces a transformative framework for artistic typography synthesis, powered by Large Language Models (LLMs) and grounded in a user-centric design paradigm. Its foundation is a multi-agent system comprising the Pipeline,…

Lifestyle images are photographs that capture environments and objects in everyday settings. In furniture product marketing, advertisers often create lifestyle images containing products to resonate with potential buyers, allowing buyers to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jialu Gao , Mithun Das Gupta , Qun Li , Raveena Kshatriya , Andrew D. Wilson , Keng-hao Chang , Balasaravanan Thoravi Kumaravel

Generative design, an AI-assisted technology for optimizing design through algorithmic processes, is propelling advancements across numerous fields. As the use of immersive environments such as Augmented Reality (AR) continues to rise,…

Human-Computer Interaction · Computer Science 2025-03-28 Sora Kang , Kaiwen Yu , Xinyi Zhou , Joonhwan Lee

The field of generative AI has a transformative impact on various areas, including virtual reality, autonomous driving, the metaverse, gaming, and robotics. Among these applications, 3D object generation techniques are of utmost importance.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Qinghong Sun , Yangguang Li , ZeXiang Liu , Xiaoshui Huang , Fenggang Liu , Xihui Liu , Wanli Ouyang , Jing Shao

Personalized dialogue systems aim to endow the chatbot agent with more anthropomorphic traits for human-like interactions. Previous approaches have explored explicitly user profile modeling using text descriptions, implicit derivation of…

Computation and Language · Computer Science 2023-10-31 Zhenyi Lu , Wei Wei , Xiaoye Qu , XianLing Mao , Dangyang Chen , Jixiong Chen

Character image animation has rapidly advanced with the rise of digital humans. However, existing methods rely largely on 2D-rendered pose images for motion guidance, which limits generalization and discards essential 4D information for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanbo Ding , Xirui Hu , Zhizhi Guo , Yan Zhang , Xinrui Wang , Zhixiang He , Chi Zhang , Yali Wang , Xuelong Li

3D Content Generation is at the heart of many computer graphics applications, including video gaming, film-making, virtual and augmented reality, etc. This paper proposes a novel deep-learning based approach for automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yongzhi Xu , Yonhon Ng , Yifu Wang , Inkyu Sa , Yunfei Duan , Zhenhong Sun , Yang Li , Pan Ji , Hongdong Li

New systems employ Machine Learning to sift through large knowledge sources, creating flexible Large Language Models. These models discern context and predict sequential information in various communication forms. Generative AI, leveraging…

Artificial Intelligence · Computer Science 2023-07-19 Ted Selker

Recent advances in video generation have led to remarkable improvements in visual quality and temporal coherence. Upon this, trajectory-controllable video generation has emerged to enable precise object motion control through explicitly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Quanhao Li , Zhen Xing , Rui Wang , Hui Zhang , Qi Dai , Zuxuan Wu

AI Advancements have augmented casual writing and story generation, but their usage poses challenges in collaborative storytelling. In role-playing games such as Dungeons & Dragons (D&D), composing prompts using generative AI requires a…

Human-Computer Interaction · Computer Science 2023-04-05 Jose Ma. Santiago , Richard Lance Parayno , Jordan Aiko Deja , Briane Paul V. Samson

People with visual impairments often struggle to create content that relies heavily on visual elements, particularly when conveying spatial and structural information. Existing accessible drawing tools, which construct images line by line,…

Human-Computer Interaction · Computer Science 2025-04-30 Seonghee Lee , Maho Kohga , Steve Landau , Sile O'Modhrain , Hari Subramonyam

The emerging field of panoramic video generation from text and image prompts unlocks new creative possibilities in virtual reality (VR), addressing the limitations of current immersive experiences, which are constrained by pre-designed…

Human-Computer Interaction · Computer Science 2025-01-28 Yunge Wen

Creating interactive scenes often involves complex programming tasks. Although large language models (LLMs) like ChatGPT can generate code from natural language, their output is often error-prone, particularly when scripting interactions…

Human-Computer Interaction · Computer Science 2025-02-10 Hui Ye , Chufeng Xiao , Jiaye Leng , Pengfei Xu , Hongbo Fu

We present DreamWaltz, a novel framework for generating and animating complex 3D avatars given text guidance and parametric human body prior. While recent methods have shown encouraging results for text-to-3D generation of common objects,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yukun Huang , Jianan Wang , Ailing Zeng , He Cao , Xianbiao Qi , Yukai Shi , Zheng-Jun Zha , Lei Zhang

Generative videos have the potential to revolutionize game development by autonomously creating new content. In this paper, we present GameFactory, a framework for action-controlled scene-generalizable game video generation. We first…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Jiwen Yu , Yiran Qin , Xintao Wang , Pengfei Wan , Di Zhang , Xihui Liu

Traditional 3D modeling requires technical expertise, specialized software, and time-intensive processes, making it inaccessible for many users. Our research aims to lower these barriers by combining generative AI and augmented reality (AR)…

Graphics · Computer Science 2025-05-01 Majid Behravan , Maryam Haghani , Denis Gracanin

Text-to-3D scene generation from natural language is highly desirable for digital content creation. However, existing methods are largely domain-restricted or reliant on predefined spatial relationships, limiting their capacity for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jun Luo , Jiaxiang Tang , Ruijie Lu , Gang Zeng

Indoor scene modification has emerged as a prominent area within computer vision, particularly for its applications in Augmented Reality (AR) and Virtual Reality (VR). Traditional methods often rely on pre-existing object databases and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yiyang Luo , Ke Lin , Chao Gu