English
Related papers

Related papers: SketchDreamer: Interactive Text-Augmented Creative…

200 papers

With the involvement of artificial intelligence (AI), sketches can be automatically generated under certain topics. Even though breakthroughs have been made in previous studies in this area, a relatively high proportion of the generated…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yunkui Pang , Zhiqing Pan , Ruiyang Sun , Shuchong Wang

Creative sketching or doodling is an expressive activity, where imaginative and previously unseen depictions of everyday visual objects are drawn. Creative sketch image generation is a challenging vision problem, where the task is to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Ankan Kumar Bhunia , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Fahad Shahbaz Khan , Jorma Laaksonen , Michael Felsberg

Text-conditioned image generation models are a prevalent use of AI image synthesis, yet intuitively controlling output guided by an artist remains challenging. Current methods require multiple images and textual prompts for each object to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Shounak Chatterjee

Recently, text-to-3D approaches have achieved high-fidelity 3D content generation using text description. However, the generated objects are stochastic and lack fine-grained control. Sketches provide a cheap approach to introduce such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Minglin Chen , Weihao Yuan , Yukun Wang , Zhe Sheng , Yisheng He , Zilong Dong , Liefeng Bo , Yulan Guo

Sketching is a natural and effective visual communication medium commonly used in creative processes. Recent developments in deep-learning models drastically improved machines' ability in understanding and generating visual content. An…

Human-Computer Interaction · Computer Science 2021-11-22 Forrest Huang , Eldon Schoop , David Ha , Jeffrey Nichols , John Canny

Although recent advancements in diffusion models have significantly enriched the quality of generated images, challenges remain in synthesizing pixel-based human-drawn sketches, a representative example of abstract expression. To combat…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jiho Park , Sieun Choi , Jaeyoon Seo , Jihie Kim

This paper explores the burgeoning field of 3D content generation within the landscape of Artificial Intelligence Generated Content (AIGC) and large-scale models. It investigates innovative methods like Text-to-3D and Image-to-3D, which…

Graphics · Computer Science 2024-05-27 Ke Zhao , Andreas Larsen

Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this paper turns it into a photorealistic image - just like those shown in Fig. 1(a), all non-cherry-picked. We differ significantly from prior art in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Peter Schaldenbrand , Zhixuan Liu , Jean Oh

Recent advances in diffusion models have significantly improved text-to-image (T2I) generation, but they often struggle to balance fine-grained precision with high-level control. Methods like ControlNet and T2I-Adapter excel at following…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Pouyan Navard , Amin Karimi Monsefi , Mengxi Zhou , Wei-Lun Chao , Alper Yilmaz , Rajiv Ramnath

Recent advances in text-conditioned generative models have provided us with neural networks capable of creating images of astonishing quality, be they realistic, abstract, or even creative. These models have in common that (more or less…

Human-Computer Interaction · Computer Science 2022-10-10 Francisco Ibarrola , Tomas Lawton , Kazjon Grace

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is…

Graphics · Computer Science 2024-12-20 Pei Chen , Fudong Wang , Yixuan Tong , Jingdong Chen , Ming Yang , Minghui Yang

Recent remarkable advances in large-scale text-to-image diffusion models have inspired a significant breakthrough in text-to-3D generation, pursuing 3D content creation solely from a given text prompt. However, existing text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yang Chen , Yingwei Pan , Yehao Li , Ting Yao , Tao Mei

This study presents a theory-inspired visual narrative generative system that integrates conceptual principles-comic authoring idioms-with generative and language models to enhance the comic creation process. Our system combines human…

Artificial Intelligence · Computer Science 2024-09-27 Yi-Chun Chen , Arnav Jhala

Driven by advances in generative artificial intelligence (AI) techniques and algorithms, the widespread adoption of AI-generated content (AIGC) has emerged, allowing for the generation of diverse and high-quality content. Especially, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-27 Hongyang Du , Ruichen Zhang , Dusit Niyato , Jiawen Kang , Zehui Xiong , Dong In Kim , Xuemin , Shen , H. Vincent Poor

Recently, ChatGPT, along with DALL-E-2 and Codex,has been gaining significant attention from society. As a result, many individuals have become interested in related resources and are seeking to uncover the background and secrets behind its…

Artificial Intelligence · Computer Science 2023-03-09 Yihan Cao , Siyu Li , Yixin Liu , Zhiling Yan , Yutong Dai , Philip S. Yu , Lichao Sun

Sketching is inherently a sequential process, in which strokes are drawn in a meaningful order to explore and refine ideas. However, most generative models treat sketches as static images, overlooking the temporal structure that underlies…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Hui Ren , Yuval Alaluf , Omer Bar Tal , Alexander Schwing , Antonio Torralba , Yael Vinker

Scientific sketches (e.g., models) offer a powerful lens into students' conceptual understanding, yet AI-powered automated assessment of such free-form, visually diverse artifacts remains a critical challenge. Existing solutions often treat…

Human-Computer Interaction · Computer Science 2025-10-21 Ehsan Latif , Zirak Khan , Xiaoming Zhai

Sketching and natural languages are effective communication media for interactive applications. We introduce Sketchforme, the first neural-network-based system that can generate sketches based on text descriptions specified by users.…

Human-Computer Interaction · Computer Science 2019-04-10 Forrest Huang , John F. Canny

This paper presents a real-time generative drawing system that interprets and integrates both formal intent - the structural, compositional, and stylistic attributes of a sketch - and contextual intent - the semantic and thematic meaning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jookyung Song , Mookyoung Kang , Nojun Kwak