English
Related papers

Related papers: SketchDreamer: Interactive Text-Augmented Creative…

200 papers

Inspired by cognitive theories of creativity, this paper introduces a computational model (AIGenC) that lays down the necessary components to enable artificial agents to learn, use and generate transferable representations. Unlike machine…

Artificial Intelligence · Computer Science 2023-06-22 Corina Catarau-Cotutiu , Esther Mondragon , Eduardo Alonso

Artificial Intelligence-Generated Content (AIGC) refers to the use of AI to automate the information creation process while fulfilling the personalized requirements of users. However, due to the instability of AIGC models, e.g., the…

Artificial Intelligence · Computer Science 2023-01-10 Hongyang Du , Zonghang Li , Dusit Niyato , Jiawen Kang , Zehui Xiong , Xuemin , Shen , Dong In Kim

We present CoGS, a novel method for the style-conditioned, sketch-driven synthesis of images. CoGS enables exploration of diverse appearance possibilities for a given sketched object, enabling decoupled control over the structure and the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Cusuh Ham , Gemma Canet Tarres , Tu Bui , James Hays , Zhe Lin , John Collomosse

We propose an interactive GAN-based sketch-to-image translation method that helps novice users create images of simple objects. As the user starts to draw a sketch of a desired object type, the network interactively recommends plausible…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Arnab Ghosh , Richard Zhang , Puneet K. Dokania , Oliver Wang , Alexei A. Efros , Philip H. S. Torr , Eli Shechtman

Recent years have witnessed significant advancements in text-guided style transfer, primarily attributed to innovations in diffusion models. These models excel in conditional guidance, utilizing text or images to direct the sampling…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Nisha Huang , Kaer Huang , Yifan Pu , Jiangshan Wang , Jie Guo , Yiqiang Yan , Xiu Li , Tong-Yee Lee

Artificial Intelligence Generated Content (AIGC) assisting image production triggers controversy in journalism while attracting attention from media agencies. Key issues involve misinformation, authenticity, semantic fidelity, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Yajie Yang , Yuqing Zhao , Xiaochao Xi , Yinan Zhu

Realistic hair strand generation is crucial for applications like computer graphics and virtual reality. While diffusion models can generate hairstyles from text or images, these inputs lack precision and user-friendliness. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Na Zhang , Moran Li , Chengming Xu , Han Feng , Xiaobin Hu , Jiangning Zhang , Weijian Cao , Chengjie Wang , Yanwei Fu

Storyboarding is an established method for designing user experiences. Generative AI can support this process by helping designers quickly create visual narratives. However, existing tools only focus on accurate text-to-image generation.…

Human-Computer Interaction · Computer Science 2024-07-11 Zhaohui Liang , Xiaoyu Zhang , Kevin Ma , Zhao Liu , Xipei Ren , Kosa Goucher-Lambert , Can Liu

Generating cognitive-aligned layered SVGs remains challenging due to existing methods' tendencies toward either oversimplified single-layer outputs or optimization-induced shape redundancies. We propose LayerTracer, a diffusion transformer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yiren Song , Danze Chen , Mike Zheng Shou

Deep generative models have unlocked another profound realm of human creativity. By capturing and generalizing patterns within data, we have entered the epoch of all-encompassing Artificial Intelligence for General Creativity (AIGC).…

Artificial Intelligence · Computer Science 2023-12-27 Hanqun Cao , Cheng Tan , Zhangyang Gao , Yilun Xu , Guangyong Chen , Pheng-Ann Heng , Stan Z. Li

We present SketchGPT, a flexible framework that employs a sequence-to-sequence autoregressive model for sketch generation, and completion, and an interpretation case study for sketch recognition. By mapping complex sketches into simplified…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Adarsh Tiwari , Sanket Biswas , Josep Lladós

The rapid progress in diffusion models, transformers, and language agents has unlocked new possibilities, yet their potential in user interfaces and commercial applications remains underexplored. We present Sketch-Search Agent, a novel…

Information Retrieval · Computer Science 2025-04-15 Edward Sun

We introduce SemanticDraw, a new paradigm of interactive content creation where high-quality images are generated in near real-time from given multiple hand-drawn regions, each encoding prescribed semantic meaning. In order to maximize the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Jaerin Lee , Daniel Sungho Jung , Kanggeon Lee , Kyoung Mu Lee

Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches,…

Human-Computer Interaction · Computer Science 2024-05-24 Kristen M. Edwards , Brandon Man , Faez Ahmed

Personalization techniques for large text-to-image (T2I) models allow users to incorporate new concepts from reference images. However, existing methods primarily rely on textual descriptions, leading to limited control over customized…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Chufeng Xiao , Hongbo Fu

We introduce the first method for automatic image generation from scene-level freehand sketches. Our model allows for controllable image generation by specifying the synthesis goal via freehand sketches. The key contribution is an attribute…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Chengying Gao , Qi Liu , Qi Xu , Limin Wang , Jianzhuang Liu , Changqing Zou

Generative Artificial Intelligence (AI) is a cutting-edge technology capable of producing text, images, and various media content leveraging generative models and user prompts. Between 2022 and 2023, generative AI surged in popularity with…

Artificial Intelligence · Computer Science 2023-10-27 Nouar AlDahoul , Joseph Hong , Matteo Varvello , Yasir Zaki

Recently, there have been several promising methods to generate realistic imagery from deep convolutional networks. These methods sidestep the traditional computer graphics rendering pipeline and instead generate imagery at the pixel level…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Patsorn Sangkloy , Jingwan Lu , Chen Fang , Fisher Yu , James Hays

Recent remarkable improvements in large-scale text-to-image generative models have shown promising results in generating high-fidelity images. To further enhance editability and enable fine-grained generation, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Kangyeol Kim , Sunghyun Park , Junsoo Lee , Jaegul Choo

With recent advancements in the capabilities of Text-to-Image (T2I) AI models, product designers have begun experimenting with them in their work. However, T2I models struggle to interpret abstract language and the current user experience…

Human-Computer Interaction · Computer Science 2025-01-31 David Chuan-En Lin , Hyeonsu B. Kang , Nikolas Martelaro , Aniket Kittur , Yan-Ying Chen , Matthew K. Hong