English
Related papers

Related papers: ControlGUI: Guiding Generative GUI Exploration thr…

200 papers

Large-scale generative models are capable of producing high-quality images from detailed text descriptions. However, many aspects of an image are difficult or impossible to convey through text. We introduce self-guidance, a method that…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Dave Epstein , Allan Jabri , Ben Poole , Alexei A. Efros , Aleksander Holynski

Illustration is a fundamental mode of human expression and communication. Certain types of motion that accompany speech can provide this illustrative mode of communication. While Augmented and Virtual Reality technologies (AR/VR) have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Hui Xian Grace Lim , Xuanming Cui , Yogesh S Rawat , Ser-Nam Lim

Creative ideation relies on exploring diverse stimuli, but the overwhelming abundance of information often makes it difficult to identify valuable insights or reach the `aha' moment. Traditional methods for accessing design stimuli lack…

Human-Computer Interaction · Computer Science 2025-04-23 Yaqing Yang , Vikram Mohanty , Nikolas Martelaro , Aniket Kittur , Yan-Ying Chen , Matthew K. Hong

Graphic design is crucial for conveying ideas and messages. Designers usually organize their work into objects, backgrounds, and vectorized text layers to simplify editing. However, this workflow demands considerable expertise. With the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Jingye Chen , Zhaowen Wang , Nanxuan Zhao , Li Zhang , Difan Liu , Jimei Yang , Qifeng Chen

Deep generative models have various content creation applications such as graphic design, e-commerce, and virtual Try-on. However, current works mainly focus on synthesizing realistic visual outputs, often ignoring other sensory modalities,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Ruihan Gao , Wenzhen Yuan , Jun-Yan Zhu

In many applications of computer graphics, art and design, it is desirable for a user to provide intuitive non-image input, such as text, sketch, stroke, graph or layout, and have a computer system automatically generate photo-realistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Yuan Xue , Yuan-Chen Guo , Han Zhang , Tao Xu , Song-Hai Zhang , Xiaolei Huang

Adopting contextually appropriate, audience-tailored linguistic styles is critical to the success of user-centric language generation systems (e.g., chatbots, computer-aided writing, dialog systems). While existing approaches demonstrate…

Computation and Language · Computer Science 2023-01-26 Samraj Moorjani , Adit Krishnan , Hari Sundaram , Ewa Maslowska , Aravind Sankar

Sketching out Graphical User Interface (GUI) layout is part of the pipeline of designing a GUI and a crucial task for the success of a software application. Arranging all components inside a GUI layout manually is a time-consuming task. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Andrey Sobolevsky , Guillaume-Alexandre Bilodeau , Jinghui Cheng , Jin L. C. Guo

Recent advances in denoising diffusion models have enabled rapid generation of optimized structures for topology optimization. However, these models often rely on surrogate predictors to enforce physical constraints, which may fail to…

Machine Learning · Computer Science 2025-08-05 Euihyun Kim , Keun Park , Yeoneung Kim

Conditional generative models typically demand large annotated training sets to achieve high-quality synthesis. As a result, there has been significant interest in designing models that perform plug-and-play generation, i.e., to use a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Nithin Gopalakrishnan Nair , Anoop Cherian , Suhas Lohit , Ye Wang , Toshiaki Koike-Akino , Vishal M. Patel , Tim K. Marks

Computing students increasingly rely on generative AI tools for programming assistance, often without formal instruction or guidance. This highlights a need to teach students how to effectively interact with AI models, particularly through…

Computers and Society · Computer Science 2025-09-15 Victor-Alexandru Pădurean , Paul Denny , Alkis Gotovos , Adish Singla

As generative AI tools increasingly influence creative practice, they raise longstanding HCI questions about how creatives learn complex software and how they can be better supported. We conducted an interview study with artists and…

Human-Computer Interaction · Computer Science 2026-05-12 Haidan Liu , Isabelle Kwan , Taiga Okuma , Jeffrey Loverock , Nicholas Vincent , Parmit K Chilana

Generative AI offers new opportunities for automating urban planning by creating site-specific urban layouts and enabling flexible design exploration. However, existing approaches often struggle to produce realistic and practical designs at…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Qingyi Wang , Yuebing Liang , Yunhan Zheng , Kaiyuan Xu , Jinhua Zhao , Shenhao Wang

As generative technologies advance, visual content has evolved into a complex mix of natural and AI-generated images, driving the need for more efficient coding techniques that prioritize perceptual quality. Traditional codecs and learned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jianhui Chang

Generation of graphs is a major challenge for real-world tasks that require understanding the complex nature of their non-Euclidean structures. Although diffusion models have achieved notable success in graph generation recently, they are…

Machine Learning · Computer Science 2024-06-04 Jaehyeong Jo , Dongki Kim , Sung Ju Hwang

Artificial Intelligence Generated Content (AIGC) has shown remarkable progress in generating realistic images. However, in this paper, we take a step "backward" and address AIGC for the most rudimentary visual modality of human sketches.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zhiyu Qu , Tao Xiang , Yi-Zhe Song

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Technological advances continue to redefine the dynamics of human-machine interactions, particularly in task execution. This proposal responds to the advancements in Generative AI by outlining a research plan that probes intent-AI…

Human-Computer Interaction · Computer Science 2024-05-03 Zijian Ding

Inspiration from design examples plays a crucial role in the creative process of user interface design. However, current tools and techniques that support inspiration usually only focus on example browsing with limited user control or…

Human-Computer Interaction · Computer Science 2022-03-15 Mohammad Amin Mozaffari , Xinyuan Zhang , Jinghui Cheng , Jin L. C. Guo

Community consultations are integral to urban planning processes intended to incorporate diverse stakeholder perspectives. However, limited resources, visual and spoken language barriers, and uneven power dynamics frequently constrain…

Human-Computer Interaction · Computer Science 2025-09-16 Rashid Mushkani , Hugo Berard , Shin Koseki