English
Related papers

Related papers: GUIGAN: Learning to Generate GUI Designs Using Gen…

200 papers

Bionic design refers to an approach of generative creativity in which a target object (e.g. a floor lamp) is designed to contain features of biological source objects (e.g. flowers), resulting in creative biologically-inspired design. In…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Simiao Yu , Hao Dong , Pan Wang , Chao Wu , Yike Guo

With the deep integration of artificial intelligence and interactive technology, Graphical User Interface (GUI) Agent, as the carrier connecting goal-oriented natural language and real-world devices, has received widespread attention from…

Artificial Intelligence · Computer Science 2025-11-13 Leyang Yang , Ziwei Wang , Xiaoxuan Tang , Sheng Zhou , Dajun Chen , Wei Jiang , Yong Li

The goal of graph representation learning is to embed each vertex in a graph into a low-dimensional vector space. Existing graph representation learning methods can be classified into two categories: generative models that learn the…

Machine Learning · Computer Science 2017-11-23 Hongwei Wang , Jia Wang , Jialin Wang , Miao Zhao , Weinan Zhang , Fuzheng Zhang , Xing Xie , Minyi Guo

AI models excel at creating content, but typically render it with static, predefined interfaces. Specifically, the output of LLMs is often a markdown "wall of text". Generative UI is a long standing promise, where the model generates not…

Graphical User Interface (GUI) agents have the potential to assist users in interacting with complex software (e.g., PowerPoint, Photoshop). While prior research has primarily focused on automating user actions through clicks and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Saelyne Yang , Jaesang Yu , Yi-Hao Peng , Kevin Qinghong Lin , Jae Won Cho , Yale Song , Juho Kim

Generative Adversarial Networks are used for generating the data using a generator and a discriminator, GANs usually produce high-quality images, but training GANs in an adversarial setting is a difficult task. GANs require high computation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Md Nurul Muttakin , Malik Shahid Sultan , Robert Hoehndorf , Hernando Ombao

While generative AI enables high-fidelity UI generation from text prompts, users struggle to articulate design intent and evaluate or refine results-creating gulfs of execution and evaluation. To understand the information needed for UI…

Human-Computer Interaction · Computer Science 2026-02-10 Seokhyeon Park , Soohyun Lee , Eugene Choi , Hyunwoo Kim , Minkyu Kweon , Yumin Song , Jinwook Seo

Graphic design is an effective language for visual communication. Using complex composition of visual elements (e.g., shape, color, font) guided by design principles and aesthetics, design helps produce more visually-appealing content. The…

Human-Computer Interaction · Computer Science 2023-09-06 Danqing Huang , Jiaqi Guo , Shizhao Sun , Hanling Tian , Jieru Lin , Zheng Hu , Chin-Yew Lin , Jian-Guang Lou , Dongmei Zhang

Biometric systems based on iris recognition are currently being used in border control applications and mobile devices. However, research in iris recognition is stymied by various factors such as limited datasets of bonafide irides and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Shivangi Yadav , Arun Ross

Generative UI is transforming interface design by facilitating AI-driven collaborative workflows between designers and computational systems. This study establishes a working definition of Generative UI through a multi-method qualitative…

Human-Computer Interaction · Computer Science 2025-05-22 Kyungho Lee

The demand for quality in mobile applications has increased greatly given users' high reliance on them for daily tasks. Developers work tirelessly to ensure that their applications are both functional and user-friendly. In pursuit of this,…

Software Engineering · Computer Science 2025-05-16 Safwat Ali Khan

As a new way of training generative models, Generative Adversarial Nets (GAN) that uses a discriminative model to guide the training of the generative model has enjoyed considerable success in generating real-valued data. However, it has…

Machine Learning · Computer Science 2017-08-28 Lantao Yu , Weinan Zhang , Jun Wang , Yong Yu

Designing a logo is a long, complicated, and expensive process for any designer. However, recent advancements in generative algorithms provide models that could offer a possible solution. Logos are multi-modal, have very few categorical…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Ajkel Mino , Gerasimos Spanakis

It is necessary to improve the concepts of the present web based graphical user interface for the development of more flexible and intelligent interface to provide ease and increase the level of comfort at user end like most of the desktop…

Human-Computer Interaction · Computer Science 2010-11-16 Zeeshan Ahmed , Vasil Popov

Graphical User Interface (GUI) agents have made significant progress in automating digital tasks through the utilization of computer vision and language models. Nevertheless, existing agent systems encounter notable limitations. Firstly,…

Artificial Intelligence · Computer Science 2025-06-24 Jinjie Wei , Jiyao Liu , Lihao Liu , Ming Hu , Junzhi Ning , Mingcheng Li , Weijie Yin , Junjun He , Xiao Liang , Chao Feng , Dingkang Yang

The emergence of deep generative models has recently enabled the automatic generation of massive amounts of graphical content, both in 2D and in 3D. Generative Adversarial Networks (GANs) and style control mechanisms, such as Adaptive…

Graphics · Computer Science 2020-04-28 Omry Sendik , Dani Lischinski , Daniel Cohen-Or

Recent advances in generative models and adversarial training have enabled artificially generating artworks in various artistic styles. It is highly desirable to gain more control over the generated style in practice. However, artistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xin Miao , Huayan Wang , Jun Fu , Jiayi Liu , Shen Wang , Zhenyu Liao

Vibration rendering is essential for creating realistic tactile experiences in human-virtual object interactions, such as in video game controllers and VR devices. By dynamically adjusting vibration parameters based on user actions, these…

Human-Computer Interaction · Computer Science 2025-02-18 Mingxin Zhang , Shun Terui , Yasutoshi Makino , Hiroyuki Shinoda

The generator in the generative adversarial network (GAN) learns image generation in a coarse-to-fine manner in which earlier layers learn the overall structure of the image and the latter ones refine the details. To propagate the coarse…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Seung Park , Yong-Goo Shin

Generative AI (GenAI) models have become more capable than ever at augmenting productivity and cognition across diverse contexts. However, a fundamental challenge remains as users struggle to anticipate what AI will generate. As a result,…

Human-Computer Interaction · Computer Science 2025-04-17 Bryan Min , Haijun Xia