English
Related papers

Related papers: GUIGAN: Learning to Generate GUI Designs Using Gen…

200 papers

The process of developing a mobile application typically starts with the ideation and conceptualization of its user interface. This concept is then translated into a set of mock-ups to help determine how well the user interface embodies the…

Software Engineering · Computer Science 2019-01-07 Carlos Bernal-Cardenas , Kevin Moran , Michele Tufano , Zichang Liu , Linyong Nan , Zhehan Shi , Denys Poshyvanyk

Generating images via the generative adversarial network (GAN) has attracted much attention recently. However, most of the existing GAN-based methods can only produce low-resolution images of limited quality. Directly generating…

Computer Vision and Pattern Recognition · Computer Science 2019-04-01 Yong Guo , Qi Chen , Jian Chen , Qingyao Wu , Qinfeng Shi , Mingkui Tan

The computer programs most users interact with daily are driven by a graphical user interface (GUI). However, many scientific applications are used with a command line interface (CLI) for the ease of development and increased flexibility…

Human-Computer Interaction · Computer Science 2008-06-03 N. C. Manoukis , E. C. Anderson

A class of recent approaches for generating images, called Generative Adversarial Networks (GAN), have been used to generate impressively realistic images of objects, bedrooms, handwritten digits and a variety of other image modalities.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Swaminathan Gurumurthy , Ravi Kiran Sarvadevabhatla , Venkatesh Babu Radhakrishnan

Among the major remaining challenges for generative adversarial networks (GANs) is the capacity to synthesize globally and locally coherent images with object shapes and textures indistinguishable from real images. To target this issue we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Edgar Schönfeld , Bernt Schiele , Anna Khoreva

Generative Artificial Intelligence (GenAI) has emerged as a fundamental component of intelligent interactive systems, enabling the automatic generation of multimodal media content. The continuous enhancement in the quality of Artificial…

Human-Computer Interaction · Computer Science 2024-07-23 Yongquan Hu , Dawen Zhang , Mingyue Yuan , Kaiqi Xian , Don Samitha Elvitigala , June Kim , Gelareh Mohammadi , Zhenchang Xing , Xiwei Xu , Aaron Quigley

Federated Generative Adversarial Network (FedGAN) is a communication-efficient approach to train a GAN across distributed clients without clients having to share their sensitive training data. In this paper, we experimentally show that…

Machine Learning · Computer Science 2021-04-19 Vaikkunth Mugunthan , Vignesh Gokul , Lalana Kagal , Shlomo Dubnov

During the early stages of interface design, designers need to produce multiple sketches to explore a design space. Design tools often fail to support this critical stage, because they insist on specifying more details than necessary.…

Human-Computer Interaction · Computer Science 2026-03-31 Aryan Garg , Yue Jiang , Antti Oulasvirta

The evolution of User Interface design has emphasized the need for efficient, reusable, and editable components to ensure an efficient design process. This research introduces CoGen, a system that uses machine learning techniques to…

Human-Computer Interaction · Computer Science 2026-01-16 Ishani Kanapathipillai , Obhasha Priyankara

During software front-end development, the work to convert Graphical User Interface(GUI) image to the corresponding front-end code is an inevitable tedious work. There have been some attempts to make this work to be automatic. However, the…

Machine Learning · Computer Science 2020-07-08 Xiaoling Huang , Feng Liao

Generative Adversarial Networks (GANs) have obtained extraordinary success in the generation of realistic images, a domain where a lower pixel-level accuracy is acceptable. We study the problem, not yet tackled in the literature, of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Emanuele Ghelfi , Paolo Galeone , Michele De Simoni , Federico Di Mattia

Graphical User Interface (GUI) agents adopt an end-to-end paradigm that maps a screenshot to an action sequence, thereby automating repetitive tasks in virtual environments. However, existing GUI agents are evaluated almost exclusively on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Chunyi Li , Longfei Li , Zicheng Zhang , Xiaohong Liu , Min Tang , Weisi Lin , Guangtao Zhai

While a multitude of studies have been conducted on graph drawing, many existing methods only focus on optimizing a single aesthetic aspect of graph layouts, which can lead to sub-optimal results. There are a few existing methods that have…

Machine Learning · Computer Science 2023-08-15 Xiaoqi Wang , Kevin Yen , Yifan Hu , Han-Wei Shen

We present a method for improving human design of chairs. The goal of the method is generating enormous chair candidates in order to facilitate human designer by creating sketches and 3d models accordingly based on the generated chair…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Zhibo Liu , Feng Gao , Yizhou Wang

Design is a non-linear, reflective process in which practitioners engage with visual, semantic, and other expressive materials to explore, iterate, and refine ideas. As Generative AI (GenAI) becomes integrated into professional design…

Human-Computer Interaction · Computer Science 2026-03-04 Xiaohan Peng , Wendy E. Mackay , Janin Koch

Despite the recency of their conception, Generative Adversarial Networks (GANs) constitute an extensively researched machine learning sub-field for the creation of synthetic data through deep generative modeling. GANs have consequently been…

Networking and Internet Architecture · Computer Science 2021-05-11 Hojjat Navidan , Parisa Fard Moshiri , Mohammad Nabati , Reza Shahbazian , Seyed Ali Ghorashi , Vahid Shah-Mansouri , David Windridge

Post-training GUI agents in interactive environments is critical for developing generalization and long-horizon planning capabilities. However, training on real-world applications is hindered by high latency, poor reproducibility, and…

Artificial Intelligence · Computer Science 2026-02-17 Yuan Cao , Dezhi Ran , Mengzhou Wu , Yuzhe Guo , Xin Chen , Ang Li , Gang Cao , Gong Zhi , Hao Yu , Linyi Li , Wei Yang , Tao Xie

This study proposes a UI interface generation method based on a diffusion model, aiming to achieve high-quality, diversified, and personalized interface design through generative artificial intelligence technology. The diffusion model is…

Human-Computer Interaction · Computer Science 2025-03-27 Yifei Duan , Liuqingqing Yang , Tong Zhang , Zhijun Song , Fenghua Shao

Graphical User Interfaces (GUIs) are central to app development projects. App developers may use the GUIs of other apps as a means of requirements refinement and rapid prototyping or as a source of inspiration for designing and improving…

Software Engineering · Computer Science 2024-11-12 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Binbin Xu , Pierre Louis Bernard , Gérard Dray , Walid Maalej

Generative Adversarial Networks (GANs) have shown great capacity on image generation, in which a discriminative model guides the training of a generative model to construct images that resemble real images. Recently, GANs have been extended…

Computation and Language · Computer Science 2018-08-24 Xinyue Liu , Xiangnan Kong , Lei Liu , Kuorong Chiang