English
Related papers

Related papers: GUIGAN: Learning to Generate GUI Designs Using Gen…

200 papers

We present a novel approach to image manipulation and understanding by simultaneously learning to segment object masks, paste objects to another background image, and remove them from original images. For this purpose, we develop a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-01-17 Pavel Ostyakov , Roman Suvorov , Elizaveta Logacheva , Oleg Khomenko , Sergey I. Nikolenko

GUI agent aims to enable automated operations on Mobile/PC devices, which is an important task toward achieving artificial general intelligence. The rapid advancement of VLMs accelerates the development of GUI agents, owing to their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Zhixiong Zeng , Jing Huang , Liming Zheng , Wenkang Han , Yufeng Zhong , Lei Chen , Longrong Yang , Yingjie Chu , Yuzhi He , Lin Ma

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

Generative adversarial networks (GANs) have proven effective in modeling distributions of high-dimensional data. However, their training instability is a well-known hindrance to convergence, which results in practical challenges in their…

Machine Learning · Computer Science 2022-09-28 Alessandro Ferrero , Shireen Elhabian , Ross Whitaker

Generative adversarial networks (GANs) have been trained to be professional artists able to create stunning artworks such as face generation and image style transfer. In this paper, we focus on a realistic business scenario: automated…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yinpeng Chen , Zhiyu Pan , Min Shi , Hao Lu , Zhiguo Cao , Weicai Zhong

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Huiyu Zhou , Ruili Wang , M. Emre Celebi , Jie Yang

I present IGAN (Inferent Generative Adversarial Networks), a neural architecture that learns both a generative and an inference model on a complex high dimensional data distribution, i.e. a bidirectional mapping between data samples and a…

Machine Learning · Computer Science 2024-09-04 Luc Vignaud

This paper proposes the idea of using a generative adversarial network (GAN) to assist a novice user in designing real-world shapes with a simple interface. The user edits a voxel grid with a painting interface (like Minecraft). Yet, at any…

Computer Vision and Pattern Recognition · Computer Science 2018-01-09 Jerry Liu , Fisher Yu , Thomas Funkhouser

Recent progress in GUI agents has substantially improved visual grounding, yet robust planning remains challenging, particularly when the environment deviates from a canonical initial state. In real applications, users often invoke…

Artificial Intelligence · Computer Science 2026-05-26 Henry Hengyuan Zhao , Kaiming Yang , Wendi Yu , Difei Gao , Mike Zheng Shou

Skin cancer is a serious condition that requires accurate diagnosis and treatment. One way to assist clinicians in this task is using computer-aided diagnosis (CAD) tools that automatically segment skin lesions from dermoscopic images. We…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Shubham Innani , Prasad Dutande , Ujjwal Baid , Venu Pokuri , Spyridon Bakas , Sanjay Talbar , Bhakti Baheti , Sharath Chandra Guntuku

Graphic design is essential for visual communication with layouts being fundamental to composing attractive designs. Layout generation differs from pixel-level image synthesis and is unique in terms of the requirement of mutual relations…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Hsin-Ying Lee , Lu Jiang , Irfan Essa , Phuong B Le , Haifeng Gong , Ming-Hsuan Yang , Weilong Yang

Generative user interfaces (UIs) create new opportunities to adapt interfaces to individual users on demand, but personalization remains difficult because desirable UI properties are subjective, hard to articulate, and costly to infer from…

Machine Learning · Computer Science 2026-04-14 Yi-Hao Peng , Samarth Das , Jeffrey P. Bigham , Jason Wu

With the advent of WWW and outburst in technology and software development, testing the software became a major concern. Due to the importance of the testing phase in a software development life cycle, testing has been divided into…

Software Engineering · Computer Science 2012-02-22 A. Isabella , Emi Retna

Recent advancements in artificial intelligence, such as computer vision and deep learning, have led to the emergence of numerous generative AI platforms, particularly for image generation. However, the application of AI-generated image…

Human-Computer Interaction · Computer Science 2024-06-21 Yuying Tang , Mariana Ciancia , Zhigang Wang , Ze Gao

Generative AI (GenAI) models excel in their ability to recognize patterns in existing data and generate new and unexpected content. Recent advances have motivated applications of GenAI tools (e.g., Stable Diffusion, ChatGPT) to professional…

Human-Computer Interaction · Computer Science 2023-06-05 Matthew K. Hong , Shabnam Hakimi , Yan-Ying Chen , Heishiro Toyoda , Charlene Wu , Matt Klenk

Generative adversarial networks (GANs) have achieved impressive results today, but not all generated images are perfect. A number of quantitative criteria have recently emerged for generative model, but none of them are designed for a…

Image and Video Processing · Electrical Eng. & Systems 2020-07-15 Shuyang Gu , Jianmin Bao , Dong Chen , Fang Wen

Generative image modeling techniques such as GAN demonstrate highly convincing image generation result. However, user interaction is often necessary to obtain the desired results. Existing attempts add interactivity but require either…

Graphics · Computer Science 2020-09-01 Toby Chong Long Hin , I-Chao Shen , Issei Sato , Takeo Igarashi

As generative artificial intelligence advances, Large Language Models (LLMs) are being explored for automated graphical user interface (GUI) design. This study investigates the usability and adaptability of LLM-generated interfaces by…

Human-Computer Interaction · Computer Science 2026-02-02 Bartosz Sawicki , Tomasz Les , Dariusz Parzych , Aleksandra Wycisk-Ficek , Pawel Trebacz , Pawel Zawadzki

Recent advancements in image generation models have enabled the prediction of future Graphical User Interface (GUI) states based on user instructions. However, existing benchmarks primarily focus on general domain visual fidelity, leaving…

We present a novel and effective approach for generating new clothing on a wearer through generative adversarial learning. Given an input image of a person and a sentence describing a different outfit, our model "redresses" the person as…

Computer Vision and Pattern Recognition · Computer Science 2017-10-23 Shizhan Zhu , Sanja Fidler , Raquel Urtasun , Dahua Lin , Chen Change Loy