English
Related papers

Related papers: Generative and Malleable User Interfaces with Gene…

200 papers

In software development, the raw requirements proposed by users are frequently incomplete, which impedes the complete implementation of application functionalities. With the emergence of large language models, recent methods with the…

Software Engineering · Computer Science 2024-11-11 Sai Zhang , Zhenchang Xing , Ronghui Guo , Fangzhou Xu , Lei Chen , Zhaoyuan Zhang , Xiaowang Zhang , Zhiyong Feng , Zhiqiang Zhuang

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore…

Human-Computer Interaction · Computer Science 2024-04-18 Faraz Faruqi , Yingtao Tian , Vrushank Phadnis , Varun Jampani , Stefanie Mueller

Generative Artificial Intelligence (AI) tools are increasingly deployed across social media platforms, yet their implications for user behavior and experience remain understudied, particularly regarding two critical dimensions: (1) how AI…

Human-Computer Interaction · Computer Science 2025-06-18 Anders Giovanni Møller , Daniel M. Romero , David Jurgens , Luca Maria Aiello

Generative Artificial Intelligence (GAI) has made outstanding strides in recent years, with a good-sized impact on software product management. Drawing on pertinent articles from 2016 to 2023, this systematic literature evaluation reveals…

Software Engineering · Computer Science 2023-06-08 Nishant A. Parikh

Despite being trained on vast amounts of data, most LLMs are unable to reliably generate well-designed UIs. Designer feedback is essential to improving performance on UI generation; however, we find that existing RLHF methods based on…

Human-Computer Interaction · Computer Science 2026-02-18 Jason Wu , Amanda Swearngin , Arun Krishna Vajjala , Alan Leung , Jeffrey Nichols , Titus Barik

Recent advances in generative AI have brought incredible breakthroughs in several areas, including medical imaging. These generative models have tremendous potential not only to help safely share medical data via synthetic datasets but also…

Many recommendation systems limit user inputs to text strings or behavior signals such as clicks and purchases, and system outputs to a list of products sorted by relevance. With the advent of generative AI, users have come to expect richer…

Although generative artificial intelligence (AI) is not new, recent technological breakthroughs have transformed its capabilities across many domains. These changes necessitate new attention from educators and specialized training within…

Human-Computer Interaction · Computer Science 2025-10-27 Maria J. Molina , Amy McGovern , Jhayron S. Perez-Carrasquilla , Xiaowen Li , Robin L. Tanamachi

Generative, ML-driven interactive systems have the potential to change how people interact with computers in creative processes - turning tools into co-creators. However, it is still unclear how we might achieve effective human-AI…

Human-Computer Interaction · Computer Science 2022-07-08 Frederic Gmeiner , Kenneth Holstein , Nikolas Martelaro

Generative artificial intelligence models learn probability distributions from data and produce novel samples that capture the salient properties of their training sets. Proteins are particularly attractive for such approaches given their…

Biomolecules · Quantitative Biology 2026-02-27 Filippo Stocco , Michele Garibbo , Noelia Ferruz

Recent advancements in generative models have unlocked the capabilities to render photo-realistic data in a controllable fashion. Trained on the real data, these generative models are capable of producing realistic samples with minimal to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Abhay Rawat , Shubham Dokania , Astitva Srivastava , Shuaib Ahmed , Haiwen Feng , Rahul Tallamraju

After the release of several widely adopted artificial intelligence (AI) literacy guidelines by 2021, the unprecedented rise of generative AI since 2023 has transformed the way we work and acquire information worldwide. Unlike traditional…

Human-Computer Interaction · Computer Science 2025-10-21 Chengzhi Zhang , Brian Magerko

Professional creative software has steep learning curves for novices due to complex interfaces, limited guidance, and unfamiliar terminology. To support educators and tool creators in addressing learner challenges, we introduce TaskLens, an…

Human-Computer Interaction · Computer Science 2026-04-28 Yimeng Liu , Misha Sra

Open data refers to data that is freely available for reuse. Although there has been rapid increase in availability of open data to public in the last decade, this has not translated into better decision-support tools for them. We propose…

Artificial Intelligence · Computer Science 2019-01-14 Biplav Srivastava

The development of high-dimensional generative models has recently gained a great surge of interest with the introduction of variational auto-encoders and generative adversarial neural networks. Different variants have been proposed where…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Mickaël Chen , Ludovic Denoyer , Thierry Artières

Generative Artificial Intelligence (Generative AI) is a collection of AI technologies that can generate new information such as texts and images. With its strong capabilities, Generative AI has been actively studied in creative design…

Human-Computer Interaction · Computer Science 2025-02-04 Liuging Chen , Yaxuan Song , Jia Guo , Lingyun Sun , Peter Childs , Yuan Yin

Generative models are a class of AI models capable of creating new instances of data by learning and sampling from their statistical distributions. In recent years, these models have gained prominence in machine learning due to the…

Generalization to unseen real-world scenarios for robot manipulation requires exposure to diverse datasets during training. However, collecting large real-world datasets is intractable due to high operational costs. For robot learning to…

Robotics · Computer Science 2024-09-04 Zoey Chen , Zhao Mandi , Homanga Bharadhwaj , Mohit Sharma , Shuran Song , Abhishek Gupta , Vikash Kumar

Designers rely on visual search to explore and develop ideas in early design stages. However, designers can struggle to identify suitable text queries to initiate a search or to discover images for similarity-based search that can…

Human-Computer Interaction · Computer Science 2024-03-05 Kihoon Son , DaEun Choi , Tae Soo Kim , Young-Ho Kim , Juho Kim

Graphical User Interface (or simply UI) is a primary mean of interaction between users and their devices. In this paper, we discuss three complementary Artificial Intelligence (AI) approaches for triggering the creativity of app designers…

Human-Computer Interaction · Computer Science 2025-01-29 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Gérard Dray , Walid Maalej