English
Related papers

Related papers: Misty: UI Prototyping Through Interactive Conceptu…

200 papers

Researchers have been highly active to investigate the classical machine learning workflow and integrate best practices from the software engineering lifecycle. However, deep learning exhibits deviations that are not yet covered in this…

Software Engineering · Computer Science 2022-08-30 Janosch Baltensperger , Pasquale Salza , Harald C. Gall

Diffusion models have dramatically advanced text-to-image generation in recent years, translating abstract concepts into high-fidelity images with remarkable ease. In this work, we examine whether they can also blend distinct concepts,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Lorenzo Olearo , Giorgio Longari , Alessandro Raganato , Rafael Peñaloza , Simone Melzi

Designing user interfaces (UIs) is a critical step when launching products, building portfolios, or personalizing projects, yet end users without design expertise often struggle to articulate their intent and to trust design choices.…

Human-Computer Interaction · Computer Science 2026-01-29 Junling Wang , Hongyi Lan , Xiaotian Su , Mustafa Doga Dogan , April Yi Wang

Increased popularity of `intelligent' web services provides end-users with machine-learnt functionality at little effort to developers. However, these services require a decision threshold to be set which is dependent on problem-specific…

Software Engineering · Computer Science 2020-08-20 Alex Cummaudo , Scott Barnett , Rajesh Vasa , John Grundy

Professional creative software has steep learning curves for novices due to complex interfaces, limited guidance, and unfamiliar terminology. To support educators and tool creators in addressing learner challenges, we introduce TaskLens, an…

Human-Computer Interaction · Computer Science 2026-04-28 Yimeng Liu , Misha Sra

Professional designers work from client briefs that specify goals and constraints but often lack concrete design details. Translating these abstract requirements into visual designs poses a central challenge, yet existing tools address…

Human-Computer Interaction · Computer Science 2026-04-14 Kotaro Kikuchi , Nami Ogawa

Highly interactive development environments (HIDEs) enable uninterrupted development flow through continuous program evolution and rapid hypothesis checking. However, traditional testing approaches -- typically executed separately via CLI…

Software Engineering · Computer Science 2025-08-05 Andrew Tropin

Problems in modeling and simulation require significantly different workflow management technologies than standard grid-based workflow management systems. Computational scientists typically interact with simulation software in a feedback…

The emergence of Generative AI is catalyzing a paradigm shift in user interfaces from command-based to intent-based outcome specification. In this paper, we explore abstract-to-detailed task transitions in the context of frontend code…

Human-Computer Interaction · Computer Science 2024-08-05 Qinshi Zhang , Latisha Besariani Hendra , Mohan Chi , Zijian Ding

Expertise is often built by learning from examples. This process, known as schema induction, helps us identify patterns from examples. Despite its importance, schema induction remains a challenging cognitive task. Recent advances in…

Human-Computer Interaction · Computer Science 2025-02-24 Sitong Wang , Lydia B. Chilton

Results from a triple-blind mixed-method user study into the effectiveness of mixed-initiative tools for the procedural generation of game levels are presented. A tool which generates levels using interactive evolutionary optimisation was…

Neural and Evolutionary Computing · Computer Science 2021-06-03 Sean P. Walton , Alma A. M. Rahat , James Stovold

GUI (graphical user interface) prototyping is a widely-used technique in requirements engineering for gathering and refining requirements, reducing development risks and increasing stakeholder engagement. However, GUI prototyping can be a…

Software Engineering · Computer Science 2023-10-05 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Binbin Xu , Pierre Louis Bernard , Gérard Dray

Capturing professionals' decision-making in creative workflows (e.g., UI/UX) is essential for reflection, collaboration, and knowledge sharing, yet existing methods often leave rationales incomplete and implicit decisions hidden. To address…

Human-Computer Interaction · Computer Science 2026-02-26 Kihoon Son , DaEun Choi , Tae Soo Kim , Young-Ho Kim , Sangdoo Yun , Juho Kim

We present how to integrate Design Sprints and project-based learning into introductory visualization courses. A design sprint is a unique process based on rapid prototyping and user testing to define goals and validate ideas before…

Human-Computer Interaction · Computer Science 2021-10-01 Johanna Beyer , Yalong Yang , Hanspeter Pfister

Interfaces for machine learning (ML), information and visualizations about models or data, can help practitioners build robust and responsible ML systems. Despite their benefits, recent studies of ML teams and our interviews with…

Human-Computer Interaction · Computer Science 2022-02-21 Alex Bäuerle , Ángel Alexander Cabrera , Fred Hohman , Megan Maher , David Koski , Xavier Suau , Titus Barik , Dominik Moritz

User Interface (UI) prototyping is a necessary step in the early stages of application development. Transforming sketches of a Graphical User Interface (UI) into a coded UI application is an uninspired but time-consuming task performed by a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Vanita Jain , Piyush Agrawal , Subham Banga , Rishabh Kapoor , Shashwat Gulyani

Hybrid work, a fusion of different work environments that allow employees to work in and outside their offices, represents a new frontier for agile researchers to explore. However, due to the nascent nature of the research phenomena, we are…

Software Engineering · Computer Science 2024-04-16 Dron Khanna , Emily Laue Christensen , Saagarika Gosu , Xiaofeng Wang , Maria Paasivaara

User Interface (UI) design is an creative process that involves considerable reiteration and rework. Designers go through multiple iterations of different prototyping fidelities to create a UI design. In this research, we propose to modify…

Human-Computer Interaction · Computer Science 2020-04-08 Vinoth Pandian Sermuga Pandian , Sarah Suleri

Design processes involve exploration, iteration, and movement across interconnected stages such as persona creation, problem framing, solution ideation, and prototyping. However, time and resource constraints often hinder designers from…

Human-Computer Interaction · Computer Science 2025-08-18 Sangho Suh , Michael Lai , Kevin Pu , Steven P. Dow , Tovi Grossman

Generative UI is transforming interface design by facilitating AI-driven collaborative workflows between designers and computational systems. This study establishes a working definition of Generative UI through a multi-method qualitative…

Human-Computer Interaction · Computer Science 2025-05-22 Kyungho Lee