English
Related papers

Related papers: Jigsaw: Supporting Designers to Prototype Multimod…

200 papers

AI-based design tools are proliferating in professional software to assist engineering and industrial designers in complex manufacturing and design tasks. These tools take on more agentic roles than traditional computer-aided design tools…

Human-Computer Interaction · Computer Science 2023-03-02 Frederic Gmeiner , Humphrey Yang , Lining Yao , Kenneth Holstein , Nikolas Martelaro

Artificial Intelligence (AI) planning is a flourishing research and development discipline that provides powerful tools for searching a course of action that achieves some user goal. While these planning tools show excellent performance on…

Artificial Intelligence · Computer Science 2021-02-23 Sebastian Graef , Ilche Georgievski

We, as a society, need artists to help us interpret and explain science, but what does an artist's studio look like when today's science is built upon the language of large, increasingly complex data? This paper presents a data…

Human-Computer Interaction · Computer Science 2020-10-20 Bridger Herman , Francesca Samsel , Annie Bares , Seth Johnson , Greg Abram , Daniel F. Keefe

Humans often rely on underlying structural patterns-schemas-to create, whether by writing stories, designing software, or composing music. Schemas help organize ideas and guide exploration, but they are often difficult to discover and…

Human-Computer Interaction · Computer Science 2025-08-08 Sitong Wang

Character design in games involves interdisciplinary collaborations, typically between designers who create the narrative content, and illustrators who realize the design vision. However, traditional workflows face challenges in…

Human-Computer Interaction · Computer Science 2025-08-19 Long Ling , Xinyi Chen , Ruoyu Wen , Toby Jia-Jun Li , Ray LC

Design processes involve exploration, iteration, and movement across interconnected stages such as persona creation, problem framing, solution ideation, and prototyping. However, time and resource constraints often hinder designers from…

Human-Computer Interaction · Computer Science 2025-08-18 Sangho Suh , Michael Lai , Kevin Pu , Steven P. Dow , Tovi Grossman

Creative ideation relies on exploring diverse stimuli, but the overwhelming abundance of information often makes it difficult to identify valuable insights or reach the `aha' moment. Traditional methods for accessing design stimuli lack…

Human-Computer Interaction · Computer Science 2025-04-23 Yaqing Yang , Vikram Mohanty , Nikolas Martelaro , Aniket Kittur , Yan-Ying Chen , Matthew K. Hong

AI foundation models have the capability to produce a wide array of responses to a single prompt, a feature that is highly beneficial in software engineering to generate diverse code solutions. However, this advantage introduces a…

Software Engineering · Computer Science 2024-03-21 Scott Blyth , Markus Wagner , Christoph Treude

As designers become familiar with Generative AI, a new concept is emerging: Agentic AI. While generative AI produces output in response to prompts, agentic AI systems promise to perform mundane tasks autonomously, potentially freeing…

Human-Computer Interaction · Computer Science 2025-09-26 Samangi Wadinambiarachchi , Jenny Waycott , Yvonne Rogers , Greg Wadley

Foundation models can be disruptive for future AI development by scaling up deep learning in terms of model size and training data's breadth and size. These models achieve state-of-the-art performance (often through further adaptation) on a…

Artificial Intelligence · Computer Science 2022-12-20 Johannes Schneider

Artificial intelligence (AI) and machine learning (ML) are increasingly integrated into the functioning of physical and digital products, creating unprecedented opportunities for interaction and functionality. However, there is a challenge…

Human-Computer Interaction · Computer Science 2023-10-03 Dave Murray-Rust , Maria Luce Lupetti , Iohanna Nicenboim , Wouter van der Hoog

Jigsaw puzzle solving, the problem of constructing a coherent whole from a set of non-overlapping unordered visual fragments, is fundamental to numerous applications, and yet most of the literature of the last two decades has focused thus…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Peleg Harel Ofir Itzhak Shahar , Ohad Ben-Shahar

Generative Artificial Intelligence (Generative AI) holds significant promise in reshaping interactive systems design, yet its potential across the four key phases of human-centered design remains underexplored. This article addresses this…

Human-Computer Interaction · Computer Science 2024-11-06 Marie Muehlhaus , Jürgen Steimle

Traditional visualisation designers often start with sketches before implementation. With generative AI, these sketches can be turned into AI-generated visualisations using specific prompts. However, guiding AI to create compelling visuals…

Human-Computer Interaction · Computer Science 2024-09-04 Aron E. Owen , Jonathan C. Roberts

Jigsaw puzzle solving has been an increasingly popular task in the computer vision research community. Recent works have utilized cutting-edge architectures and computational approaches to reassemble groups of pieces into a coherent image,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Ofir Itzhak Shahar , Gur Elkin , Ohad Ben-Shahar

In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabilities in interpreting design intent and a lack of…

Human-Computer Interaction · Computer Science 2025-10-30 Mingyue Yuan , Jieshan Chen , Yongquan Hu , Sidong Feng , Mulong Xie , Gelareh Mohammadi , Zhenchang Xing , Aaron Quigley

Generative AI (GenAI) tools are radically expanding the scope and capability of automation in knowledge work such as academic research. While promising for augmenting cognition and streamlining processes, AI-assisted research tools may also…

Human-Computer Interaction · Computer Science 2025-04-22 Runlong Ye , Matthew Varona , Oliver Huang , Patrick Yung Kang Lee , Michael Liut , Carolina Nobre

Despite the widespread use of artificial intelligence (AI), designing user experiences (UX) for AI-powered systems remains challenging. UX designers face hurdles understanding AI technologies, such as pre-trained language models, as design…

Human-Computer Interaction · Computer Science 2023-02-22 Q. Vera Liao , Hariharan Subramonyam , Jennifer Wang , Jennifer Wortman Vaughan

Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-world settings such as negotiation, medical diagnosis, and criminal investigation. It serves as a fundamental methodology in the field of…

Thinking of technology as a design material is appealing. It encourages designers to explore the material's properties to understand its capabilities and limitations, a prerequisite to generative design thinking. However, as a material, AI…

Human-Computer Interaction · Computer Science 2021-05-07 Hariharan Subramonyam , Colleen Seifert , Eytan Adar