English
Related papers

Related papers: GenComUI: Exploring Generative Visual Aids as Medi…

200 papers

Large Language Models have been increasingly employed in the creation of Virtual Assistants due to their ability to generate human-like text and handle complex inquiries. While these models hold great promise, challenges such as…

Computation and Language · Computer Science 2026-04-30 Dumitru Verşebeniuc , Martijn Elands , Sara Falahatkar , Chiara Magrone , Mohammad Falah , Martijn Boussé , Aki Härmä

Generative models trained on internet data have revolutionized how text, image, and video content can be created. Perhaps the next milestone for generative models is to simulate realistic experience in response to actions taken by humans,…

Artificial Intelligence · Computer Science 2024-09-27 Sherry Yang , Yilun Du , Kamyar Ghasemipour , Jonathan Tompson , Leslie Kaelbling , Dale Schuurmans , Pieter Abbeel

Generative Artificial Intelligence (Generative AI) holds significant promise in reshaping interactive systems design, yet its potential across the four key phases of human-centered design remains underexplored. This article addresses this…

Human-Computer Interaction · Computer Science 2024-11-06 Marie Muehlhaus , Jürgen Steimle

In the field of Human-Computer Interaction (HCI), interactive devices with embedded mechanical computation are gaining attention. The rise of these cutting-edge devices has created a need for specialized design tools that democratize the…

Human-Computer Interaction · Computer Science 2024-10-31 Qiuyu Lu , Jiawei Fang , Zhihao Yao , Yue Yang , Shiqing Lyu , Haipeng Mi , Lining Yao

People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI…

Human-Computer Interaction · Computer Science 2024-07-15 Jingyi Xie , Rui Yu , He Zhang , Sooyeon Lee , Syed Masum Billah , John M. Carroll

Visual blends combine elements from two distinct visual concepts into a single, integrated image, with the goal of conveying ideas through imaginative and often thought-provoking visuals. Communicating abstract concepts through visual…

Human-Computer Interaction · Computer Science 2025-02-25 Zhida Sun , Zhenyao Zhang , Yue Zhang , Min Lu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

The rapid development of generative AI (GenAI) models in computer vision necessitates effective evaluation methods to ensure their quality and fairness. Existing tools primarily focus on dataset quality assurance and model explainability,…

Human-Computer Interaction · Computer Science 2024-02-07 Tica Lin , Hanspeter Pfister , Jui-Hsien Wang

Believable proxies of human behavior can empower interactive applications ranging from immersive environments to rehearsal spaces for interpersonal communication to prototyping tools. In this paper, we introduce generative…

Human-Computer Interaction · Computer Science 2023-08-08 Joon Sung Park , Joseph C. O'Brien , Carrie J. Cai , Meredith Ringel Morris , Percy Liang , Michael S. Bernstein

Evaluating the surroundings to gain understanding, frame perspectives, and anticipate behavioral reactions is an inherent human trait. However, these continuous encounters are diverse and complex, posing challenges to their study and…

Computers and Society · Computer Science 2026-02-26 Deepank Verma , Olaf Mumm , Vanessa Miriam Carlow

Conversational generative vision models (CGVMs) like Visual ChatGPT (Wu et al., 2023) have recently emerged from the synthesis of computer vision and natural language processing techniques. These models enable more natural and interactive…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Narjes Nikzad Khasmakhi , Meysam Asgari-Chenaghlu , Nabiha Asghar , Philipp Schaer , Dietlind Zühlke

With the rise of AI-powered coding assistants, firms and programmers are exploring how to optimize their interaction with them. Research has so far mainly focused on evaluating output quality and productivity gains, leaving aside the…

Human-Computer Interaction · Computer Science 2025-12-24 Charlotte Brandebusemeyer , Tobias Schimmer , Bert Arnrich

Generative AI is transforming image synthesis, enabling the creation of high-quality, diverse, and photorealistic visuals across industries like design, media, healthcare, and autonomous systems. Advances in techniques such as…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Fouad Bousetouane

Prior work on training generative Visual Dialog models with reinforcement learning(Das et al.) has explored a Qbot-Abot image-guessing game and shown that this 'self-talk' approach can lead to improved performance at the downstream…

Machine Learning · Computer Science 2019-10-04 Vishvak Murahari , Prithvijit Chattopadhyay , Dhruv Batra , Devi Parikh , Abhishek Das

Generative UI is transforming interface design by facilitating AI-driven collaborative workflows between designers and computational systems. This study establishes a working definition of Generative UI through a multi-method qualitative…

Human-Computer Interaction · Computer Science 2025-05-22 Kyungho Lee

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

As artificial intelligence (AI) continues to evolve from a back-end computational tool into an interactive, generative collaborator, its integration into early-stage design processes demands a rethinking of traditional workflows in…

Human-Computer Interaction · Computer Science 2025-07-25 Zhangqi Liu

Semantic communication (SemCom) is expected to be a core paradigm in future communication networks, yielding significant benefits in terms of spectrum resource saving and information interaction efficiency. However, the existing SemCom…

Networking and Internet Architecture · Computer Science 2024-10-29 Le Xia , Yao Sun , Chengsi Liang , Lei Zhang , Muhammad Ali Imran , Dusit Niyato

As generative AI (GenAI) increasingly permeates design workflows, its impact on design outcomes and designers' creative capabilities warrants investigation. We conducted a within-subjects experiment where we asked participants to design…

Human-Computer Interaction · Computer Science 2024-11-04 Yue Fu , Han Bin , Tony Zhou , Marx Wang , Yixin Chen , Zelia Gomes Da Costa Lai , Jacob O. Wobbrock , Alexis Hiniker

Generative Artificial Intelligence (GenAI) is transforming Human-Computer Interaction (HCI) education and technology design, yet its impact remains poorly understood. This study explores how graduate students in an applied HCI course used…

Human-Computer Interaction · Computer Science 2025-04-28 Hauke Sandhaus , Quiquan Gu , Maria Teresa Parreira , Wendy Ju

Self-adaptive systems (SASs) are designed to handle changes and uncertainties through a feedback loop with four core functionalities: monitoring, analyzing, planning, and execution. Recently, generative artificial intelligence (GenAI),…

Software Engineering · Computer Science 2025-12-05 Jialong Li , Mingyue Zhang , Nianyu Li , Danny Weyns , Zhi Jin , Kenji Tei