English
Related papers

Related papers: AI-Instruments: Embodying Prompts as Instruments t…

200 papers

People judge interactions with large language models (LLMs) as successful when outputs match what they want, not what they type. Yet LLMs are trained to predict the next token solely from text input, not underlying intent. Because written…

Computation and Language · Computer Science 2026-03-13 Nadav Kunievsky , James A. Evans

Generative AI shifts interaction toward intent-based outcome specification, despite user intents being inherently vague, fluid, and evolving. While a growing body of HCI research has proposed diverse interaction techniques to support this…

Human-Computer Interaction · Computer Science 2026-01-29 Yoonsu Kim , Kihoon Son , Seoyoung Kim , Brandon Chin , Juho Kim

The emerging field of AI-generated art has witnessed the rise of prompt marketplaces, where creators can purchase, sell, or share prompts to generate unique artworks. These marketplaces often assert ownership over prompts, claiming them as…

Cryptography and Security · Computer Science 2026-01-27 Khoi Trinh , Scott Seidenberger , Joseph Spracklen , Raveen Wijewickrama , Bimal Viswanath , Murtuza Jadliwala , Anindya Maiti

Prompts are how humans communicate with LLMs. Informative prompts are essential for guiding LLMs to produce the desired output. However, prompt engineering is often tedious and time-consuming, requiring significant expertise, limiting its…

Computation and Language · Computer Science 2024-08-09 Liat Ein-Dor , Orith Toledo-Ronen , Artem Spector , Shai Gretz , Lena Dankin , Alon Halfon , Yoav Katz , Noam Slonim

The groundbreaking capabilities of Large Language Models (LLMs) offer new opportunities for enhancing human-computer interaction through emotion-adaptive Artificial Intelligence (AI). However, deliberately controlling the sentiment in these…

Computation and Language · Computer Science 2026-02-09 Kerstin Sahler , Sophie Jentzsch

Meetings often suffer from a lack of intentionality, such as unclear goals and straying off-topic. Identifying goals and maintaining their clarity throughout a meeting is challenging, as discussions and uncertainties evolve. Yet meeting…

Human-Computer Interaction · Computer Science 2025-04-09 Xinyue Chen , Lev Tankelevitch , Rishi Vanukuru , Ava Elizabeth Scott , Payod Panda , Sean Rintel

Prompt engineering has emerged as a powerful technique for guiding large language models (LLMs) toward desired responses, significantly enhancing their performance across diverse tasks. Beyond their role as static predictors, LLMs…

Machine Learning · Computer Science 2025-03-27 Ryumei Nakada , Wenlong Ji , Tianxi Cai , James Zou , Linjun Zhang

Prompting-based user interfaces (UIs) shift the task of defining and accessing relevant functions from developers to users. However, how UIs shape this flexibility has not yet been investigated explicitly. We explored interaction with Large…

Human-Computer Interaction · Computer Science 2024-10-15 Florian Lehmann , Daniel Buschek

Generative AI systems have revolutionized human interaction by enabling natural language-based coding and problem solving. However, the inherent ambiguity of natural language often leads to imprecise instructions, forcing users to…

Artificial Intelligence · Computer Science 2025-07-02 Fabrizio Marozzo

Expressing design intent using natural language prompts requires designers to verbalize the ambiguous visual details concisely, which can be challenging or even impossible. To address this, we introduce Brickify, a visual-centric…

Human-Computer Interaction · Computer Science 2025-03-03 Xinyu Shi , Yinghou Wang , Ryan Rossi , Jian Zhao

AI illustrator aims to automatically design visually appealing images for books to provoke rich thoughts and emotions. To achieve this goal, we propose a framework for translating raw descriptions with complex semantics into semantically…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Yiyang Ma , Huan Yang , Bei Liu , Jianlong Fu , Jiaying Liu

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

Computation and Language · Computer Science 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

The abilities of Generative-Artificial Intelligence (AI) to produce real-time, sophisticated responses across diverse contexts has promised a huge potential in physics education, particularly in providing customized feedback. In this study,…

Physics Education · Physics 2025-08-14 Amogh Sirnoorkar , N. Sanjay Rebello

Current AI interaction models treat the prompt as the primary object of exchange, omitting a critical layer: the user's latent source intent, the goal state preceding and motivating the prompt. Here we introduce Intent Signal Theory (IST),…

Human-Computer Interaction · Computer Science 2026-05-26 Gang Peng

Studies of Generative AI (GenAI)-assisted creative workflows have focused on individuals overcoming challenges of prompting to produce what they envisioned. When designers work in teams, how do collaboration and prompting influence each…

Human-Computer Interaction · Computer Science 2025-09-29 Yuanning Han , Ziyi Qiu , Jiale Cheng , RAY LC

Generative AI tools, such as AI-generated hints, are increasingly integrated into programming education to offer timely, personalized support. However, little is known about how to effectively leverage these hints while ensuring autonomous…

Computers and Society · Computer Science 2025-12-05 Heeryung Choi , Tung Phung , Mengyan Wu , Adish Singla , Christopher Brooks

As AI tools such as ChatGPT enter programming classrooms, students encounter differing rules across courses and instructors, which shape how they use AI and leave them with unequal capabilities for leveraging it. We investigate how students…

Human-Computer Interaction · Computer Science 2026-04-14 Tianyu Shao , Miguel Feijóo-García , Yi Zhang , Hugo Castellanos , Tawfiq Salem , Alejandra Magana , Tianyi Li

With the growing capabilities of large language models (LLMs), they are increasingly applied in areas like intelligent customer service, code generation, and knowledge management. Natural language (NL) prompts act as the ``APIs'' for…

Software Engineering · Computer Science 2025-08-12 Zhenchang Xing , Yang Liu , Zhuo Cheng , Qing Huang , Dehai Zhao , Daniel Sun , Chenhua Liu

Text-based prompting remains the predominant interaction paradigm in generative AI, yet it often introduces friction for novice users such as small business owners (SBOs), who struggle to articulate creative goals in domain-specific…

Human-Computer Interaction · Computer Science 2025-04-23 Nimisha Karnatak , Adrien Baranes , Rob Marchant , Huinan Zeng , Tríona Butler , Kristen Olson

Explainable AI (XAI) interfaces seek to make large language models more transparent, yet explanation alone does not produce understanding. Explaining a system's behavior is not the same as being able to engage with it, to probe and…

Human-Computer Interaction · Computer Science 2026-03-18 Gabrielle Benabdallah