English
Related papers

Related papers: Interaction Context Often Increases Sycophancy in …

200 papers

Large language models (LLMs) enable conversational agents (CAs) to express distinctive personalities, raising new questions about how such designs shape user perceptions. This study investigates how personality expression levels and…

Human-Computer Interaction · Computer Science 2026-04-30 Hasibur Rahman , Smit Desai

This position paper argues that effective tutoring requires corrective friction: surfacing misconceptions and challenging them supportively to drive conceptual change. Yet preference-aligned LLMs can trade epistemic rigor for agreeableness.…

Artificial Intelligence · Computer Science 2026-05-15 Enkelejda Kasneci , Gjergji Kasneci

Large language models (LMs) such as GPT-3 have the surprising ability to do in-context learning, where the model learns to do a downstream task simply by conditioning on a prompt consisting of input-output examples. The LM learns from these…

Computation and Language · Computer Science 2022-07-22 Sang Michael Xie , Aditi Raghunathan , Percy Liang , Tengyu Ma

Rapid improvements in large language models have unveiled a critical challenge in human-AI interaction: sycophancy. In this context, sycophancy refers to the tendency of models to excessively agree with or flatter users, often at the…

Computation and Language · Computer Science 2025-03-18 Joshua Liu , Aarav Jain , Soham Takuri , Srihan Vege , Aslihan Akalin , Kevin Zhu , Sean O'Brien , Vasu Sharma

Online scams often unfold gradually through interaction, yet existing detection systems predominantly rely on snapshot-based signals and interruptive warnings, revealing two research gaps in the lack of signals that represent scam risk…

Human-Computer Interaction · Computer Science 2026-04-28 Zhenyu Mao , Jacky Keung , Xiangyu Li , Yicheng Sun , Kehui Chen , Jingyu Zhang , Jialong Li

The dominant metaphor of LLMs-as-minds leads to misleading conceptions of machine agency and is limited in its ability to help both users and developers build the right degree of trust and understanding for outputs from LLMs. It makes it…

Human-Computer Interaction · Computer Science 2025-04-15 Diana Robinson , Neil Lawrence

While auxiliary information has become a key to enhancing Large Language Models (LLMs), relatively little is known about how LLMs merge these contexts, specifically contexts generated by LLMs and those retrieved from external sources. To…

Computation and Language · Computer Science 2024-06-13 Hexiang Tan , Fei Sun , Wanli Yang , Yuanzhuo Wang , Qi Cao , Xueqi Cheng

Conventional Voice Assistants (VAs) rely on traditional language models to discern user intent and respond to their queries, leading to interactions that often lack a broader contextual understanding, an area in which Large Language Models…

Human-Computer Interaction · Computer Science 2024-12-02 Amama Mahmood , Junxiang Wang , Bingsheng Yao , Dakuo Wang , Chien-Ming Huang

The widespread availability of Large Language Models (LLMs) within Integrated Development Environments (IDEs) has led to their speedy adoption. Conversational interactions with LLMs enable programmers to obtain natural language explanations…

Human-Computer Interaction · Computer Science 2024-02-12 Bhavya Chopra , Yasharth Bajpai , Param Biyani , Gustavo Soares , Arjun Radhakrishna , Chris Parnin , Sumit Gulwani

This study investigates the behaviors of Large Language Models (LLMs) when faced with conflicting prompts versus their internal memory. This will not only help to understand LLMs' decision mechanism but also benefit real-world applications,…

Computation and Language · Computer Science 2024-02-21 Jiahao Ying , Yixin Cao , Kai Xiong , Yidong He , Long Cui , Yongbin Liu

The emergence of Large Language Models (LLMs) has revealed a growing need for human-AI collaboration, especially in creative decision-making scenarios where trust and reliance are paramount. Through human studies and model evaluations on…

Computation and Language · Computer Science 2024-10-07 Manasi Sharma , Ho Chit Siu , Rohan Paleja , Jaime D. Peña

We introduce a multi-turn benchmark for evaluating personalised alignment in LLM-based AI assistants, focusing on their ability to handle user-provided safety-critical contexts. Our assessment of ten leading models across five scenarios…

Human-Computer Interaction · Computer Science 2025-01-31 Lize Alberts , Benjamin Ellis , Andrei Lupu , Jakob Foerster

Large language models (LLMs) are increasingly shaping creative work and problem-solving; however, prior research suggests that they may diminish unassisted creativity. To address this tension, a coach-like LLM environment was developed that…

Human-Computer Interaction · Computer Science 2025-10-31 Alon Rosenbaum , Yigal David , Eran Kaufman , Gilad Ravid , Amit Ronen , Assaf Krebs

User interactions with LLMs are shaped by prior experiences and individual exploration, but in-lab studies do not provide system designers with visibility into these in-the-wild factors. This work explores a new approach to studying…

Human-Computer Interaction · Computer Science 2026-05-08 Shengqi Zhu , Jeffrey M. Rzeszotarski , David Mimno

Large Language Models (LLMs) are increasingly deployed for personalized product recommendations, with practitioners commonly assuming that longer user purchase histories lead to better predictions. We challenge this assumption through a…

Information Retrieval · Computer Science 2026-01-29 Kargi Chauhan , Mahalakshmi Venkateswarlu

As large language models (LLMs) are increasingly integrated into multi-agent and human-AI systems, understanding their awareness of both self-context and conversational partners is essential for ensuring reliable performance and robust…

Computation and Language · Computer Science 2025-08-29 Younwoo Choi , Changling Li , Yongjin Yang , Zhijing Jin

The conformity effect describes the tendency of individuals to align their responses with the majority. Studying this bias in large language models (LLMs) is crucial, as LLMs are increasingly used in various information-seeking and…

Computation and Language · Computer Science 2025-05-27 Xiaochen Zhu , Caiqi Zhang , Tom Stafford , Nigel Collier , Andreas Vlachos

People judge interactions with large language models (LLMs) as successful when outputs match what they want, not what they type. Yet LLMs are trained to predict the next token solely from text input, not underlying intent. Because written…

Computation and Language · Computer Science 2026-03-13 Nadav Kunievsky , James A. Evans

Large Language Models (LLMs) excel at producing broadly relevant text, but this generality becomes a limitation when user-specific preferences are required, such as recommending restaurants or planning travel. In these scenarios, users…

Machine Learning · Computer Science 2025-10-21 Ioannis Tsaknakis , Bingqing Song , Shuyu Gan , Dongyeop Kang , Alfredo Garcia , Gaowen Liu , Charles Fleming , Mingyi Hong

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang