中文
相关论文

相关论文: Is Length Really A Liability? An Evaluation of Mul…

200 篇论文

Large Language Models (LLMs) should answer factual questions truthfully, grounded in objective knowledge, regardless of user context such as self-disclosed personal information, or system personalization. In this paper, we present the first…

计算与语言 · 计算机科学 2025-10-16 Nil-Jana Akpinar , Chia-Jung Lee , Vanessa Murdock , Pietro Perona

Large Language Models (LLMs) have revolutionized conversational AI, yet their robustness in extended multi-turn dialogues remains poorly understood. Existing evaluation frameworks focus on static benchmarks and single-turn assessments,…

计算与语言 · 计算机科学 2026-02-05 Yubo Li , Ramayya Krishnan , Rema Padman

As large language models (LLMs) are increasingly deployed in multi-turn dialogue and other sustained interactive scenarios, it is essential to understand how extended context affects their performance. Popular benchmarks, focusing primarily…

计算与语言 · 计算机科学 2025-06-03 Robert Hankache , Kingsley Nketia Acheampong , Liang Song , Marek Brynda , Raad Khraishi , Greig A. Cowan

Large Language Models (LLMs) have been evaluated using diverse question types, e.g., multiple-choice, true/false, and short/long answers. This study answers an unexplored question about the impact of different question types on LLM accuracy…

计算与语言 · 计算机科学 2026-04-29 Seok Hwan Song , Mohna Chakraborty , Qi Li , Wallapak Tavanapong

Large Language Models (\textbf{LLMs}), e.g. ChatGPT, have been widely adopted in real-world dialogue applications. However, LLMs' robustness, especially in handling long complex dialogue sessions, including frequent motivation transfer,…

计算与语言 · 计算机科学 2025-09-16 Chenghao Yang , Yinbo Luo , Zhoufutu Wen , Qi Chu , Tao Gong , Longxiang Liu , Kaiyuan Zhang , Jianpeng Jiao , Ge Zhang , Wenhao Huang , Nenghai Yu

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

计算与语言 · 计算机科学 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Users can discuss a wide range of topics with large language models (LLMs), but they do not always prefer solving problems or getting information through lengthy conversations. This raises an intriguing HCI question: How does instructing…

人机交互 · 计算机科学 2024-04-29 Shih-Hong Huang , Ya-Fang Lin , Zeyu He , Chieh-Yang Huang , Ting-Hao 'Kenneth' Huang

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to…

计算与语言 · 计算机科学 2026-02-06 Yang Xu , Xuanming Zhang , Samuel Yeh , Jwala Dhamala , Ousmane Dia , Rahul Gupta , Sharon Li

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

计算与语言 · 计算机科学 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Large Language Models (LLMs) often exhibit sycophancy, distorting responses to align with user beliefs, notably by readily agreeing with user counterarguments. Paradoxically, LLMs are increasingly adopted as successful evaluative agents for…

计算与语言 · 计算机科学 2025-09-23 Sungwon Kim , Daniel Khashabi

Large language models (LLMs) exhibiting test-time scaling behavior, such as extended reasoning traces and self-verification, have demonstrated remarkable performance on complex, long-term reasoning tasks. However, the robustness of these…

机器学习 · 计算机科学 2026-04-02 Gleb Rodionov

Robust verbal confidence generated by large language models (LLMs) is crucial for the deployment of LLMs to help ensure transparency, trust, and safety in many applications, including those involving human-AI interactions. In this paper, we…

计算与语言 · 计算机科学 2025-12-19 Stephen Obadinma , Xiaodan Zhu

Large language models (LLMs) have become common decision-support tools across educational and professional contexts, raising questions about how their outputs shape human critical thinking. Prior work suggests that the amount of AI…

Large Language Models (LLMs) interact with millions of people worldwide in applications such as customer support, education and healthcare. However, their ability to produce deceptive outputs, whether intentionally or inadvertently, poses…

计算与语言 · 计算机科学 2025-10-17 Marwa Abdulhai , Ryan Cheng , Aryansh Shrivastava , Natasha Jaques , Yarin Gal , Sergey Levine

This study examines how user-provided suggestions affect Large Language Models (LLMs) in a simulated educational context, where sycophancy poses significant risks. Testing five different LLMs from the OpenAI GPT-4o and GPT-4.1 model classes…

计算与语言 · 计算机科学 2025-06-13 Chuck Arvin

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex cognitive tasks. However, their complexity and lack of transparency have raised several trustworthiness concerns, including the propagation of…

机器学习 · 计算机科学 2023-11-07 Satyapriya Krishna

Large Language Models (LLMs) generate text token-by-token in discrete time, yet real-world communication, from therapy sessions to business negotiations, critically depends on continuous time constraints. Current LLM architectures and…

人工智能 · 计算机科学 2026-01-21 Neil K. R. Sehgal , Sharath Chandra Guntuku , Lyle Ungar

Multi-round incomplete information tasks are crucial for evaluating the lateral thinking capabilities of large language models (LLMs). Currently, research primarily relies on multiple benchmarks and automated evaluation metrics to assess…

计算与语言 · 计算机科学 2025-06-02 Wenhan Dong , Tianyi Hu , Jingyi Zheng , Zhen Sun , Yuemeng Zhao , Yule Liu , Xinlei He , Xinyi Huang

Large Language Models (LLMs) have been demonstrated to generate illegal or unethical responses, particularly when subjected to "jailbreak." Research on jailbreak has highlighted the safety issues of LLMs. However, prior studies have…

计算与语言 · 计算机科学 2024-10-31 Zhenhong Zhou , Jiuyang Xiang , Haopeng Chen , Quan Liu , Zherui Li , Sen Su

Power differences shape human communication through well documented socio cognitive effects, including language coordination, pronoun usage, authority bias, and harmful compliance. We examine whether large language models (LLMs) exhibit…

计算与语言 · 计算机科学 2026-05-21 Anvesh Rao Vijjini , Sagar Manjunath , Snigdha Chaturvedi