中文
相关论文

相关论文: How Different AI Chatbots Behave? Benchmarking Lar…

200 篇论文

While large language models (LLMs) have demonstrated remarkable capabilities in understanding human languages, this study explores how they translate this understanding into social exchange contexts that capture certain essences of real…

计算与语言 · 计算机科学 2025-05-26 Ou Jiamin , Eikmans Emile , Buskens Vincent , Pankowska Paulina , Shan Yuli

Recent advances in large language models (LLMs) have enabled their use in complex agentic roles, involving decision-making with humans or other agents, making ethical alignment a key AI safety concern. While prior work has examined both…

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

计算与语言 · 计算机科学 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

Behavioral testing in NLP allows fine-grained evaluation of systems by examining their linguistic capabilities through the analysis of input-output behavior. Unfortunately, existing work on behavioral testing in Machine Translation (MT) is…

计算与语言 · 计算机科学 2023-11-06 Javier Ferrando , Matthias Sperber , Hendra Setiawan , Dominic Telaar , Saša Hasan

Machines driven by large language models (LLMs) have the potential to augment humans across various tasks, a development with profound implications for business settings where effective communication, collaboration, and stakeholder trust…

人机交互 · 计算机科学 2025-07-28 Paweł Niszczota , Tomasz Grzegorczyk , Alexander Pastukhov

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

计算与语言 · 计算机科学 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

It has been established in recent work that Large Language Models (LLMs) can be prompted to "self-play" conversational games that probe certain capabilities (general instruction following, strategic goal orientation, language understanding…

计算与语言 · 计算机科学 2024-06-03 Anne Beyer , Kranti Chalamalasetti , Sherzod Hakimov , Brielen Madureira , Philipp Sadler , David Schlangen

Large-language models (LLMs) hold significant promise in improving human-robot interaction, offering advanced conversational skills and versatility in managing diverse, open-ended user requests in various tasks and domains. Despite the…

机器人学 · 计算机科学 2024-01-09 Callie Y. Kim , Christine P. Lee , Bilge Mutlu

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs…

计算与语言 · 计算机科学 2023-10-10 Thilo Hagendorff , Sarah Fabi , Michal Kosinski

The strategic significance of Large Language Models (LLMs) in economic expansion, innovation, societal development, and national security has been increasingly recognized since the advent of ChatGPT. This study provides a comprehensive…

计算与语言 · 计算机科学 2024-05-22 Zhenhui Jiang , Jiaxin Li , Yang Liu

Large language models (LLMs) are increasingly used in the social sciences to simulate human behavior, based on the assumption that they can generate realistic, human-like text. Yet this assumption remains largely untested. Existing…

计算与语言 · 计算机科学 2025-11-26 Nicolò Pagan , Petter Törnberg , Christopher A. Bail , Anikó Hannák , Christopher Barrie

As large language models (LLMs) increasingly engage in complex social interactions, ensuring that their behaviors align with human ethical principles and intentions, known as value alignment, has become a critical scientific challenge.…

计算工程、金融与科学 · 计算机科学 2026-05-29 Yu Lei , Hao Liu , Chengxing Xie , Songjia Liu , Zhiyu Yin , Canyu Chen , Guohao Li , Philip Torr , Zhen Wu

Large language models are increasingly used in decision-making tasks that require them to process information from a variety of sources, including both human experts and other algorithmic agents. How do LLMs weigh the information provided…

人工智能 · 计算机科学 2026-02-26 Jessica Y. Bo , Lillio Mok , Ashton Anderson

The role-play ability of Large Language Models (LLMs) has emerged as a popular research direction. However, existing studies focus on imitating well-known public figures or fictional characters, overlooking the potential for simulating…

计算与语言 · 计算机科学 2024-04-23 Man Tik Ng , Hui Tung Tse , Jen-tse Huang , Jingjing Li , Wenxuan Wang , Michael R. Lyu

In this paper, we explore the potential of Large Language Models (LLMs) Agents in playing the strategic social deduction game, Resistance Avalon. Players in Avalon are challenged not only to make informed decisions based on dynamically…

人工智能 · 计算机科学 2023-11-09 Jonathan Light , Min Cai , Sheng Shen , Ziniu Hu

While artificial intelligence (AI) technology is becoming increasingly popular, its underlying mechanisms tend to remain opaque to most people. To address this gap, the field of AI literacy aims to develop various resources to teach people…

计算机与社会 · 计算机科学 2026-03-31 Allison Chen , Isabella Pu

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

计算与语言 · 计算机科学 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Large language model (LLM) powered chatbots are primarily text-based today, and impose a large interactional cognitive load, especially for exploratory or sensemaking tasks such as planning a trip or learning about a new city. Because the…

人机交互 · 计算机科学 2023-12-04 Xiao Ma , Swaroop Mishra , Ariel Liu , Sophie Su , Jilin Chen , Chinmay Kulkarni , Heng-Tze Cheng , Quoc Le , Ed Chi

Providing scaffolding through educational chatbots built on Large Language Models (LLM) has potential risks and benefits that remain an open area of research. When students navigate impasses, they ask for help by formulating impasse-driven…

人机交互 · 计算机科学 2026-02-23 Alexandra Neagu , Marcus Messer , Peter Johnson , Rhodri Nelson

As large language models (LLMs) become increasingly integrated into society, their alignment with human morals is crucial. To better understand this alignment, we created a large corpus of human- and LLM-generated responses to various moral…

人机交互 · 计算机科学 2024-10-11 Basile Garcia , Crystal Qian , Stefano Palminteri