中文
相关论文

相关论文: How Well Can LLMs Echo Us? Evaluating AI Chatbots'…

200 篇论文

The advent of Large Language Models (LLMs) has paved the way for complex tasks such as role-playing, which enhances user interactions by enabling models to imitate various characters. However, the closed-source nature of state-of-the-art…

In recent years, large language models (LLMs) have attracted attention due to their ability to generate human-like text. As surveys and opinion polls remain key tools for gauging public attitudes, there is increasing interest in assessing…

综合经济学 · 经济学 2025-02-12 Shapeng Jiang , Lijia Wei , Chen Zhang

The potential of artificial intelligence (AI)-based large language models (LLMs) holds considerable promise in revolutionizing education, research, and practice. However, distinguishing between human-written and AI-generated text has become…

计算与语言 · 计算机科学 2023-11-14 Kadhim Hayawi , Sakib Shahriar , Sujith Samuel Mathew

Large Language Models (LLMs) such as ChatGPT have shown remarkable abilities in producing human-like text. However, it is unclear how accurately these models internalize concepts that shape human thought and behavior. Here, we developed a…

机器学习 · 计算机科学 2025-07-01 Hiro Taiyo Hamada , Ippei Fujisawa , Genji Kawakita , Yuki Yamada

The deployment of large language models (LLMs) in diverse applications requires a thorough understanding of their decision-making strategies and behavioral patterns. As a supplement to a recent study on the behavioral Turing test, this…

人工智能 · 计算机科学 2024-12-18 Yutong Xie , Yiyao Liu , Zhuang Ma , Lin Shi , Xiyuan Wang , Walter Yuan , Matthew O. Jackson , Qiaozhu Mei

The introduction of ChatGPT has garnered widespread attention in both academic and industrial communities. ChatGPT is able to respond effectively to a wide range of human questions, providing fluent and comprehensive answers that…

计算与语言 · 计算机科学 2023-01-19 Biyang Guo , Xin Zhang , Ziyuan Wang , Minqi Jiang , Jinran Nie , Yuxuan Ding , Jianwei Yue , Yupeng Wu

Large Language Models (LLMs) have recently emerged, attracting considerable attention due to their ability to generate highly natural, human-like text. This study compares the latent community structures of LLM-generated text and…

计算与语言 · 计算机科学 2025-01-03 Mose Park , Yunjin Choi , Jong-June Jeon

Large Language Models (LLMs) are able to provide assistance on a wide range of information-seeking tasks. However, model outputs may be misleading, whether unintentionally or in cases of intentional deception. We investigate the ability of…

计算与语言 · 计算机科学 2024-07-17 Betty Li Hou , Kejian Shi , Jason Phang , James Aung , Steven Adler , Rosie Campbell

Large Language Models (LLMs),such as ChatGPT, are increasingly used in research, ranging from simple writing assistance to complex data annotation tasks. Recently, some research has suggested that LLMs may even be able to simulate human…

人工智能 · 计算机科学 2025-08-14 Sarah Schröder , Thekla Morgenroth , Ulrike Kuhl , Valerie Vaquet , Benjamin Paaßen

The Turing test examines whether AIs exhibit human-like behaviour in natural language conversations. The traditional setting limits each participant to one message at a time and requires constant human participation. This fails to reflect a…

计算与语言 · 计算机科学 2025-05-30 Weiqi Wu , Hongqiu Wu , Hai Zhao

Large Language Models (LLMs) have recently emerged as powerful tools for natural language generation, with applications spanning from content creation to social simulations. Their ability to mimic human interactions raises both…

计算与语言 · 计算机科学 2025-06-30 Daniele Cirulli , Giulio Cimini , Giovanni Palermo

Recent research has focused on examining Large Language Models' (LLMs) characteristics from a psychological standpoint, acknowledging the necessity of understanding their behavioral characteristics. The administration of personality tests…

计算与语言 · 计算机科学 2024-10-07 Jen-tse Huang , Wenxiang Jiao , Man Ho Lam , Eric John Li , Wenxuan Wang , Michael R. Lyu

Large Language Models (LLMs) offer new avenues to simulate online communities and social media. Potential applications range from testing the design of content recommendation algorithms to estimating the effects of content policies and…

We evaluate the effectiveness of Large Language Models (LLMs) in assessing essay quality, focusing on their alignment with human grading. More precisely, we evaluate ChatGPT and Llama in the Automated Essay Scoring (AES) task, a crucial…

计算与语言 · 计算机科学 2024-09-23 Anindita Kundu , Denilson Barbosa

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

计算与语言 · 计算机科学 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

The development of chatbots requires collecting a large number of human-chatbot dialogues to reflect the breadth of users' sociodemographic backgrounds and conversational goals. However, the resource requirements to conduct the respective…

计算与语言 · 计算机科学 2024-10-15 Hovhannes Tamoyan , Hendrik Schuff , Iryna Gurevych

Large Language Models (LLMs) are known for their remarkable ability to generate synthesized 'knowledge', such as text documents, music, images, etc. However, there is a huge gap between LLM's and human capabilities for understanding…

计算与语言 · 计算机科学 2024-08-14 Vladimir Cherkassky , Eng Hock Lee

Large language models (LLMs) are recognized as systems that closely mimic aspects of human intelligence. This capability has attracted attention from the social science community, who see the potential in leveraging LLMs to replace human…

计算机与社会 · 计算机科学 2025-03-04 Qiuejie Xie , Qiming Feng , Tianqi Zhang , Qingqiu Li , Linyi Yang , Yuejie Zhang , Rui Feng , Liang He , Shang Gao , Yue Zhang

We evaluated 4 systems (ELIZA, GPT-4o, LLaMa-3.1-405B, and GPT-4.5) in two randomised, controlled, and pre-registered Turing tests on independent populations. Participants had 5 minute conversations simultaneously with another human…

计算与语言 · 计算机科学 2025-04-01 Cameron R. Jones , Benjamin K. Bergen

Recent advancements have showcased the capabilities of Large Language Models like GPT4 and Llama2 in tasks such as summarization, translation, and content review. However, their widespread use raises concerns, particularly around the…

人工智能 · 计算机科学 2024-09-25 Tony Ma