中文
相关论文

相关论文: Do Large Language Models Judge Error Severity Like…

200 篇论文

Large language models (LLMs) are increasingly used as epistemic partners in everyday reasoning, yet their errors remain predominantly analyzed through predictive metrics rather than through their interpretive effects on human judgment. This…

Large Language Models (LLMs) are recruited in applications that span from clinical assistance and legal support to question answering and education. Their success in specialized tasks has led to the claim that they possess human-like…

计算与语言 · 计算机科学 2024-07-10 Vittoria Dentella , Fritz Guenther , Elliot Murphy , Gary Marcus , Evelina Leivada

Language models often misinterpret human intentions due to their handling of ambiguity, a limitation well-recognized in NLP research. While morally clear scenarios are more discernible to LLMs, greater difficulty is encountered in morally…

计算与语言 · 计算机科学 2024-10-11 Pranav Senthilkumar , Visshwa Balasubramanian , Prisha Jain , Aneesa Maity , Jonathan Lu , Kevin Zhu

Large Language Models (LLMs) represent a major step toward artificial general intelligence, significantly advancing our ability to interact with technology. While LLMs perform well on Natural Language Processing tasks -- such as…

计算与语言 · 计算机科学 2025-05-15 Brandon Smith , Mohamed Reda Bouadjenek , Tahsin Alamgir Kheya , Phillip Dawson , Sunil Aryal

Unlocking the potential of Large Language Models (LLMs) in data classification represents a promising frontier in natural language processing. In this work, we evaluate the performance of different LLMs in comparison with state-of-the-art…

计算与语言 · 计算机科学 2025-01-16 Arina Kostina , Marios D. Dikaiakos , Dimosthenis Stefanidis , George Pallis

Artificial Intelligence (AI) is increasingly being integrated into scientific research, particularly in the social sciences, where understanding human behavior is critical. Large Language Models (LLMs) have shown promise in replicating…

计算与语言 · 计算机科学 2025-06-23 Ziyan Cui , Ning Li , Huaikang Zhou

Large Language Models (LLMs) have recently displayed their extraordinary capabilities in language understanding. However, how to comprehensively assess the sentiment capabilities of LLMs continues to be a challenge. This paper investigates…

计算与语言 · 计算机科学 2025-02-17 Yang Liu , Xichou Zhu , Zhou Shen , Yi Liu , Min Li , Yujun Chen , Benzi John , Zhenzhen Ma , Tao Hu , Zhi Li , Zhiyang Xu , Wei Luo , Junhui Wang

Understanding the limits of language is a prerequisite for Large Language Models (LLMs) to act as theories of natural language. LLM performance in some language tasks presents both quantitative and qualitative differences from that of…

计算与语言 · 计算机科学 2025-06-30 Vittoria Dentella , Fritz Guenther , Evelina Leivada

The advancing fluency of LLMs raises important questions about their ability to emulate complex human traits, including emotional expression and personality, across diverse linguistic and cultural contexts. This study investigates whether…

计算与语言 · 计算机科学 2026-03-25 Nasser A Alsadhan

Understanding how humans conceptualize and categorize natural objects offers critical insights into perception and cognition. With the advent of Large Language Models (LLMs), a key question arises: can these models develop human-like object…

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

软件工程 · 计算机科学 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

The zero-shot capability of Large Language Models (LLMs) has enabled highly flexible, reference-free metrics for various tasks, making LLM evaluators common tools in NLP. However, the robustness of these LLM evaluators remains relatively…

计算与语言 · 计算机科学 2024-05-06 Rickard Stureborg , Dimitris Alikaniotis , Yoshi Suhara

Psychometric tests are increasingly used to assess psychological constructs in large language models (LLMs). However, it remains unclear whether these tests -- originally developed for humans -- yield meaningful results when applied to…

计算与语言 · 计算机科学 2026-01-28 Jana Jung , Marlene Lutz , Indira Sen , Markus Strohmaier

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

计算与语言 · 计算机科学 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

计算与语言 · 计算机科学 2025-12-01 Fatima Kazi

Evaluating image editing models remains challenging due to the coarse granularity and limited interpretability of traditional metrics, which often fail to capture aspects important to human perception and intent. Such metrics frequently…

Large Language Models (LLMs) have recently been shown to produce estimates of psycholinguistic norms, such as valence, arousal, or concreteness, for words and multiword expressions, that correlate with human judgments. These estimates are…

计算与语言 · 计算机科学 2026-03-13 Thomas Hikaru Clark , Carlos Arriaga , Javier Conde , Gonzalo Martínez , Pedro Reviriego

Understanding the deep semantics of images is essential in the era dominated by social media. However, current research works primarily on the superficial description of images, revealing a notable deficiency in the systematic investigation…

计算与语言 · 计算机科学 2024-06-21 Yixin Yang , Zheng Li , Qingxiu Dong , Heming Xia , Zhifang Sui

This study investigated whether multimodal large language models can achieve human-like sensory grounding by examining their ability to capture perceptual strength ratings across sensory modalities. We explored how model characteristics…

计算与语言 · 计算机科学 2025-11-10 Jonghyun Lee , Dojun Park , Jiwoo Lee , Hoekeon Choi , Sung-Eun Lee

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…