中文
相关论文

相关论文: LLM-Metrics: Measuring Research Impact Through Lar…

200 篇论文

Large language models (LLMs) have been noted to fabricate scholarly citations, yet the scope of this behavior across providers, domains, and prompting conditions remains poorly quantified. We present one of the largest citation…

计算与语言 · 计算机科学 2026-03-05 MZ Naser

Large Language Models (LLMs) are increasingly deployed in roles requiring nuanced psychological understanding, such as emotional support agents, counselors, and decision-making assistants. However, their ability to interpret human…

计算与语言 · 计算机科学 2025-09-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

统计方法学 · 统计学 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

This report analyzes the potential for large language models (LLMs) to expedite accurate replication and generalization of published research about message effects in marketing. LLM-powered participants (personas) were tested by replicating…

计算与语言 · 计算机科学 2025-04-28 Leo Yeykelis , Kaavya Pichai , James J. Cummings , Byron Reeves

Objective: This study aims to summarize the usage of Large Language Models (LLMs) in the process of creating a scientific review. We look at the range of stages in a review that can be automated and assess the current state-of-the-art…

数字图书馆 · 计算机科学 2025-05-16 Dmitry Scherbakov , Nina Hubig , Vinita Jansari , Alexander Bakumenko , Leslie A. Lenert

Significant scientific discoveries have driven the progress of human civilisation. The explosion of scientific literature and data has created information barriers across disciplines that have slowed the pace of scientific discovery. Large…

计算与语言 · 计算机科学 2023-11-13 Biqing Qi , Kaiyan Zhang , Haoxiang Li , Kai Tian , Sihang Zeng , Zhang-Ren Chen , Bowen Zhou

Large language models (LLMs) are increasingly examined as both behavioral subjects and decision systems, yet it remains unclear whether observed cognitive biases reflect surface imitation or deeper probability shifts. Anchoring bias, a…

人工智能 · 计算机科学 2025-11-11 Felipe Valencia-Clavijo

Large Language Models (LLMs) have emerged as powerful support tools across various natural language tasks and a range of application domains. Recent studies focus on exploring their capabilities for data annotation. This paper provides a…

计算与语言 · 计算机科学 2025-07-01 Maja Pavlovic , Massimo Poesio

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

计算与语言 · 计算机科学 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

As Large Language Models (LLMs) are increasingly embedded in real-world decision-making processes, it becomes crucial to examine the extent to which they exhibit cognitive biases. Extensively studied in the field of psychology, cognitive…

计算与语言 · 计算机科学 2025-09-30 R. Alexander Knipper , Charles S. Knipper , Kaiqi Zhang , Valerie Sims , Clint Bowers , Santu Karmaker

Large language models (LLMs) have emerged as versatile tools in various daily applications. However, they are fraught with issues that undermine their utility and trustworthiness. These include the incorporation of erroneous references…

计算与语言 · 计算机科学 2023-09-13 Dongyub Lee , Taesun Whang , Chanhee Lee , Heuiseok Lim

Measuring innovation often relies on context-specific proxies and on expert evaluation. Hence, empirical innovation research is often limited to settings where such data is available. We investigate how large language models (LLMs) can be…

计算与语言 · 计算机科学 2025-08-05 Robin Nowak , Patrick Figge , Carolin Haeussler

Recent advancements in large language models (LLMs) hold significant promise in improving physics education research that uses machine learning. In this study, we compare the application of various models to perform large-scale analysis of…

物理教育 · 物理学 2025-02-25 Rebeckah K. Fussell , Megan Flynn , Anil Damle , Michael F. J. Fox , N. G. Holmes

In this paper, we explore the potential of Large Language Models (LLMs) with assertions to mitigate imbalances in educational datasets. Traditional models often fall short in such contexts, particularly due to the complexity and nuanced…

计算机与社会 · 计算机科学 2024-07-03 Jeanne McClure , Machi Shimmei , Noboru Matsuda , Shiyan Jiang

Large language models (LLMs) present a promising yet challenging frontier for automated source citation in scientific communication. Previous approaches to citation generation have been limited by citation ambiguity and LLM…

计算与语言 · 计算机科学 2025-04-14 Yash Saxena , Deepa Tilwani , Ali Mohammadi , Edward Raff , Amit Sheth , Srinivasan Parthasarathy , Manas Gaur

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

计算与语言 · 计算机科学 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

Traditional psychological models of belief revision focus on face-to-face interactions, but with the rise of social media, more effective models are needed to capture belief revision at scale, in this rich text-based online discourse. Here,…

计算与语言 · 计算机科学 2025-12-01 Gia Bao Hoang , Keith J Ransom , Rachel Stephens , Carolyn Semmler , Nicolas Fay , Lewis Mitchell

With the rapid advancement of Large Language Models (LLMs), the academic community has faced unprecedented disruptions, particularly in the realm of academic communication. The primary function of peer review is improving the quality of…

计算与语言 · 计算机科学 2026-04-22 Wenqing Wu , Chengzhi Zhang , Yi Zhao , Tong Bao

As the academic landscape expands, the challenge of efficiently identifying impactful newly published articles grows increasingly vital. This paper introduces a promising approach, leveraging the capabilities of LLMs to predict the future…

计算与语言 · 计算机科学 2024-12-17 Penghai Zhao , Qinghua Xing , Kairan Dou , Jinyu Tian , Ying Tai , Jian Yang , Ming-Ming Cheng , Xiang Li