中文
相关论文

相关论文: Can LLMs Write Faithfully? An Agent-Based Evaluati…

200 篇论文

In the era of rapid digital communication, vast amounts of textual data are generated daily, demanding efficient methods for latent content analysis to extract meaningful insights. Large Language Models (LLMs) offer potential for automating…

This study investigates whether large language models, specifically GPT4, can match human capabilities in analogical reasoning within strategic decision making contexts. Using a novel experimental design involving source to target matching,…

人工智能 · 计算机科学 2025-05-02 Phanish Puranam , Prothit Sen , Maciej Workiewicz

Large language models (LLMs) have greatly impacted the natural language processing (NLP) field, particularly for the English language. These models have demonstrated capabilities in understanding and generating human-like text. The success…

计算与语言 · 计算机科学 2024-07-10 Hasna Chouikhi , Manel Aloui , Cyrine Ben Hammou , Ghaith Chaabane , Haithem Kchaou , Chehir Dhaouadi

This study explores the potential of Large Language Models (LLMs), specifically GPT-4, to enhance objectivity in organizational task performance evaluations. Through comparative analyses across two studies, including various task…

计算与语言 · 计算机科学 2024-08-13 Ning Li , Huaikang Zhou , Mingze Xu

Qualitative coding, or content analysis, extracts meaning from text to discern quantitative patterns across a corpus of texts. Recently, advances in the interpretive abilities of large language models (LLMs) offer potential for automating…

计算与语言 · 计算机科学 2024-02-14 Zackary Okun Dunivin

Recent advances in the performance of large language models (LLMs) have sparked debate over whether, given sufficient training, high-level human abilities emerge in such generic forms of artificial intelligence (AI). Despite the exceptional…

计算与语言 · 计算机科学 2024-01-18 Nicholas Ichien , Dušan Stamenković , Keith J. Holyoak

With the rapid advancement of large language models (LLMs), there is a pressing need for a comprehensive evaluation suite to assess their capabilities and limitations. Existing LLM leaderboards often reference scores reported in other…

计算与语言 · 计算机科学 2024-04-03 Shen Zheng , Yuyu Zhang , Yijie Zhu , Chenguang Xi , Pengyang Gao , Xun Zhou , Kevin Chen-Chuan Chang

Large language model (LLM) agents have demonstrated impressive capabilities in utilizing external tools and knowledge to boost accuracy and reduce hallucinations. However, developing prompting techniques that enable LLM agents to…

Large Language Models (LLMs) are increasingly being used to simulate human-like decision making in agent-based financial market models (ABMs). As models become more powerful and accessible, researchers can now incorporate individual LLM…

机器学习 · 计算机科学 2025-01-29 Alicia Vidler , Toby Walsh

Generative AI, particularly large language models (LLMs), is beginning to transform the financial industry by automating tasks and helping to make sense of complex financial information. One especially promising use case is the automatic…

统计金融 · 定量金融 2025-11-11 Zonghan Wu , Congyuan Zou , Junlin Wang , Chenhan Wang , Hangjing Yang , Yilei Shao

Writing has long been considered a hallmark of human intelligence and remains a pinnacle task for artificial intelligence (AI) due to the intricate cognitive processes involved. Recently, rapid advancements in generative AI, particularly…

计算与语言 · 计算机科学 2024-11-06 Samar M. Magdy , Fakhraddin Alwajih , Sang Yun Kwon , Reem Abdel-Salam , Muhammad Abdul-Mageed

This paper provides an in-depth evaluation of three state-of-the-art Large Language Models (LLMs) for personalized career mentoring in the computing field, using three distinct student profiles that consider gender, race, and professional…

计算与语言 · 计算机科学 2024-12-16 Xiao Luo , Sean O'Connell , Shamima Mithun

Attributing authorship in the era of large language models (LLMs) is increasingly challenging as machine-generated prose rivals human writing. We benchmark two complementary attribution mechanisms , fixed Style Embeddings and an…

计算与语言 · 计算机科学 2026-03-18 Misam Abbas

The surge in scientific submissions has placed increasing strain on the traditional peer-review process, prompting the exploration of large language models (LLMs) for automated review generation. While LLMs demonstrate competence in…

计算与语言 · 计算机科学 2025-09-25 Ruochi Li , Haoxuan Zhang , Edward Gehringer , Ting Xiao , Junhua Ding , Haihua Chen

Large language models (LLMs) have recently emerged as a powerful tool for a wide range of language generation tasks. Nevertheless, this progress has been slower in Arabic. In this work, we focus on the task of generating stories from LLMs.…

计算与语言 · 计算机科学 2024-07-11 Ahmed Oumar El-Shangiti , Fakhraddin Alwajih , Muhammad Abdul-Mageed

Large Language Models (LLMs), trained on extensive datasets using advanced deep learning architectures, have demonstrated remarkable performance across a wide range of language tasks, becoming a cornerstone of modern AI technologies.…

This paper evaluates the knowledge and reasoning capabilities of Large Language Models in Islamic inheritance law, known as 'ilm al-mawarith. We assess the performance of seven LLMs using a benchmark of 1,000 multiple-choice questions…

计算与语言 · 计算机科学 2025-09-18 Abdessalam Bouchekif , Samer Rashwani , Heba Sbahi , Shahd Gaben , Mutaz Al-Khatib , Mohammed Ghaly

Financial arguments play a critical role in shaping investment decisions and public trust in financial institutions. Nevertheless, assessing their quality remains poorly studied in the literature. In this paper, we examine the capabilities…

计算与语言 · 计算机科学 2025-08-13 Alaa Alhamzeh , Mays Al Rebdawi

Large language models (LLMs) often generate content that contains factual errors when responding to fact-seeking prompts on open-ended topics. To benchmark a model's long-form factuality in open domains, we first use GPT-4 to generate…

计算与语言 · 计算机科学 2024-11-08 Jerry Wei , Chengrun Yang , Xinying Song , Yifeng Lu , Nathan Hu , Jie Huang , Dustin Tran , Daiyi Peng , Ruibo Liu , Da Huang , Cosmo Du , Quoc V. Le