中文
相关论文

相关论文: A Comprehensive Evaluation of Large Language Model…

200 篇论文

Large language models (LLMs) are increasingly integral to information retrieval (IR), powering ranking, evaluation, and AI-assisted content creation. This widespread adoption necessitates a critical examination of potential biases arising…

信息检索 · 计算机科学 2025-07-11 Krisztian Balog , Donald Metzler , Zhen Qin

With the development of large language models (LLMs) like the GPT series, their widespread use across various application scenarios presents a myriad of challenges. This review initially explores the issue of domain specificity, where LLMs…

计算与语言 · 计算机科学 2023-10-23 Xiaoliang Chen , Liangbin Li , Le Chang , Yunhe Huang , Yuxuan Zhao , Yuxiao Zhang , Dinuo Li

This paper investigates Large Language Models (LLMs) ability to assess the economic soundness and theoretical consistency of empirical findings in spatial econometrics. We created original and deliberately altered "counterfactual" summaries…

计算机与社会 · 计算机科学 2025-06-10 Giuseppe Arbia , Luca Morandini , Vincenzo Nardelli

The explainability of recommender systems has attracted significant attention in academia and industry. Many efforts have been made for explainable recommendations, yet evaluating the quality of the explanations remains a challenging and…

信息检索 · 计算机科学 2024-06-07 Xiaoyu Zhang , Yishan Li , Jiayin Wang , Bowen Sun , Weizhi Ma , Peijie Sun , Min Zhang

Large Language Models (LLMs) have been increasingly used to optimize the analysis and synthesis of legal documents, enabling the automation of tasks such as summarization, classification, and retrieval of legal information. This study aims…

计算与语言 · 计算机科学 2025-04-02 Matheus Belarmino , Rackel Coelho , Roberto Lotudo , Jayr Pereira

Large language models (LLMs) have achieved remarkable success in general-domain tasks, yet their direct application to the legal domain remains challenging due to hallucinated legal citations, incomplete knowledge coverage, and weak…

计算与语言 · 计算机科学 2026-04-21 Yuting Huang , Yinghao Hu , Qian Xiao , Wenlin Zhong , Yiquan Wu , Taishi Zhou , Moke Chen , Changlong Sun , Kun Kuang , Fei Wu

Legal judgment prediction is essential for enhancing judicial efficiency. In this work, we identify that existing large language models (LLMs) underperform in this domain due to challenges in understanding case complexities and…

计算与语言 · 计算机科学 2024-08-07 Chenlong Deng , Kelong Mao , Yuyao Zhang , Zhicheng Dou

The effective training and evaluation of retrieval systems require a substantial amount of relevance judgments, which are traditionally collected from human assessors -- a process that is both costly and time-consuming. Large Language…

信息检索 · 计算机科学 2024-12-19 Hossein A. Rahmani , Emine Yilmaz , Nick Craswell , Bhaskar Mitra

In this study, we investigate the capabilities and inherent biases of advanced large language models (LLMs) such as GPT-3.5 and GPT-4 in the context of debate evaluation. We discover that LLM's performance exceeds humans and surpasses the…

计算与语言 · 计算机科学 2024-06-05 Xinyi Liu , Pinxin Liu , Hangfeng He

Automated fact-checking, using machine learning to verify claims, has grown vital as misinformation spreads beyond human fact-checking capacity. Large Language Models (LLMs) like GPT-4 are increasingly trusted to write academic papers,…

计算与语言 · 计算机科学 2024-02-08 Dorian Quelle , Alexandre Bovet

In this paper, we explore the challenges inherent to Large Language Models (LLMs) like GPT-4, particularly their propensity for hallucinations, logic mistakes, and incorrect conclusions when tasked with answering complex questions. The…

计算与语言 · 计算机科学 2023-12-22 Xiang Li , Haoran Tang , Siyu Chen , Ziwei Wang , Anurag Maravi , Marcin Abram

Large Language Models (LLMs) have been shown to achieve breakthrough performance on complex logical reasoning tasks. Nevertheless, most existing research focuses on employing formal language to guide LLMs to derive reliable reasoning paths,…

计算与语言 · 计算机科学 2025-05-23 Jin Jiang , Jianing Wang , Yuchen Yan , Yang Liu , Jianhua Zhu , Mengdi Zhang , Xunliang Cai , Liangcai Gao

Large Language Models (LLMs) are often used as automated judges to evaluate text, but their effectiveness can be hindered by various unintentional biases. We propose using linear classifying probes, trained by leveraging differences between…

计算与语言 · 计算机科学 2025-03-25 Sharan Maiya , Yinhong Liu , Ramit Debnath , Anna Korhonen

The legal landscape encompasses a wide array of lawsuit types, presenting lawyers with challenges in delivering timely and accurate information to clients, particularly concerning critical aspects like potential imprisonment duration or…

人工智能 · 计算机科学 2024-07-30 Jia-Hong Huang , Chao-Chun Yang , Yixian Shen , Alessio M. Pacces , Evangelos Kanoulas

While large language models (LLMs), such as GPT-3, appear to be robust and general, their reasoning ability is not at a level to compete with the best models trained for specific natural language reasoning problems. In this study, we…

计算与语言 · 计算机科学 2023-07-18 Zhun Yang , Adam Ishay , Joohyung Lee

In the fast-evolving domain of artificial intelligence, large language models (LLMs) such as GPT-3 and GPT-4 are revolutionizing the landscapes of finance, healthcare, and law: domains characterized by their reliance on professional…

Large Language Models (LLMs) are increasingly adopted as evaluators, offering a scalable alternative to human annotation. However, existing supervised fine-tuning (SFT) approaches often fall short in domains that demand complex reasoning.…

计算与语言 · 计算机科学 2025-11-04 Nuo Chen , Zhiyuan Hu , Qingyun Zou , Jiaying Wu , Qian Wang , Bryan Hooi , Bingsheng He

Large Language Models (LLMs) have recently gained significant attention due to their remarkable capabilities in performing diverse tasks across various domains. However, a thorough evaluation of these models is crucial before deploying them…

Large language models (LLMs) have demonstrated significant potential to accelerate scientific discovery as valuable tools for analyzing data, generating hypotheses, and supporting innovative approaches in various scientific fields. In this…

计算与语言 · 计算机科学 2025-10-30 Jin Huang , Silviu Cucerzan , Sujay Kumar Jauhar , Ryen W. White

The paper underscores the significance of Large Language Models (LLMs) in reshaping recommender systems, attributing their value to unique reasoning abilities absent in traditional recommenders. Unlike conventional systems lacking direct…

信息检索 · 计算机科学 2024-03-20 Arpita Vats , Vinija Jain , Rahul Raja , Aman Chadha