中文
相关论文

相关论文: SciRerankBench: Benchmarking Rerankers Towards Sci…

200 篇论文

Retrieval-augmented generation (RAG) with large language models (LLMs) has demonstrated strong performance in multilingual question-answering (QA) tasks by leveraging relevant passages retrieved from corpora. In multilingual RAG (mRAG), the…

计算与语言 · 计算机科学 2025-12-12 Jirui Qi , Raquel Fernández , Arianna Bisazza

Large language models (LLMs) augmented with external data have demonstrated remarkable capabilities in completing real-world tasks. Techniques for integrating external data into LLMs, such as Retrieval-Augmented Generation (RAG) and…

计算与语言 · 计算机科学 2024-09-24 Siyun Zhao , Yuqing Yang , Zilong Wang , Zhiyuan He , Luna K. Qiu , Lili Qiu

Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations.…

计算与语言 · 计算机科学 2024-05-06 Mingchen Li , Halil Kilicoglu , Hua Xu , Rui Zhang

In this paper, we introduce Rank-R1, a novel LLM-based reranker that performs reasoning over both the user query and candidate documents before performing the ranking task. Existing document reranking methods based on large language models…

信息检索 · 计算机科学 2025-03-11 Shengyao Zhuang , Xueguang Ma , Bevan Koopman , Jimmy Lin , Guido Zuccon

While large language models (LLMs) have achieved state-of-the-art performance on a wide range of medical question answering (QA) tasks, they still face challenges with hallucinations and outdated knowledge. Retrieval-augmented generation…

计算与语言 · 计算机科学 2024-02-26 Guangzhi Xiong , Qiao Jin , Zhiyong Lu , Aidong Zhang

As large language models (LLMs) are increasingly applied to scientific reasoning, the complexity of answer formats and the diversity of equivalent expressions make answer verification a critical yet challenging task. Existing verification…

人工智能 · 计算机科学 2025-09-30 Shenghe Zheng , Chenyu Huang , Fangchen Yu , Junchi Yao , Jingqi Ye , Tao Chen , Yun Luo , Ning Ding , LEI BAI , Ganqu Cui , Peng Ye

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

This study evaluates large language models (LLMs) in generating code from algorithm descriptions in recent NLP papers. The task requires two key competencies: (1) algorithm comprehension: synthesizing information from papers and academic…

计算与语言 · 计算机科学 2025-08-08 Yanzheng Xiang , Hanqi Yan , Shuyin Ouyang , Lin Gui , Yulan He

Large language models (LLMs) often generate outdated or inaccurate information based on static training datasets. Retrieval-augmented generation (RAG) mitigates this by integrating outside data sources. While previous RAG systems used…

Retrieval Augmented Generation (RAG) systems have emerged as a powerful method for enhancing large language models (LLMs) with up-to-date information. However, the retrieval step in RAG can sometimes surface documents containing…

计算与语言 · 计算机科学 2025-04-02 Vignesh Gokul , Srikanth Tenneti , Alwarappan Nakkiran

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Scientific paper retrieval is essential for supporting literature discovery and research. While dense retrieval methods demonstrate effectiveness in general-purpose tasks, they often fail to capture fine-grained scientific concepts that are…

信息检索 · 计算机科学 2025-10-07 Yunyi Zhang , Ruozhen Yang , Siqi Jiao , SeongKu Kang , Jiawei Han

Traditional retrieval-augmented generation (RAG) benchmarks evaluate systems using heuristic-based metrics, but these require human preferences as the ground truth for reference. In contrast, arena-based benchmarks, where systems compete…

计算与语言 · 计算机科学 2025-04-01 Nandan Thakur , Suleman Kazi , Ge Luo , Jimmy Lin , Amin Ahmad

Large language models (LLMs) present a promising yet challenging frontier for automated source citation in scientific communication. Previous approaches to citation generation have been limited by citation ambiguity and LLM…

计算与语言 · 计算机科学 2025-04-14 Yash Saxena , Deepa Tilwani , Ali Mohammadi , Edward Raff , Amit Sheth , Srinivasan Parthasarathy , Manas Gaur

Large Vision-Language Models (LVLMs) have made remarkable strides in multimodal tasks such as visual question answering, visual grounding, and complex reasoning. However, they remain limited by static training data, susceptibility to…

人工智能 · 计算机科学 2025-08-27 Chan-Wei Hu , Yueqi Wang , Shuo Xing , Chia-Ju Chen , Suofei Feng , Ryan Rossi , Zhengzhong Tu

Large language models (LLMs) often need to incorporate external knowledge to solve theme-specific problems. Retrieval-augmented generation (RAG) has shown its high promise, empowering LLMs to generate more qualified responses with retrieved…

机器学习 · 计算机科学 2025-08-05 Jimeng Shi , Sizhe Zhou , Bowen Jin , Wei Hu , Runchu Tian , Shaowen Wang , Giri Narasimhan , Jiawei Han

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

计算与语言 · 计算机科学 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

The advancements of large language models (LLMs) have piqued growing interest in developing LLM-based language agents to automate scientific discovery end-to-end, which has sparked both excitement and skepticism about their true…

Literature reviews are an essential component of scientific research, but they remain time-intensive and challenging to write, especially due to the recent influx of research papers. This paper explores the zero-shot abilities of recent…