中文
相关论文

相关论文: Fine-Tuning LLaMA for Multi-Stage Text Retrieval

200 篇论文

Large Language Models (LLMs) play powerful, black-box readers in the retrieve-then-read pipeline, making remarkable progress in knowledge-intensive tasks. This work introduces a new framework, Rewrite-Retrieve-Read instead of the previous…

计算与语言 · 计算机科学 2023-10-24 Xinbei Ma , Yeyun Gong , Pengcheng He , Hai Zhao , Nan Duan

With over 200 million published academic documents and millions of new documents being written each year, academic researchers face the challenge of searching for information within this vast corpus. However, existing retrieval systems…

信息检索 · 计算机科学 2024-05-21 Gengchen Wei , Xinle Pang , Tianning Zhang , Yu Sun , Xun Qian , Chen Lin , Han-Sen Zhong , Wanli Ouyang

Large language models (LLMs) have achieved remarkable success across various natural language processing (NLP) tasks. However, recent studies suggest that they still face challenges in performing fundamental NLP tasks essential for deep…

计算与语言 · 计算机科学 2025-04-22 Ziyan Zhang , Yang Hou , Chen Gong , Zhenghua Li

Large Language Models (LLMs) demonstrate remarkable translation capabilities in high-resource language tasks, yet their performance in low-resource languages is hindered by insufficient multilingual data during pre-training. To address…

计算与语言 · 计算机科学 2024-10-15 Yinquan Lu , Wenhao Zhu , Lei Li , Yu Qiao , Fei Yuan

This paper focuses on extending the success of large language models (LLMs) to sequential decision making. Existing efforts either (i) re-train or finetune LLMs for decision making, or (ii) design prompts for pretrained LLMs. The former…

机器学习 · 计算机科学 2025-06-17 Dingyang Chen , Qi Zhang , Yinglun Zhu

The rapid evolution of e-commerce has exposed the limitations of traditional product retrieval systems in managing complex, multi-turn user interactions. Recent advances in multimodal generative retrieval -- particularly those leveraging…

The advent of Large Language Models (LLMs) heralds a pivotal shift in online user interactions with information. Traditional Information Retrieval (IR) systems primarily relied on query-document matching, whereas LLMs excel in comprehending…

信息检索 · 计算机科学 2023-11-22 Samira Ghodratnama , Mehrdad Zakershahrak

Systematic literature reviews (SLRs) are essential but labor-intensive due to high publication volumes and inefficient keyword-based filtering. To streamline this process, we evaluate Large Language Models (LLMs) for enhancing efficiency…

机器学习 · 计算机科学 2025-06-17 Lucas Joos , Daniel A. Keim , Maximilian T. Fischer

Large language models (LLMs) have recently emerged as powerful tools for tackling many language-processing tasks. Despite their success, training and fine-tuning these models is still far too computationally and memory intensive. In this…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Roy Miles , Pradyumna Reddy , Ismail Elezi , Jiankang Deng

Multimodal Large Language Models (MLLMs) enhance the potential of natural language processing. However, their actual impact on document information extraction remains unclear. In particular, it is unclear whether an MLLM-only…

计算与语言 · 计算机科学 2026-03-04 Jiyuan Shen , Peiyue Yuan , Atin Ghosh , Yifan Mai , Daniel Dahlmeier

Researchers have successfully applied large language models (LLMs) such as ChatGPT to reranking in an information retrieval context, but to date, such work has mostly been built on proprietary models hidden behind opaque API endpoints. This…

信息检索 · 计算机科学 2023-09-27 Ronak Pradeep , Sahel Sharifymoghaddam , Jimmy Lin

Test-time scaling has emerged as a promising paradigm in language modeling, leveraging additional computational resources at inference time to enhance model performance. In this work, we introduce R2-LLMs, a novel and versatile hierarchical…

计算与语言 · 计算机科学 2025-07-09 Alex ZH Dou , Zhongwei Wan , Dongfei Cui , Xin Wang , Jing Xiong , Haokun Lin , Chaofan Tao , Shen Yan , Mi Zhang

We address the task of evidence retrieval for long document question answering, which involves locating relevant paragraphs within a document to answer a question. We aim to assess the applicability of large language models (LLMs) in the…

计算与语言 · 计算机科学 2023-11-23 Inderjeet Nair , Shwetha Somasundaram , Apoorv Saxena , Koustava Goswami

Large language models (LLMs) show promise for supporting clinical decision-making in complex fields such as rheumatology. Our evaluation shows that smaller language models (SLMs), combined with retrieval-augmented generation (RAG), achieve…

This study introduces a system leveraging Large Language Models (LLMs) to extract text and enhance user interaction with PDF documents via a conversational interface. Utilizing Retrieval-Augmented Generation (RAG), the system provides…

信息检索 · 计算机科学 2025-02-20 Soham Roy , Mitul Goswami , Nisharg Nargund , Suneeta Mohanty , Prasant Kumar Pattnaik

Recent advancements in large language models (LLMs) have demonstrated their remarkable capabilities across various language tasks. Inspired by the success of text-to-text translation refinement, this paper investigates how LLMs can improve…

计算与语言 · 计算机科学 2025-01-28 Huaixia Dou , Xinyu Tian , Xinglin Lyu , Jie Zhu , Junhui Li , Lifan Guo

Flight trajectory prediction is a critical time series task in aviation. While deep learning methods have shown significant promise, the application of large language models (LLMs) to this domain remains underexplored. This study pioneers…

人工智能 · 计算机科学 2025-01-30 Kaiwei Luo , Jiliu Zhou

Large Language Models (LLMs) offer new potential for automating documentation-to-code traceability, yet their capabilities remain underexplored. We present a comprehensive evaluation of LLMs (Claude 3.5 Sonnet, GPT-4o, and o3-mini) in…

软件工程 · 计算机科学 2025-08-08 Ebube Alor , SayedHassan Khatoonabadi , Emad Shihab

Multimodal language analysis is a rapidly evolving field that leverages multiple modalities to enhance the understanding of high-level semantics underlying human conversational utterances. Despite its significance, little research has…

计算与语言 · 计算机科学 2025-04-25 Hanlei Zhang , Zhuohang Li , Yeshuang Zhu , Hua Xu , Peiwu Wang , Haige Zhu , Jie Zhou , Jinchao Zhang

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…