中文
相关论文

相关论文: Retrieval Augmented Instruction Tuning for Open NE…

200 篇论文

In-Context Learning (ICL) enables Large Language Models (LLMs) to perform new tasks by conditioning on prompts with relevant information. Retrieval-Augmented Generation (RAG) enhances ICL by incorporating retrieved documents into the LLM's…

机器学习 · 计算机科学 2024-12-02 Marie Al Ghossein , Emile Contal , Alexandre Robicquet

Large language models (LLMs) remain unreliable for global enterprise applications due to substantial performance gaps between high-resource and mid/low-resource languages, driven by English-centric pretraining and internal reasoning biases.…

计算与语言 · 计算机科学 2025-10-28 Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Tao Sheng , Sujith Ravi , Dan Roth

Instruction Fine-Tuning (IFT) is a powerful paradigm that strengthens the zero-shot capabilities of Large Language Models (LLMs), but in doing so induces new evaluation metric requirements. We show LLM-based metrics to be well adapted to…

机器学习 · 计算机科学 2023-12-19 Manuel Faysse , Gautier Viaud , Céline Hudelot , Pierre Colombo

Compact dual-encoder models are widely used for retrieval owing to their efficiency and scalability. However, such models often underperform compared to their Large Language Model (LLM)-based retrieval counterparts, likely due to their…

信息检索 · 计算机科学 2025-09-23 Pranjal A. Chitale , Bishal Santra , Yashoteja Prabhu , Amit Sharma

Despite its substantial impact on various search, recommendation, and question answering tasks, privacy-preserving methods for personalizing large language models (LLMs) have received relatively limited exploration. There is one primary…

计算与语言 · 计算机科学 2025-06-27 Alireza Salemi , Hamed Zamani

Large Language Models (LLMs) play powerful, black-box readers in the retrieve-then-read pipeline, making remarkable progress in knowledge-intensive tasks. This work introduces a new framework, Rewrite-Retrieve-Read instead of the previous…

计算与语言 · 计算机科学 2023-10-24 Xinbei Ma , Yeyun Gong , Pengcheng He , Hai Zhao , Nan Duan

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

计算与语言 · 计算机科学 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

Large language models (LLMs) exhibit remarkable capabilities but often produce inaccurate responses, as they rely solely on their embedded knowledge. Retrieval-Augmented Generation (RAG) enhances LLMs by incorporating an external…

计算与语言 · 计算机科学 2024-09-25 Nitin Aravind Birur , Tanay Baswa , Divyanshu Kumar , Jatan Loya , Sahil Agarwal , Prashanth Harshangi

Retrieval-Augmented Large Language Models (LLMs), which incorporate the non-parametric knowledge from external knowledge bases into LLMs, have emerged as a promising approach to enhancing response accuracy in several tasks, such as…

计算与语言 · 计算机科学 2024-03-29 Soyeong Jeong , Jinheon Baek , Sukmin Cho , Sung Ju Hwang , Jong C. Park

Knowing that the generative capabilities of large language models (LLM) are sometimes hampered by tendencies to hallucinate or create non-factual responses, researchers have increasingly focused on methods to ground generated outputs in…

信息检索 · 计算机科学 2024-11-20 Sonal Prabhune , Donald J. Berndt

Recent information retrieval (IR) models are pre-trained and instruction-tuned on massive datasets and tasks, enabling them to perform well on a wide range of tasks and potentially generalize to unseen tasks with instructions. However,…

信息检索 · 计算机科学 2024-10-15 Weiwei Sun , Zhengliang Shi , Jiulong Wu , Lingyong Yan , Xinyu Ma , Yiding Liu , Min Cao , Dawei Yin , Zhaochun Ren

Information retrieval (IR) systems have played a vital role in modern digital life and have cemented their continued usefulness in this new era of generative AI via retrieval-augmented generation. With strong language processing…

计算与语言 · 计算机科学 2025-03-04 Shijie Chen , Bernal Jiménez Gutiérrez , Yu Su

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

信息检索 · 计算机科学 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Instruction tuning is a crucial supervised training phase in Large Language Models (LLMs), aiming to enhance the LLM's ability to generalize instruction execution and adapt to user preferences. With the increasing integration of multi-modal…

多媒体 · 计算机科学 2023-11-28 Chen Li , Yixiao Ge , Dian Li , Ying Shan

Large language models (LLMs) have enabled a wide variety of real-world applications in various domains. However, creating a high-performing application with high accuracy remains challenging, particularly for subjective tasks like emotion…

计算与语言 · 计算机科学 2025-07-01 Mengqi Wang , Tiantian Feng , Shrikanth Narayanan

The adoption of generative AI and large language models (LLMs) in education is still emerging. In this study, we explore the development and evaluation of AI teaching assistants that provide curriculum-based guidance using a…

计算与语言 · 计算机科学 2025-10-06 Konstantinos Katharakis , Sippo Rossi , Raghava Rao Mukkamala

Information extraction (IE) has been studied extensively. The existing methods always follow a fixed extraction order for complex IE tasks with multiple elements to be extracted in one instance such as event extraction. However, we conduct…

计算与语言 · 计算机科学 2024-03-26 Wenhao Huang , Jiaqing Liang , Zhixu Li , Yanghua Xiao , Chuanjun Ji

As large language models (LLMs) continue to advance, instruction tuning has become critical for improving their ability to generate accurate and contextually appropriate responses. Although numerous instruction-tuning datasets have been…

计算与语言 · 计算机科学 2024-10-18 Jielin Song , Siyu Liu , Bin Zhu , Yanghui Rao

Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowledge in the context,…

计算与语言 · 计算机科学 2025-03-28 Kushagra Bhushan , Yatin Nandwani , Dinesh Khandelwal , Sonam Gupta , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

Open information extraction (IE) is the task of extracting open-domain assertions from natural language sentences. A key step in open IE is confidence modeling, ranking the extractions based on their estimated quality to adjust precision…

计算与语言 · 计算机科学 2019-06-03 Zhengbao Jiang , Pengcheng Yin , Graham Neubig