English
Related papers

Related papers: Improving LLMs with a knowledge from databases

200 papers

A question-answering (QA) system is to search suitable answers within a knowledge base. Current QA systems struggle with queries requiring complex reasoning or real-time knowledge integration. They are often supplemented with retrieval…

Computation and Language · Computer Science 2025-05-21 Sizhe Yuen , Ting Su , Ziyang Wang , Yali Du , Adam J. Sobey

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

Computation and Language · Computer Science 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

Large Language Models (LLMs) have immense potential to transform the telecommunications industry. They could help professionals understand complex standards, generate code, and accelerate development. However, traditional LLMs struggle with…

Networking and Internet Architecture · Computer Science 2024-06-12 Girma M. Yilma , Jose A. Ayala-Romero , Andres Garcia-Saavedra , Xavier Costa-Perez

Software engineers are increasingly adding semantic search capabilities to applications using a strategy known as Retrieval Augmented Generation (RAG). A RAG system involves finding documents that semantically match a query and then passing…

Software Engineering · Computer Science 2024-02-05 Scott Barnett , Stefanus Kurniawan , Srikanth Thudumu , Zach Brannelly , Mohamed Abdelrazek

Large Language Models (LLMs) have significantly advanced medical question-answering by leveraging extensive clinical data and medical literature. However, the rapid evolution of medical knowledge and the labor-intensive process of manually…

Computation and Language · Computer Science 2025-07-01 Mohammad Reza Rezaei , Reza Saadati Fard , Jayson L. Parker , Rahul G. Krishnan , Milad Lankarany

Recent advancements in language models (LMs) have notably enhanced their ability to reason with tabular data, primarily through program-aided mechanisms that manipulate and analyze tables. However, these methods often require the entire…

Efforts to ensure the safety of large language models (LLMs) include safety fine-tuning, evaluation, and red teaming. However, despite the widespread use of the Retrieval-Augmented Generation (RAG) framework, AI safety work focuses on…

Computation and Language · Computer Science 2025-04-28 Bang An , Shiyue Zhang , Mark Dredze

Large Language Model (LLM)-based recommendation systems have demonstrated remarkable capabilities in understanding user preferences and generating personalized suggestions. However, existing approaches face critical challenges in…

Information Retrieval · Computer Science 2026-04-24 Sushant Mehta

Retrieval Augmented Generation (RAG) has emerged as a crucial technique for enhancing the accuracy of Large Language Models (LLMs) by incorporating external information. With the advent of LLMs that support increasingly longer context…

Machine Learning · Computer Science 2024-11-07 Quinn Leng , Jacob Portes , Sam Havens , Matei Zaharia , Michael Carbin

Retrieval Augmented Generation (RAG) is widely used to enable Large Language Models (LLMs) perform Question Answering (QA) tasks in various domains. However, RAG based on open-source LLM for specialized domains has challenges of evaluating…

Computation and Language · Computer Science 2024-07-23 Sujoy Roychowdhury , Sumit Soman , H G Ranjani , Neeraj Gunda , Vansh Chhabra , Sai Krishna Bala

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Large language models (LLMs) are transforming the way information is retrieved with vast amounts of knowledge being summarized and presented via natural language conversations. Yet, LLMs are prone to highlight the most frequently seen…

Computation and Language · Computer Science 2024-02-20 Julien Delile , Srayanta Mukherjee , Anton Van Pamel , Leonid Zhukov

Retrieval-Augmented Generation (RAG) enhances Large Language Model (LLM) output by providing prior knowledge as context to input. This is beneficial for knowledge-intensive and expert reliant tasks, including legal question-answering, which…

Speech recognition systems often face challenges due to domain mismatch, particularly in real-world applications where domain-specific data is unavailable because of data accessibility and confidentiality constraints. Inspired by…

Computation and Language · Computer Science 2025-02-24 Peng Shen , Xugang Lu , Hisashi Kawai

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

This tutorial explores the advancements and challenges in the development of Large Language Models (LLMs) such as ChatGPT and Gemini. It addresses inherent limitations like temporal knowledge cutoffs, mathematical inaccuracies, and the…

Computation and Language · Computer Science 2024-11-13 Giorgio Roffo

Graph-based Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs), improving their factual accuracy, adaptability, interpretability, and trustworthiness. A number of…

Information Retrieval · Computer Science 2026-04-28 Yingli Zhou , Yaodong Su , Youran Sun , Shu Wang , Taotao Wang , Runyuan He , Yongwei Zhang , Sicong Liang , Xilin Liu , Yuchi Ma , Yixiang Fang

This paper presents an innovative large language model (LLM) agent framework for enhancing diagnostic accuracy in simulated clinical environments using the AgentClinic benchmark. The proposed automatic correction enables doctor agents to…

Artificial Intelligence · Computer Science 2024-10-15 Abhishek Dutta , Yen-Che Hsiao

Retrieval-Augmented Generation (RAG) significantly improved the ability of Large Language Models (LLMs) to solve knowledge-intensive tasks. While existing research seeks to enhance RAG performance by retrieving higher-quality documents or…

Artificial Intelligence · Computer Science 2024-10-22 Xin Zhou , Ping Nie , Yiwen Guo , Haojie Wei , Zhanqiu Zhang , Pasquale Minervini , Ruotian Ma , Tao Gui , Qi Zhang , Xuanjing Huang

We study the limitations of Large Language Models (LLMs) for the task of response generation in human-machine dialogue. Several techniques have been proposed in the literature for different dialogue types (e.g., Open-Domain). However, the…

Computation and Language · Computer Science 2024-08-06 Simone Alghisi , Massimo Rizzoli , Gabriel Roccabruna , Seyed Mahed Mousavi , Giuseppe Riccardi