English
Related papers

Related papers: Merging Generated and Retrieved Knowledge for Open…

200 papers

This paper investigates the role of dynamic external knowledge integration in improving counter-argument generation using Large Language Models (LLMs). While LLMs have shown promise in argumentative tasks, their tendency to generate…

Computation and Language · Computer Science 2025-06-23 Anar Yeginbergen , Maite Oronoz , Rodrigo Agerri

Large Language Models (LLMs) perform well in general QA but often struggle in domain-specific scenarios. Retrieval-Augmented Generation (RAG) introduces external knowledge but suffers from hallucinations and latency due to noisy retrievals.…

Computation and Language · Computer Science 2025-09-19 Bolei He , Xinran He , Run Shao , Shanfu Shu , Xianwei Xue , Mingquan Cheng , Haifeng Li , Zhenhua Ling

Large Language Models (LLMs) are versatile, yet they often falter in tasks requiring deep and reliable reasoning due to issues like hallucinations, limiting their applicability in critical scenarios. This paper introduces a rigorously…

Computation and Language · Computer Science 2023-11-21 Saizhuo Wang , Zhihan Liu , Zhaoran Wang , Jian Guo

High-performing medical Large Language Models (LLMs) typically require extensive fine-tuning with substantial computational resources, limiting accessibility for resource-constrained healthcare institutions. This study introduces a…

Computation and Language · Computer Science 2025-10-17 Ziad Elshaer , Essam A. Rashed

Knowledge retrieval with multi-modal queries plays a crucial role in supporting knowledge-intensive multi-modal applications. However, existing methods face challenges in terms of their effectiveness and training efficiency, especially when…

Information Retrieval · Computer Science 2024-01-17 Xinwei Long , Jiali Zeng , Fandong Meng , Zhiyuan Ma , Kaiyan Zhang , Bowen Zhou , Jie Zhou

Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two…

Computation and Language · Computer Science 2023-10-10 Zhangyin Feng , Xiaocheng Feng , Dezhi Zhao , Maojin Yang , Bing Qin

This work presents a framework for assessing whether large language models (LLMs) encode more factual knowledge in their parameters than what they express in their outputs. While a few studies hint at this possibility, none has clearly…

Computation and Language · Computer Science 2025-08-07 Zorik Gekhman , Eyal Ben David , Hadas Orgad , Eran Ofek , Yonatan Belinkov , Idan Szpektor , Jonathan Herzig , Roi Reichart

Large language models (LLMs) have shown remarkable capabilities in code translation, yet their performance deteriorates in low-resource programming domains such as Fortran and emerging frameworks like CUDA, where high-quality parallel data…

Programming Languages · Computer Science 2025-12-04 Le Chen , Nuo Xu , Winson Chen , Bin Lei , Pei-Hung Lin , Dunzhi Zhou , Rajeev Thakur , Caiwen Ding , Ali Jannesari , Chunhua Liao

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

Computation and Language · Computer Science 2020-09-22 Shih-Ting Lin , Greg Durrett

Retrieval-augmented generation (RAG) with large language models (LLMs) has demonstrated strong performance in multilingual question-answering (QA) tasks by leveraging relevant passages retrieved from corpora. In multilingual RAG (mRAG), the…

Computation and Language · Computer Science 2025-12-12 Jirui Qi , Raquel Fernández , Arianna Bisazza

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

Computation and Language · Computer Science 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

As large language models (LLMs) are more frequently used in retrieval-augmented generation pipelines, it is increasingly relevant to study their behavior under knowledge conflicts. Thus far, the role of the source of the retrieved…

Computation and Language · Computer Science 2026-04-20 Jakob Schuster , Vagrant Gautam , Katja Markert

Open-ended question answering (QA) evaluates a model's ability to perform contextualized reasoning beyond factual recall. This challenge is especially acute in practice-based domains, where knowledge is procedural and grounded in…

Computation and Language · Computer Science 2026-01-29 Si Chen , Le Huy Khiem , Annalisa Szymanski , Ronald Metoyer , Ting Hua , Nitesh V. Chawla

Integrating external knowledge into large language models (LLMs) presents a promising solution to overcome the limitations imposed by their antiquated and static parametric memory. Prior studies, however, have tended to over-reliance on…

Computation and Language · Computer Science 2024-05-30 Hao Zhang , Yuyang Zhang , Xiaoguang Li , Wenxuan Shi , Haonan Xu , Huanshuo Liu , Yasheng Wang , Lifeng Shang , Qun Liu , Yong Liu , Ruiming Tang

Retrieval-Augmented Generation (RAG) significantly enhances Large Language Models (LLMs) by providing access to external knowledge. However, current research primarily focuses on retrieval quality, often overlooking the critical…

Computation and Language · Computer Science 2026-04-16 Zhengyi Zhao , Shubo Zhang , Zezhong Wang , Yuxi Zhang , Huimin Wang , Yutian Zhao , Yefeng Zheng , Binyang Li , Kam-Fai Wong , Xian Wu

Although achieving great success, Large Language Models (LLMs) usually suffer from unreliable hallucinations. Although language attribution can be a potential solution, there are no suitable benchmarks and evaluation metrics to attribute…

Computation and Language · Computer Science 2024-05-24 Xinze Li , Yixin Cao , Liangming Pan , Yubo Ma , Aixin Sun

Open-domain question answering (QA) is the tasl of identifying answers to natural questions from a large corpus of documents. The typical open-domain QA system starts with information retrieval to select a subset of documents from the…

Computation and Language · Computer Science 2020-09-03 Sina J. Semnani , Manish Pandey

This work presents an ontology-integrated large language model (LLM) framework for chemical engineering that unites structured domain knowledge with generative reasoning. The proposed pipeline aligns model training and inference with the…

Machine Learning · Computer Science 2025-12-15 Crystal Su , Kuai Yu , Jingrui Zhang , Mingyuan Shao , Daniel Bauer

Proprietary corporate documents contain rich domain-specific knowledge, but their overwhelming volume and disorganized structure make it difficult even for employees to access the right information when needed. For example, in the…

Artificial Intelligence · Computer Science 2025-08-28 Nayoung Choi , Grace Byun , Andrew Chung , Ellie S. Paek , Shinsun Lee , Jinho D. Choi

Process discovery aims to derive process models from event logs, providing insights into operational behavior and forming a foundation for conformance checking and process improvement. However, models derived solely from event data may not…

Artificial Intelligence · Computer Science 2025-10-09 Ali Norouzifar , Humam Kourani , Marcus Dees , Wil van der Aalst