English
Related papers

Related papers: Aggregated Knowledge Model: Enhancing Domain-Speci…

200 papers

This study develops a question-answering system based on Retrieval-Augmented Generation (RAG) using Chinese Wikipedia and Lawbank as retrieval sources. Using TTQA and TMMLU+ as evaluation datasets, the system employs BGE-M3 for dense vector…

Information Retrieval · Computer Science 2025-01-17 Te-Lun Yang , Jyi-Shane Liu , Yuen-Hsien Tseng , Jyh-Shing Roger Jang

Large Language Models (LLMs), although powerful in general domains, often perform poorly on domain-specific tasks such as medical question answering (QA). In addition, LLMs tend to function as "black-boxes", making it challenging to modify…

Computation and Language · Computer Science 2024-08-19 Yucheng Shi , Shaochen Xu , Tianze Yang , Zhengliang Liu , Tianming Liu , Quanzheng Li , Xiang Li , Ninghao Liu

In this paper, we propose Knowledge Base augmented Language Model (KBLaM), a new method for augmenting Large Language Models (LLMs) with external knowledge. KBLaM works with a knowledge base (KB) constructed from a corpus of documents,…

Artificial Intelligence · Computer Science 2025-02-11 Xi Wang , Taketomo Isazawa , Liana Mikaelyan , James Hensman

Question-answering for domain-specific applications has recently attracted much interest due to the latest advancements in large language models (LLMs). However, accurately assessing the performance of these applications remains a…

Recent advancements in Large Language Models and Retrieval-Augmented Generation have boosted interest in domain-specific question-answering for enterprise products. However, AI Assistants often face challenges in multi-product QA settings,…

Computation and Language · Computer Science 2025-01-28 Parshin Shojaee , Sai Sree Harsha , Dan Luo , Akash Maharaj , Tong Yu , Yunyao Li

This project investigates the efficacy of Large Language Models (LLMs) in understanding and extracting scientific knowledge across specific domains and to create a deep learning framework: Knowledge AI. As a part of this framework, we…

Computation and Language · Computer Science 2024-08-12 Balaji Muralidharan , Hayden Beadles , Reza Marzban , Kalyan Sashank Mupparaju

Large language models (LLMs) have demonstrated remarkable performance in a wide range of natural language tasks. However, as these models continue to grow in size, they face significant challenges in terms of computational costs.…

Computation and Language · Computer Science 2023-08-08 Ankush Agarwal , Sakharam Gawade , Amar Prakash Azad , Pushpak Bhattacharyya

Large Language Models (LLMs) have demonstrated impressive capabilities across natural language processing tasks. However, their application to specialized domains such as medicine and biology requires further optimization to ensure factual…

Computation and Language · Computer Science 2025-02-06 Seonok Kim

Retrieval-Augmented Generation (RAG) enhances the performance of Large Language Models (LLMs) by incorporating external knowledge. However, LLMs still encounter challenges in effectively utilizing the knowledge from retrieved documents,…

Computation and Language · Computer Science 2025-02-26 Mingyan Wu , Zhenghao Liu , Yukun Yan , Xinze Li , Shi Yu , Zheni Zeng , Yu Gu , Ge Yu

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

Given the growing trend of many organizations integrating Retrieval Augmented Generation (RAG) into their operations, we assess RAG on domain-specific data and test state-of-the-art models across various optimization techniques. We…

Artificial Intelligence · Computer Science 2024-11-14 Anum Afzal , Juraj Vladika , Gentrit Fazlija , Andrei Staradubets , Florian Matthes

Large Language Models (LLMs) have greatly contributed to the development of adaptive intelligent agents and are positioned as an important way to achieve Artificial General Intelligence (AGI). However, LLMs are prone to produce factually…

Computation and Language · Computer Science 2024-08-29 Weijian Xie , Xuefeng Liang , Yuhui Liu , Kaihua Ni , Hong Cheng , Zetian Hu

Open-domain question answering (OpenQA) represents a cornerstone in natural language processing (NLP), primarily focused on extracting answers from unstructured textual data. With the rapid advancements in Large Language Models (LLMs),…

Computation and Language · Computer Science 2025-10-28 Tingjia Shen , Hao Wang , Chuan Qin , Ruijun Sun , Yang Song , Defu Lian , Hengshu Zhu , Enhong Chen

In domains such as materials science, biomedicine, and finance, high-stakes deployment of large language models (LLMs) requires injecting private, domain-specific knowledge that is proprietary, fast-evolving, and under-represented in public…

Computation and Language · Computer Science 2026-04-15 Rongji Li , Jian Xu , Yi Chen , Xueqing Chen , Yisheng Yang , Jiayi Wang , Xingyu Chen , Chunyu Xie , Dawei Leng , Xu-Yao Zhang

This research explores the integration of large language models (LLMs) into scientific data assimilation, focusing on combustion science as a case study. Leveraging foundational models integrated with Retrieval-Augmented Generation (RAG)…

Artificial Intelligence · Computer Science 2024-09-12 Vansh Sharma , Venkat Raman

Medical question-answering (QA) systems can benefit from advances in large language models (LLMs), but directly applying LLMs to the clinical domain poses challenges such as maintaining factual accuracy and avoiding hallucinations. In this…

Computation and Language · Computer Science 2025-12-08 Tasnimul Hassan , Md Faisal Karim , Haziq Jeelani , Elham Behnam , Robert Green , Fayeq Jeelani Syed

Deploying Large Language Models (LLMs) for healthcare question answering requires robust methods to ensure accuracy and reliability. This work introduces Query-Based Retrieval Augmented Generation (QB-RAG), a framework for enhancing…

Machine Learning · Computer Science 2025-07-31 Eric Yang , Jonathan Amar , Jong Ha Lee , Bhawesh Kumar , Yugang Jia

Large language models (LLMs) often exhibit limited performance on domain-specific tasks due to the natural disproportionate representation of specialized information in their training data and the static nature of these datasets. Knowledge…

Computation and Language · Computer Science 2025-09-30 Chaojun Nie , Jun Zhou , Guanxiang Wang , Shisong Wu , Zichen Wang

Large Language Model (LLM) has gained popularity and achieved remarkable results in open-domain tasks, but its performance in real industrial domain-specific scenarios is average due to its lack of specific domain knowledge. This issue has…

Computation and Language · Computer Science 2023-10-17 Fangkai Yang , Pu Zhao , Zezhong Wang , Lu Wang , Jue Zhang , Mohit Garg , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Background: Over the past few decades, the process and methodology of automated question generation (AQG) have undergone significant transformations. Recent progress in generative natural language models has opened up new potential in the…

Artificial Intelligence · Computer Science 2024-12-06 Dominic Lohr , Marc Berges , Abhishek Chugh , Michael Kohlhase , Dennis Müller