English
Related papers

Related papers: Injecting Domain-Specific Knowledge into Large Lan…

200 papers

Discovering good process models is essential for different process analysis tasks such as conformance checking and process improvements. Automated process discovery methods often overlook valuable domain knowledge. This knowledge, including…

Artificial Intelligence · Computer Science 2024-09-02 Ali Norouzifar , Humam Kourani , Marcus Dees , Wil van der Aalst

Knowledge infusion is a promising method for enhancing Large Language Models for domain-specific NLP tasks rather than pre-training models over large data from scratch. These augmented LLMs typically depend on additional pre-training or…

Computation and Language · Computer Science 2024-03-05 Kinshuk Vasisht , Balaji Ganesan , Vikas Kumar , Vasudha Bhatnagar

Large Language Models (LLMs) have achieved exceptional capabilities in open generation across various domains, yet they encounter difficulties with tasks that require intensive knowledge. To address these challenges, methods for integrating…

Computation and Language · Computer Science 2024-12-17 Fali Wang , Runxue Bao , Suhang Wang , Wenchao Yu , Yanchi Liu , Wei Cheng , Haifeng Chen

We conduct the first empirical study on using knowledge transfer to improve the generalization ability of large language models (LLMs) in software engineering tasks, which often require LLMs to generalize beyond their training data. Our…

Software Engineering · Computer Science 2023-08-10 Qing Huang , Yishun Wu , Zhenchang Xing , He Jiang , Yu Cheng , Huan Jin

Large language models (LLMs) have attracted significant attention due to their impressive general capabilities across diverse downstream tasks. However, without domain-specific optimization, they often underperform on specialized knowledge…

Computation and Language · Computer Science 2025-09-25 Kangtao Lv , Haibin Chen , Yujin Yuan , Langming Liu , Shilei Liu , Yongwei Wang , Wenbo Su , Bo Zheng

This paper presents a study on the integration of domain-specific knowledge in prompt engineering to enhance the performance of large language models (LLMs) in scientific domains. A benchmark dataset is curated to encapsulate the intricate…

Computation and Language · Computer Science 2024-04-24 Hongxuan Liu , Haoyu Yin , Zhiyao Luo , Xiaonan Wang

This project investigates the efficacy of Large Language Models (LLMs) in understanding and extracting scientific knowledge across specific domains and to create a deep learning framework: Knowledge AI. As a part of this framework, we…

Computation and Language · Computer Science 2024-08-12 Balaji Muralidharan , Hayden Beadles , Reza Marzban , Kalyan Sashank Mupparaju

Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works…

Computation and Language · Computer Science 2024-10-18 Humza Naveed , Asad Ullah Khan , Shi Qiu , Muhammad Saqib , Saeed Anwar , Muhammad Usman , Naveed Akhtar , Nick Barnes , Ajmal Mian

Although large language models (LLMs) excel in knowledge recall and reasoning, their static nature leads to outdated information as the real world evolves or when adapting to domain-specific knowledge, highlighting the need for effective…

Computation and Language · Computer Science 2025-04-02 Ruoxi Xu , Yunjie Ji , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Ben He , Yingfei Sun , Xiangang Li , Le Sun

Generative large language models(LLMs) are proficient in solving general problems but often struggle to handle domain-specific tasks. This is because most of domain-specific tasks, such as personalized recommendation, rely on task-related…

Information Retrieval · Computer Science 2023-11-08 Wenxuan Zhang , Hongzhi Liu , Yingpeng Du , Chen Zhu , Yang Song , Hengshu Zhu , Zhonghai Wu

Domain-specific knowledge can significantly contribute to addressing a wide variety of vision tasks. However, the generation of such knowledge entails considerable human labor and time costs. This study investigates the potential of Large…

Large Language Models (LLMs) have emerged as a transformative power in enhancing natural language comprehension, representing a significant stride toward artificial general intelligence. The application of LLMs extends beyond conventional…

Pre-trained language models (PLM) have advanced the state-of-the-art across NLP applications, but lack domain-specific knowledge that does not naturally occur in pre-training data. Previous studies augmented PLMs with symbolic knowledge for…

Computation and Language · Computer Science 2022-12-19 Denis Emelin , Daniele Bonadiman , Sawsan Alqahtani , Yi Zhang , Saab Mansour

Large language models (LLMs) have demonstrated remarkable performance in a wide range of natural language tasks. However, as these models continue to grow in size, they face significant challenges in terms of computational costs.…

Computation and Language · Computer Science 2023-08-08 Ankush Agarwal , Sakharam Gawade , Amar Prakash Azad , Pushpak Bhattacharyya

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Large language models (LLMs) have emerged as powerful machine-learning systems capable of handling a myriad of tasks. Tuned versions of these systems have been turned into chatbots that can respond to user queries on a vast diversity of…

Computation and Language · Computer Science 2024-08-16 Kevin G. Yager

This study analyzes the multiple functions of Large Language Models (LLMs) in transforming research and development (R&D) processes. By automating knowledge discovery, boosting hypothesis creation, integrating transdisciplinary insights,…

Computation and Language · Computer Science 2025-11-25 Raha Aghaei , Ali A. Kiaei , Mahnaz Boush , Mahan Rofoosheh , Mohammad Zavvar

With the rapid development of artificial intelligence, large language models (LLMs) have shown promising capabilities in mimicking human-level language comprehension and reasoning. This has sparked significant interest in applying LLMs to…

Computation and Language · Computer Science 2023-11-06 Mingze Yuan , Peng Bao , Jiajia Yuan , Yunhao Shen , Zifan Chen , Yi Xie , Jie Zhao , Yang Chen , Li Zhang , Lin Shen , Bin Dong

In many scientific fields, large language models (LLMs) have revolutionized the way text and other modalities of data (e.g., molecules and proteins) are handled, achieving superior performance in various applications and augmenting the…

Computation and Language · Computer Science 2024-10-01 Yu Zhang , Xiusi Chen , Bowen Jin , Sheng Wang , Shuiwang Ji , Wei Wang , Jiawei Han

Large Language Models (LLMs) have been widely applied in various professional fields. By fine-tuning the models using domain specific question and answer datasets, the professional domain knowledge and Q\&A abilities of these models have…

Computation and Language · Computer Science 2024-07-17 Qimin Yang , Rongsheng Wang , Jiexin Chen , Runqi Su , Tao Tan