English
Related papers

Related papers: DRAK: Unlocking Molecular Insights with Domain-Spe…

200 papers

Large Language Models (LLMs) can be seen as compressed knowledge bases, but it remains unclear what knowledge they truly contain and how far their knowledge boundary extends. Existing benchmarks are mostly static and provide limited support…

Machine Learning · Computer Science 2026-05-27 Yuheng Yang , Siqi Zhu , Tao Feng , Ge Liu , Jiaxuan You

Reducing hallucination of Large Language Models (LLMs) is imperative for use in the sciences, where reliability and reproducibility are crucial. However, LLMs inherently lack long-term memory, making it a nontrivial, ad hoc, and inevitably…

Computation and Language · Computer Science 2024-10-11 Yuan Chiang , Elvis Hsieh , Chia-Hong Chou , Janosh Riebesell

Retrieval-Augmented Generation (RAG) has significantly mitigated the hallucinations of Large Language Models (LLMs) by grounding the generation with external knowledge. Recent extensions of RAG to graph-based retrieval offer a promising…

Machine Learning · Computer Science 2025-09-23 Jialin Chen , Houyu Zhang , Seongjun Yun , Alejandro Mottini , Rex Ying , Xiang Song , Vassilis N. Ioannidis , Zheng Li , Qingjun Cui

Large language models (LLMs) have achieved remarkable success due to their exceptional generative capabilities. Despite their success, they also have inherent limitations such as a lack of up-to-date knowledge and hallucination.…

Cryptography and Security · Computer Science 2024-08-14 Wei Zou , Runpeng Geng , Binghui Wang , Jinyuan Jia

Large Language Models (LLMs) showcase remarkable abilities, yet they struggle with limitations such as hallucinations, outdated knowledge, opacity, and inexplicable reasoning. To address these challenges, Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-10-03 Sourav Verma

Large language models (LLMs) are introducing a paradigm shift in molecular discovery by enabling text-guided interaction with chemical spaces through natural language, symbolic notations, with emerging extensions to incorporate multi-modal…

Machine Learning · Computer Science 2025-05-23 Ziqing Wang , Kexin Zhang , Zihan Zhao , Yibo Wen , Abhishek Pandey , Han Liu , Kaize Ding

This paper investigates the impact of domain-specific model fine-tuning and of reasoning mechanisms on the performance of question-answering (Q&A) systems powered by large language models (LLMs) and Retrieval-Augmented Generation (RAG).…

Artificial Intelligence · Computer Science 2024-04-23 Zooey Nguyen , Anthony Annunziata , Vinh Luong , Sang Dinh , Quynh Le , Anh Hai Ha , Chanh Le , Hong An Phan , Shruti Raghavan , Christopher Nguyen

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

In knowledge-intensive tasks such as open-domain question answering (OpenQA), large language models (LLMs) often struggle to generate factual answers, relying solely on their internal (parametric) knowledge. To address this limitation,…

Computation and Language · Computer Science 2025-04-29 Jinming Nian , Zhiyuan Peng , Qifan Wang , Yi Fang

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

Computation and Language · Computer Science 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang

Recent advancements in Large Language Models (LLMs) have significantly improved their performance across various Natural Language Processing (NLP) tasks. However, LLMs still struggle with generating non-factual responses due to limitations…

Computation and Language · Computer Science 2024-09-10 Taeho Hwang , Soyeong Jeong , Sukmin Cho , SeungYoon Han , Jong C. Park

Logs play a critical role in providing essential information for system monitoring and troubleshooting. Recently, with the success of pre-trained language models (PLMs) and large language models (LLMs) in natural language processing (NLP),…

Software Engineering · Computer Science 2025-02-03 Lipeng Ma , Weidong Yang , Sihang Jiang , Ben Fei , Mingjie Zhou , Shuhao Li , Mingyu Zhao , Bo Xu , Yanghua Xiao

With the rise of knowledge graph based retrieval-augmented generation (RAG) techniques such as GraphRAG and Pike-RAG, the role of knowledge graphs in enhancing the reasoning capabilities of large language models (LLMs) has become…

Information Retrieval · Computer Science 2025-04-15 Hairong Zhang , Jiaheng Si , Guohang Yan , Boyuan Qi , Pinlong Cai , Song Mao , Ding Wang , Botian Shi

Retrieval-augmented generation (RAG) has demonstrated effectiveness in mitigating the hallucination problem of large language models (LLMs). However, the difficulty of aligning the retriever with the diverse LLMs' knowledge preferences…

Computation and Language · Computer Science 2024-07-19 Guanting Dong , Yutao Zhu , Chenghao Zhang , Zechen Wang , Zhicheng Dou , Ji-Rong Wen

Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations.…

Computation and Language · Computer Science 2024-05-06 Mingchen Li , Halil Kilicoglu , Hua Xu , Rui Zhang

Recent advancements in language models (LMs) have notably enhanced their ability to reason with tabular data, primarily through program-aided mechanisms that manipulate and analyze tables. However, these methods often require the entire…

Data allocation plays a critical role in federated large language model (LLM) and small language models (SLMs) reasoning collaboration. Nevertheless, existing data allocation methods fail to address an under-explored challenge in…

Artificial Intelligence · Computer Science 2026-02-24 Wei Guo , Siyuan Lu , Xiangdong Ran , Yiqi Tong , Yikun Ban , Zelong Xu , Jing Fan , Zixuan Huang , Xiao Zhang , Zhaojun Hu , Fuzhen Zhuang

Existing retrieval-augmented code generation (RACG) methods typically use an external retrieval module to fetch semantically similar code snippets used for generating subsequent fragments. However, even for consecutive code fragments, the…

Information Retrieval · Computer Science 2025-10-10 Qian Dong , Jia Chen , Qingyao Ai , Hongning Wang , Haitao Li , Yi Wu , Yao Hu , Yiqun Liu , Shaoping Ma

Domain-specific knowledge can significantly contribute to addressing a wide variety of vision tasks. However, the generation of such knowledge entails considerable human labor and time costs. This study investigates the potential of Large…