English
Related papers

Related papers: Knowledge-Augmented Language Model Prompting for Z…

200 papers

Recent developments in pre-trained neural language modeling have led to leaps in accuracy on commonsense question-answering benchmarks. However, there is increasing concern that models overfit to specific tasks, without learning to utilize…

Computation and Language · Computer Science 2020-12-16 Kaixin Ma , Filip Ilievski , Jonathan Francis , Yonatan Bisk , Eric Nyberg , Alessandro Oltramari

In the field of information retrieval, Query Likelihood Models (QLMs) rank documents based on the probability of generating the query given the content of a document. Recently, advanced large language models (LLMs) have emerged as effective…

Information Retrieval · Computer Science 2023-10-23 Shengyao Zhuang , Bing Liu , Bevan Koopman , Guido Zuccon

Clinical diagnosis is time-consuming, requiring intensive interactions between patients and medical professionals. While large language models (LLMs) could ease the pre-diagnostic workload, their limited domain knowledge hinders effective…

Computation and Language · Computer Science 2026-03-03 Liwen Sun , Xiang Yu , Ming Tan , Zhuohao Chen , Anqi Cheng , Ashutosh Joshi , Chenyan Xiong

The growing trend of Large Language Models (LLM) development has attracted significant attention, with models for various applications emerging consistently. However, the combined application of Large Language Models with semantic…

Computation and Language · Computer Science 2023-05-09 Milena Trajanoska , Riste Stojanov , Dimitar Trajanov

Large Language Models (LLMs) have achieved exceptional capabilities in open generation across various domains, yet they encounter difficulties with tasks that require intensive knowledge. To address these challenges, methods for integrating…

Computation and Language · Computer Science 2024-12-17 Fali Wang , Runxue Bao , Suhang Wang , Wenchao Yu , Yanchi Liu , Wei Cheng , Haifeng Chen

This paper investigates the capabilities of Large Language Models (LLMs) in the context of understanding their knowledge and uncertainty over questions. Specifically, we focus on addressing known-unknown questions, characterized by high…

Computation and Language · Computer Science 2024-07-03 Alfonso Amayuelas , Kyle Wong , Liangming Pan , Wenhu Chen , William Wang

Knowledge augmentation has significantly enhanced the performance of Large Language Models (LLMs) in knowledge-intensive tasks. However, existing methods typically operate on the simplistic premise that model performance equates with…

Computation and Language · Computer Science 2026-02-16 Hao Chen , Ye He , Yuchun Fan , Yukun Yan , Zhenghao Liu , Qingfu Zhu , Maosong Sun , Wanxiang Che

Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed,…

Information Retrieval · Computer Science 2024-12-24 Siyi Liu , Yang Li , Jiang Li , Shan Yang , Yunshi Lan

Recently, it has been shown that the incorporation of structured knowledge into Large Language Models significantly improves the results for a variety of NLP tasks. In this paper, we propose a method for exploring pre-trained Text-to-Text…

Computation and Language · Computer Science 2023-10-04 Mikhail Salnikov , Hai Le , Prateek Rajput , Irina Nikishina , Pavel Braslavski , Valentin Malykh , Alexander Panchenko

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

Large Language Models (LLMs) have significantly advanced natural language processing (NLP) with their impressive language understanding and generation capabilities. However, their performance may be suboptimal for domain-specific tasks that…

Computation and Language · Computer Science 2023-05-19 Ziyang Luo , Can Xu , Pu Zhao , Xiubo Geng , Chongyang Tao , Jing Ma , Qingwei Lin , Daxin Jiang

Knowledge concept tagging for questions plays a crucial role in contemporary intelligent educational applications, including learning progress diagnosis, practice question recommendations, and course content organization. Traditionally,…

Computation and Language · Computer Science 2024-03-27 Hang Li , Tianlong Xu , Jiliang Tang , Qingsong Wen

Recent Language Models (LMs) have shown impressive capabilities in generating texts with the knowledge internalized in parameters. Yet, LMs often generate the factually incorrect responses to the given queries, since their knowledge may be…

Computation and Language · Computer Science 2023-10-20 Jinheon Baek , Soyeong Jeong , Minki Kang , Jong C. Park , Sung Ju Hwang

Large language models (LLMs) provide powerful means to leverage prior knowledge for predictive modeling when data is limited. In this work, we demonstrate how LLMs can use their compressed world knowledge to generate intrinsically…

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

Computation and Language · Computer Science 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

Most available data is unstructured, making it challenging to access valuable information. Automatically building Knowledge Graphs (KGs) is crucial for structuring data and making it accessible, allowing users to search for information…

Artificial Intelligence · Computer Science 2024-09-06 Yassir Lairgi , Ludovic Moncla , Rémy Cazabet , Khalid Benabdeslem , Pierre Cléau

Chain-of-Thought (CoT) prompting along with sub-question generation and answering has enhanced multi-step reasoning capabilities of Large Language Models (LLMs). However, prompting the LLMs to directly generate sub-questions is suboptimal…

Computation and Language · Computer Science 2024-06-25 Jinyoung Park , Ameen Patel , Omar Zia Khan , Hyunwoo J. Kim , Joo-Kyung Kim

Knowledge Graph-based recommendations have gained significant attention due to their ability to leverage rich semantic relationships. However, constructing and maintaining Knowledge Graphs (KGs) is resource-intensive, and the accuracy of…

Information Retrieval · Computer Science 2025-02-07 Rui Cai , Chao Wang , Qianyi Cai , Dazhong Shen , Hui Xiong

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Large language models (LLMs) have shown superior performance without task-specific fine-tuning. Despite the success, the knowledge stored in the parameters of LLMs could still be incomplete and difficult to update due to the computational…

Computation and Language · Computer Science 2023-10-10 Yile Wang , Peng Li , Maosong Sun , Yang Liu