English
Related papers

Related papers: Probing Script Knowledge from Pre-Trained Models

200 papers

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge when dealing with knowledge driven tasks. Despite the many…

Computation and Language · Computer Science 2022-08-02 Qianglong Chen , Feng-Lin Li , Guohai Xu , Ming Yan , Ji Zhang , Yin Zhang

The rapid advancement of pre-trained language models (PLMs) has demonstrated promising results for various code-related tasks. However, their effectiveness in detecting real-world vulnerabilities remains a critical challenge. While existing…

Cryptography and Security · Computer Science 2025-11-25 Youpeng Li , Weiliang Qi , Xuyu Wang , Fuxun Yu , Xinda Wang

Predicting the subsequent event for an existing event context is an important but challenging task, as it requires understanding the underlying relationship between events. Previous methods propose to retrieve relational features from event…

Computation and Language · Computer Science 2022-05-24 Li Du , Xiao Ding , Yue Zhang , Kai Xiong , Ting Liu , Bing Qin

While pre-trained language models (PLMs) are the go-to solution to tackle many natural language processing problems, they are still very limited in their ability to capture and to use common-sense knowledge. In fact, even if information is…

Artificial Intelligence · Computer Science 2021-09-28 Mohammed Saeed , Naser Ahmadi , Preslav Nakov , Paolo Papotti

Script learning studies how stereotypical events unfold, enabling machines to reason about narratives with implicit information. Previous works mostly consider a script as a linear sequence of events while ignoring the potential branches…

Artificial Intelligence · Computer Science 2024-03-19 Zhaoyi Joey Hou , Li Zhang , Chris Callison-Burch

While LLMs have shown great success in understanding and generating text in traditional conversational settings, their potential for performing ill-defined complex tasks is largely under-studied. Indeed, we are yet to conduct comprehensive…

Artificial Intelligence · Computer Science 2023-10-26 Shubhra Kanti Karmaker Santu , Dongji Feng

Knowledge-enhanced Pre-trained Language Model (PLM) has recently received significant attention, which aims to incorporate factual knowledge into PLMs. However, most existing methods modify the internal structures of fixed types of PLMs by…

Computation and Language · Computer Science 2022-10-18 Jianing Wang , Wenkang Huang , Qiuhui Shi , Hongbin Wang , Minghui Qiu , Xiang Li , Ming Gao

Large language models (LLMs) acquire knowledge across diverse domains such as science, history, and geography encountered during generative pre-training. However, due to their stochasticity, it is difficult to predict what LLMs have…

Computation and Language · Computer Science 2026-01-27 Kartik Sharma , Yiqiao Jin , Rakshit Trivedi , Srijan Kumar

In light of the success of the pre-trained language models (PLMs), continual pre-training of generic PLMs has been the paradigm of domain adaption. In this paper, we propose QUERT, A Continual Pre-trained Language Model for QUERy…

Computation and Language · Computer Science 2023-06-13 Jian Xie , Yidan Liang , Jingping Liu , Yanghua Xiao , Baohua Wu , Shenghua Ni

In this work, we investigate the effectiveness of injecting external knowledge to a large language model (LLM) to identify semantic plausibility of simple events. Specifically, we enhance the LLM with fine-grained entity types, event types…

Computation and Language · Computer Science 2024-09-02 Chong Shen , Chenyue Zhou

Prompt engineering has emerged as an indispensable technique for extending the capabilities of large language models (LLMs) and vision-language models (VLMs). This approach leverages task-specific instructions, known as prompts, to enhance…

Artificial Intelligence · Computer Science 2025-03-18 Pranab Sahoo , Ayush Kumar Singh , Sriparna Saha , Vinija Jain , Samrat Mondal , Aman Chadha

Pre-trained Language Models (PLMs) are trained on vast unlabeled data, rich in world knowledge. This fact has sparked the interest of the community in quantifying the amount of factual knowledge present in PLMs, as this explains their…

Computation and Language · Computer Science 2023-12-06 Paul Youssef , Osman Alperen Koraş , Meijie Li , Jörg Schlötterer , Christin Seifert

Introductory programming courses often rely on small code-writing exercises that have clearly specified problem statements. This limits opportunities for students to practice how to clarify ambiguous requirements -- a critical skill in…

Human-Computer Interaction · Computer Science 2025-04-17 Paul Denny , Viraj Kumar , Stephen MacNeil , James Prather , Juho Leinonen

We introduce the concept of protoknowledge to formalize and measure how sequences of tokens encoding Knowledge Graphs are internalized during pretraining and utilized at inference time by Large Language Models (LLMs). Indeed, LLMs have…

Computation and Language · Computer Science 2025-05-22 Federico Ranaldi , Andrea Zugarini , Leonardo Ranaldi , Fabio Massimo Zanzotto

Simile interpretation (SI) and simile generation (SG) are challenging tasks for NLP because models require adequate world knowledge to produce predictions. Previous works have employed many hand-crafted resources to bring knowledge-related…

Computation and Language · Computer Science 2022-04-28 Weijie Chen , Yongzhu Chang , Rongsheng Zhang , Jiashu Pu , Guandan Chen , Le Zhang , Yadong Xi , Yijiang Chen , Chang Su

Augmenting large language models (LLMs) with user-specific knowledge is crucial for real-world applications, such as personal AI assistants. However, LLMs inherently lack mechanisms for prompt-driven knowledge capture. This paper…

Computation and Language · Computer Science 2024-02-02 Tolga Çöplü , Arto Bendiken , Andrii Skomorokhov , Eduard Bateiko , Stephen Cobb , Joshua J. Bouw

This paper investigates models of event implications. Specifically, how well models predict entity state-changes, by targeting their understanding of physical attributes. Nominally, Large Language models (LLM) have been exposed to…

Computation and Language · Computer Science 2022-11-11 Evangelia Spiliopoulou , Artidoro Pagnoni , Yonatan Bisk , Eduard Hovy

Large Language Models (LLMs) are increasingly ubiquitous, yet their ability to retain and reason about temporal information remains limited, hindering their application in real-world scenarios where understanding the sequential nature of…

Computation and Language · Computer Science 2024-07-08 Himanshu Beniwal , Dishant Patel , Kowsik Nandagopan D , Hritik Ladia , Ankit Yadav , Mayank Singh

Language models (LMs) increasingly drive real-world applications that require world knowledge. However, the internal processes through which models turn data into representations of knowledge and beliefs about the world, are poorly…

Computation and Language · Computer Science 2025-09-04 Daniela Gottesman , Alon Gilae-Dotan , Ido Cohen , Yoav Gur-Arieh , Marius Mosbach , Ori Yoran , Mor Geva