English
Related papers

Related papers: Efficient Knowledge Probing of Large Language Mode…

200 papers

Contemporary recommendation systems predominantly rely on ID embedding to capture latent associations among users and items. However, this approach overlooks the wealth of semantic information embedded within textual descriptions of items,…

Information Retrieval · Computer Science 2024-12-30 Jian Jia , Yipei Wang , Yan Li , Honggang Chen , Xuehan Bai , Zhaocheng Liu , Jian Liang , Quan Chen , Han Li , Peng Jiang , Kun Gai

While pre-trained language models (LMs) have brought great improvements in many NLP tasks, there is increasing attention to explore capabilities of LMs and interpret their predictions. However, existing works usually focus only on a certain…

Computation and Language · Computer Science 2022-07-29 Yaozong Shen , Lijie Wang , Ying Chen , Xinyan Xiao , Jing Liu , Hua Wu

As the applications of large language models (LLMs) expand across diverse fields, the ability of these models to adapt to ongoing changes in data, tasks, and user preferences becomes crucial. Traditional training methods, relying on static…

Machine Learning · Computer Science 2024-06-11 Junhao Zheng , Shengjie Qiu , Chengming Shi , Qianli Ma

Large language models (LLMs) can make predictions using parametric knowledge--knowledge encoded in the model weights--or contextual knowledge--knowledge presented in the context. In many scenarios, a desirable behavior is that LLMs give…

Computation and Language · Computer Science 2024-03-27 Yingfa Chen , Zhengyan Zhang , Xu Han , Chaojun Xiao , Zhiyuan Liu , Chen Chen , Kuai Li , Tao Yang , Maosong Sun

Large language models (LLMs) have demonstrated remarkable proficiency in understanding and generating responses to complex queries through large-scale pre-training. However, the efficacy of these models in memorizing and reasoning among…

Computation and Language · Computer Science 2024-02-23 Qiyuan He , Yizhong Wang , Wenya Wang

Large language models (LLMs) frequently encode factual and reasoning knowledge in their internal representations that is not faithfully reflected in their surface-level outputs -- a phenomenon known as \emph{latent knowledge}. Existing…

Computation and Language · Computer Science 2026-05-29 Ji-jun Park , Soo-joon Choi , Jiwon Jeong , Taeyang Yoon , Ju-Wan Lee

Large Language Models (LLMs) and pre-trained Language Models (LMs) have achieved impressive success on many software engineering tasks (e.g., code completion and code generation). By leveraging huge existing code corpora (e.g., GitHub),…

Software Engineering · Computer Science 2025-01-16 Xin Yin , Chao Ni , Xiaodan Xu , Xinrui Li , Xiaohu Yang

Since the advent of Large Language Models (LLMs), efforts have largely focused on improving their instruction-following and deductive reasoning abilities, leaving open the question of whether these models can truly discover new knowledge.…

Computation and Language · Computer Science 2025-10-31 Kaiyu He , Zhiyu Chen

Large language models (LLMs) have shown impressive prowess in solving a wide range of tasks with world knowledge. However, it remains unclear how well LLMs are able to perceive their factual knowledge boundaries, particularly under…

Computation and Language · Computer Science 2024-11-20 Ruiyang Ren , Yuhao Wang , Yingqi Qu , Wayne Xin Zhao , Jing Liu , Hao Tian , Hua Wu , Ji-Rong Wen , Haifeng Wang

Though large language models (LLMs) have enabled great success across a wide variety of tasks, they still appear to fall short of one of the loftier goals of artificial intelligence research: creating an artificial system that can adapt its…

Computation and Language · Computer Science 2026-05-04 Michael A. Lepori , Tal Linzen , Ann Yuan , Katja Filippova

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge…

Computation and Language · Computer Science 2024-01-31 Linyao Yang , Hongyang Chen , Zhao Li , Xiao Ding , Xindong Wu

In sequential decision-making (SDM) tasks, methods like reinforcement learning (RL) and heuristic search have made notable advances in specific cases. However, they often require extensive exploration and face challenges in generalizing…

Machine Learning · Computer Science 2024-10-11 Xue Yan , Yan Song , Xidong Feng , Mengyue Yang , Haifeng Zhang , Haitham Bou Ammar , Jun Wang

Large language models learn and continually learn through the accumulation of gradient-based updates, but how individual pieces of new information affect existing knowledge, leading to both beneficial generalization and problematic…

Computation and Language · Computer Science 2025-04-15 Chen Sun , Renat Aksitov , Andrey Zhmoginov , Nolan Andrew Miller , Max Vladymyrov , Ulrich Rueckert , Been Kim , Mark Sandler

Previous literature has proved that Pretrained Language Models (PLMs) can store factual knowledge. However, we find that facts stored in the PLMs are not always correct. It motivates us to explore a fundamental question: How do we calibrate…

Computation and Language · Computer Science 2022-10-19 Qingxiu Dong , Damai Dai , Yifan Song , Jingjing Xu , Zhifang Sui , Lei Li

Large language models (LLMs) encode parametric knowledge about world facts and have shown remarkable performance in knowledge-driven NLP tasks. However, their reliance on parametric knowledge may cause them to overlook contextual cues,…

Computation and Language · Computer Science 2023-10-24 Wenxuan Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

We study how large language models (LLMs) reason about memorized knowledge through simple binary relations such as equality ($=$), inequality ($<$), and inclusion ($\subset$). Unlike in-context reasoning, the axioms (e.g., $a < b, b < c$)…

Machine Learning · Computer Science 2025-09-18 Jonathan Shaki , Emanuele La Malfa , Michael Wooldridge , Sarit Kraus

In this paper, we investigate the feasibility of leveraging large language models (LLMs) for integrating general knowledge and incorporating pseudo-events as priors for temporal content distribution in video moment retrieval (VMR) models.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yiyang Jiang , Wengyu Zhang , Xulu Zhang , Xiaoyong Wei , Chang Wen Chen , Qing Li

Knowledge Base, represents facts about the world, often in some form of subsumption ontology, rather than implicitly, embedded in procedural code, the way a conventional computer program does. While there is a rapid growth in knowledge…

Computation and Language · Computer Science 2020-10-20 Sai Sharath Japa , Rekabdar Banafsheh

Large language models (LLMs) call for extension of context to handle many critical applications. However, the existing approaches are prone to expensive costs and inferior quality of context extension. In this work, we proposeExtensible…

Computation and Language · Computer Science 2024-02-20 Kun Luo , Zheng Liu , Shitao Xiao , Kang Liu

Despite the increasing prevalence of large language models (LLMs), we still have a limited understanding of how their representational spaces are structured. This limits our ability to interpret how and what they learn or relate them to…