English
Related papers

Related papers: A Dynamical Model for Information Retrieval and Em…

200 papers

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

Computation and Language · Computer Science 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

Continual incorporation of new knowledge is essential for the long-term evolution of large language models (LLMs). Existing approaches typically rely on parameter-update algorithms to mitigate catastrophic forgetting, yet they suffer from…

Machine Learning · Computer Science 2026-05-07 Kaustubh Pethkar , Ziyang Xiong , Zuofeng Shang , Yingcong Li

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

Computation and Language · Computer Science 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

Breakthroughs in deep learning and memory networks have made major advances in natural language understanding. Language is sequential and information carried through the sequence can be captured through memory networks. Learning the…

Computation and Language · Computer Science 2023-05-22 Anupiya Nugaliyadde

Large language models (LLMs) typically enhance their performance through either the retrieval of semantically similar information or the improvement of their reasoning capabilities. However, a significant challenge remains in effectively…

Artificial Intelligence · Computer Science 2026-01-05 Shuqi Liu , Bowei He , Chen Ma , Linqi Song

This paper investigates the role of dynamic external knowledge integration in improving counter-argument generation using Large Language Models (LLMs). While LLMs have shown promise in argumentative tasks, their tendency to generate…

Computation and Language · Computer Science 2025-06-23 Anar Yeginbergen , Maite Oronoz , Rodrigo Agerri

The research field of Information Retrieval (IR) has evolved significantly, expanding beyond traditional search to meet diverse user information needs. Recently, Large Language Models (LLMs) have demonstrated exceptional capabilities in…

Language Models (LMs) are important components in several Natural Language Processing systems. Recurrent Neural Network LMs composed of LSTM units, especially those augmented with an external memory, have achieved state-of-the-art results.…

Machine Learning · Computer Science 2018-10-11 Giancarlo D. Salton , John D. Kelleher

Large language models (LLMs) have demonstrated their ability to learn in-context, allowing them to perform various tasks based on a few input-output examples. However, the effectiveness of in-context learning is heavily reliant on the…

Computation and Language · Computer Science 2024-01-29 Liang Wang , Nan Yang , Furu Wei

The use of knowledge graphs in recommender systems has become one of the common approaches to addressing data sparsity and cold start problems. Recent advances in large language models (LLMs) offer new possibilities for processing side and…

Information Retrieval · Computer Science 2025-02-13 Minhye Jeon , Seokho Ahn , Young-Duk Seo

The increasing volume of scholarly publications requires advanced tools for efficient knowledge discovery and management. This paper introduces ongoing work on a system using Large Language Models (LLMs) for the semantic extraction of key…

Digital Libraries · Computer Science 2025-10-07 Samy Ateia , Udo Kruschwitz , Melanie Scholz , Agnes Koschmider , Moayad Almohaishi

Large Language Models (LLMs) can be seen as compressed knowledge bases, but it remains unclear what knowledge they truly contain and how far their knowledge boundary extends. Existing benchmarks are mostly static and provide limited support…

Machine Learning · Computer Science 2026-05-27 Yuheng Yang , Siqi Zhu , Tao Feng , Ge Liu , Jiaxuan You

Generative Large Language Models (LLMs) are a promising approach to structuring knowledge contained within the corpora of research literature produced by large-scale and long-running scientific collaborations. Within experimental particle…

High Energy Physics - Experiment · Physics 2025-09-09 James McGreivy , Blaise Delaney , Anja Beck , Mike Williams

Low sample efficiency is an enduring challenge of reinforcement learning (RL). With the advent of versatile large language models (LLMs), recent works impart common-sense knowledge to accelerate policy learning for RL processes. However, we…

Computation and Language · Computer Science 2024-07-08 Fuxiang Zhang , Junyou Li , Yi-Chen Li , Zongzhang Zhang , Yang Yu , Deheng Ye

Intelligently extracting and linking complex scientific information from unstructured text is a challenging endeavor particularly for those inexperienced with natural language processing. Here, we present a simple sequence-to-sequence…

Computation and Language · Computer Science 2022-12-13 Alexander Dunn , John Dagdelen , Nicholas Walker , Sanghoon Lee , Andrew S. Rosen , Gerbrand Ceder , Kristin Persson , Anubhav Jain

The chain-structured long short-term memory (LSTM) has showed to be effective in a wide range of problems such as speech recognition and machine translation. In this paper, we propose to extend it to tree structures, in which a memory cell…

Computation and Language · Computer Science 2015-03-18 Xiaodan Zhu , Parinaz Sobhani , Hongyu Guo

The large set of technical documentation of legacy accelerator systems, coupled with the retirement of experienced personnel, underscores the urgent need for efficient methods to preserve and transfer specialized knowledge. This paper…

Information Retrieval · Computer Science 2025-09-03 Qing Dai , Rasmus Ischebeck , Maruisz Sapinski , Adam Grycner

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

Computation and Language · Computer Science 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

Long-horizon applications increasingly require large language models (LLMs) to answer queries when relevant evidence is sparse and dispersed across very long contexts. Existing memory systems largely follow two paradigms: explicit…

Computation and Language · Computer Science 2026-01-08 Xin Zhang , Kailai Yang , Hao Li , Chenyue Li , Qiyu Wei , Sophia Ananiadou

Large Language Models (LLMs) are transforming information extraction from academic literature, offering new possibilities for knowledge management. This study presents an LLM-based system designed to extract detailed information about…

Information Retrieval · Computer Science 2025-05-29 Jiseung Yoo , Curran Mahowald , Meiyu Li , Wei Ai