English
Related papers

Related papers: Structure-Guided Memory Consolidation for Mitigati…

200 papers

Selecting the right knowledge is critical when using large language models (LLMs) to solve domain-specific data analysis tasks. However, most retrieval-augmented approaches rely primarily on lexical or embedding similarity, which is often a…

Computation and Language · Computer Science 2026-04-28 Xinyi Huang

A systematic review identifies and collates various clinical studies and compares data elements and results in order to provide an evidence based answer for a particular clinical question. The process is manual and involves lot of time. A…

Information Retrieval · Computer Science 2016-06-22 Tanmay Basu , Shraman Kumar , Abhishek Kalyan , Priyanka Jayaswal , Pawan Goyal , Stephen Pettifer , Siddhartha R. Jonnalagadda

Instruction-tuned large language models have shown remarkable performance in aligning generated text with user intentions across various tasks. However, maintaining human-like discourse structure in the generated text remains a challenging…

Computation and Language · Computer Science 2023-12-20 Yinhong Liu , Yixuan Su , Ehsan Shareghi , Nigel Collier

Systematic literature reviews (SLRs) are at the heart of evidence-based research, setting the foundation for future research and practice. However, producing good quality timely contributions is a challenging and highly cognitive endeavor,…

Digital Libraries · Computer Science 2020-12-16 Maisie Badami , Marcos Baez , Shayan Zamanirad , Wei Kang

Objectives: An SLR is presented focusing on text mining based automation of SLR creation. The present review identifies the objectives of the automation studies and the aspects of those steps that were automated. In so doing, the various ML…

Information Retrieval · Computer Science 2023-08-01 Girish Sundaram , Daniel Berleant

Tasks involving text generation based on multiple input texts, such as multi-document summarization, long-form question answering and contemporary dialogue applications, challenge models for their ability to properly consolidate…

Computation and Language · Computer Science 2023-05-26 Eran Hirsch , Valentina Pyatkin , Ruben Wolhandler , Avi Caciularu , Asi Shefer , Ido Dagan

Constructivist epistemology argues that knowledge is actively constructed rather than passively copied. Despite the generative nature of Large Language Models (LLMs), most existing agent memory systems are still based on dense retrieval.…

Computation and Language · Computer Science 2026-04-23 Lei Zheng , Weinan Song , Daili Li , Yanming Yang

In-Memory Computing (IMC) introduces a new paradigm of computation that offers high efficiency in terms of latency and power consumption for AI accelerators. However, the non-idealities and defects of emerging technologies used in advanced…

Federated learning (FL) enables distributed model training, yet in heterogeneous deployments, Bandwidth-Constrained Clients (BCCs) often contribute inefficiently due to limited uplink bandwidth. In model-heterogeneous FL with fixed small…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Chengjie Ma , Seungeun Oh , Jihong Park , Seong-Lyun Kim

This paper addresses the limitations of large language models in understanding long-term context. It proposes a model architecture equipped with a long-term memory mechanism to improve the retention and retrieval of semantic information…

Computation and Language · Computer Science 2025-05-30 Yue Xing , Tao Yang , Yijiashun Qi , Minggu Wei , Yu Cheng , Honghui Xin

Large Language Models (LLMs) are constrained by their inability to process lengthy inputs, resulting in the loss of critical historical information. To address this limitation, in this paper, we propose the Self-Controlled Memory (SCM)…

Computation and Language · Computer Science 2025-03-19 Bing Wang , Xinnian Liang , Jian Yang , Hui Huang , Shuangzhi Wu , Peihao Wu , Lu Lu , Zejun Ma , Zhoujun Li

Recursive self-modification is increasingly central in AutoML, neural architecture search, and adaptive optimization, yet no existing framework ensures that such changes are made safely. Godel machines offer a principled safeguard by…

Machine Learning · Computer Science 2025-10-14 Xuening Wu , Shenqin Yin , Yanlan Kang , Xinhang Zhang , Qianya Xu , Zeping Chen , Wenqiang Zhang

In Continual Learning (CL), a model is required to learn a stream of tasks sequentially without significant performance degradation on previously learned tasks. Current approaches fail for a long sequence of tasks from diverse domains and…

Machine Learning · Computer Science 2023-05-29 Iordanis Fostiropoulos , Jiaye Zhu , Laurent Itti

The organization of latent knowledge within large-scale models poses unique challenges when addressing overlapping representations and optimizing contextual accuracy. Conceptual redundancies embedded across layers often result in…

Computation and Language · Computer Science 2025-03-26 Joseph Sakau , Evander Kozlowski , Roderick Thistledown , Basil Steinberger

Cross-modal retrieval (CMR) is a fundamental task in multimedia research, focused on retrieving semantically relevant targets across different modalities. While traditional CMR methods match text and image via embedding-based similarity…

Information Retrieval · Computer Science 2025-04-18 Haoxuan Li , Yi Bin , Yunshan Ma , Guoqing Wang , Yang Yang , See-Kiong Ng , Tat-Seng Chua

Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of training cost and deployment effort. Context compression is also a challenging and pressing…

Computation and Language · Computer Science 2026-05-13 Zhongtao Miao , Qiyu Wu , Yoshimasa Tsuruoka

Structured data question answering (QA), including table QA, Knowledge Graph (KG) QA, and temporal KG QA, is a pivotal research area. Advances in large language models (LLMs) have driven significant progress in unified structural QA…

Computation and Language · Computer Science 2025-11-18 Yushan Zhu , Wen Zhang , Long Jin , Mengshu Sun , Ling Zhong , Zhiqiang Liu , Juan Li , Lei Liang , Chong Long , Chao Deng , Junlan Feng

Current LLM agents lack principled mechanisms for managing persistent memory across long interaction horizons. We present a biologically-grounded memory architecture comprising six cognitive mechanisms: (1) sleep-phase consolidation, (2)…

Artificial Intelligence · Computer Science 2026-05-12 Doga Kerestecioglu , Alexei Robsky , Clemens Vasters , Anshul Sharma , Yitzhak Kesselman

This research presents and compares multiple approaches to automate the generation of literature reviews using several Natural Language Processing (NLP) techniques and retrieval-augmented generation (RAG) with a Large Language Model (LLM).…

Computation and Language · Computer Science 2024-11-28 Nurshat Fateh Ali , Md. Mahdi Mohtasim , Shakil Mosharrof , T. Gopi Krishna

Multi-modal multi-hop question answering involves answering a question by reasoning over multiple input sources from different modalities. Existing methods often retrieve evidences separately and then use a language model to generate an…

Computation and Language · Computer Science 2023-08-08 Qian Yang , Qian Chen , Wen Wang , Baotian Hu , Min Zhang