English
Related papers

Related papers: Enhancing RWKV-based Language Models for Long-Sequ…

200 papers

Recent advancements in neural sequence modeling have led to architectures such as RWKV, which combine recurrent-style time mixing with feedforward channel mixing to enable efficient long-context processing. In this work, we propose…

Quantum Physics · Physics 2025-06-03 Chi-Sheng Chen , En-Jui Kuo

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency…

Computation and Language · Computer Science 2025-04-29 Jacky He , Guiran Liu , Binrong Zhu , Hanlu Zhang , Hongye Zheng , Xiaokai Wang

Modern large language models (LLMs) are inherently auto-regressive, requiring input to be serialized into flat sequences regardless of their structural dependencies. This serialization hinders the model's ability to leverage structural…

Machine Learning · Computer Science 2026-01-13 Haoyu Wang , Peihao Wang , Mufei Li , Shikun Liu , Siqi Miao , Zhangyang Wang , Pan Li

Document-level machine translation leverages inter-sentence dependencies to produce more coherent and consistent translations. However, these models, predominantly based on transformers, are difficult to scale to long documents as their…

Computation and Language · Computer Science 2022-10-18 Zhaofeng Wu , Hao Peng , Nikolaos Pappas , Noah A. Smith

Autoregressive Transformers rely on Key-Value (KV) caching to accelerate inference. However, the linear growth of the KV cache with context length leads to excessive memory consumption and bandwidth constraints. This bottleneck is…

Computation and Language · Computer Science 2025-06-10 Ravi Ghadia , Avinash Kumar , Gaurav Jain , Prashant Nair , Poulami Das

As Large Language Models (LLMs) scale to support context windows exceeding one million tokens, the linear growth of Key-Value (KV) cache imposes severe memory capacity and bandwidth bottlenecks, constraining the efficiency of long-context…

Computation and Language · Computer Science 2026-04-09 Zhirui Chen , Peiyang Liu , Ling Shao

The Neural Contextual Reinforcement Framework introduces an innovative approach to enhancing the logical coherence and structural consistency of text generated by large language models. Leveraging reinforcement learning principles, the…

Computation and Language · Computer Science 2025-08-11 Marcus Irvin , William Cooper , Edward Hughes , Jessica Morgan , Christopher Hamilton

Current temporal knowledge graph question answering (TKGQA) methods primarily focus on implicit temporal constraints, lacking the capability of handling more complex temporal queries, and struggle with limited reasoning abilities and error…

Computation and Language · Computer Science 2025-09-05 Zhaoyan Gong , Juan Li , Zhiqiang Liu , Lei Liang , Huajun Chen , Wen Zhang

Computational efficiency has remained a critical consideration in scaling high-capacity language models, with inference latency and resource consumption presenting significant constraints on real-time applications. The study has introduced…

Computation and Language · Computer Science 2025-03-26 Michael Mangrum , Jonathan Pemberton , Benedict Wetherby , Philip Montague

Self-modulating mechanisms introduce dynamic adaptation capabilities within language models through contextual realignment strategies that influence token embedding trajectories across extended sequences. Contextual Flux is explored as an…

Computation and Language · Computer Science 2025-08-11 Henry Evidail , Zachary Mountebank , Alistair Hathersage , Peter Stanhope , Basil Ravenscroft , Tobias Waddingham

We present a Transformer architecture for long-context language modeling that combines global attention with two biologically inspired components: chunked local attention and a gated FIFO memory mechanism. This unified attention block…

Machine Learning · Computer Science 2025-07-02 Ankit Kashyap

Transformers have revolutionized computer vision and natural language processing, but their high computational complexity limits their application in high-resolution image processing and long-context analysis. This paper introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuchen Duan , Weiyun Wang , Zhe Chen , Xizhou Zhu , Lewei Lu , Tong Lu , Yu Qiao , Hongsheng Li , Jifeng Dai , Wenhai Wang

Recent years have witnessed much interest in temporal reasoning over knowledge graphs (KG) for complex question answering (QA), but there remains a substantial gap in human capabilities. We explore how to generalize relational graph…

Computation and Language · Computer Science 2023-10-09 Aditya Sharma , Apoorv Saxena , Chitrank Gupta , Seyed Mehran Kazemi , Partha Talukdar , Soumen Chakrabarti

This paper investigates the efficacy of RWKV, a novel language model architecture known for its linear attention mechanism, for generating sentence embeddings in a zero-shot setting. I conduct a layer-wise analysis to evaluate the semantic…

Computation and Language · Computer Science 2025-02-21 Xinghan Pan

This paper introduces a novel approach to efficiently feeding knowledge to language models (LLMs) during prediction by integrating retrieval and generation processes within a unified framework. While the Retrieval-Augmented Generation (RAG)…

Computation and Language · Computer Science 2025-02-11 S Santosh Kumar , Rishi Gottimukkala , Supriya Devidutta , Karthikeyan S

Traditional Transformers face a major bottleneck in long-sequence time series forecasting due to their quadratic complexity $(\mathcal{O}(T^2))$ and their limited ability to effectively exploit frequency-domain information. Inspired by…

Machine Learning · Computer Science 2025-12-10 Qingyuan Yang , Shizhuo Deng , Dongyue Chen , Da Teng , Zehua Gan

Machine learning architectures, including transformers and recurrent neural networks (RNNs) have revolutionized forecasting in applications ranging from text processing to extreme weather. Notably, advanced network architectures, tuned for…

Machine Learning · Computer Science 2024-10-04 Hunter S. Heidenreich , Pantelis R. Vlachas , Petros Koumoutsakos

State-based sequence models like RWKV-7 offer a compelling alternative to Transformer architectures, achieving linear complexity while demonstrating greater expressive power in short-context scenarios and enabling state tracking beyond the…

Machine Learning · Computer Science 2025-04-14 Liu Xiao , Li Zhiyuan , Lin Yueyu

Incorporating prior knowledge can improve existing pre-training models in cloze-style machine reading and has become a new trend in recent studies. Notably, most of the existing models have integrated external knowledge graphs (KG) and…

Computation and Language · Computer Science 2023-09-25 Shima Foolad , Kourosh Kiani

Many advances in Natural Language Processing have been based upon more expressive models for how inputs interact with the context in which they occur. Recurrent networks, which have enjoyed a modicum of success, still lack the…

Computation and Language · Computer Science 2020-01-30 Gábor Melis , Tomáš Kočiský , Phil Blunsom