English
Related papers

Related papers: TRAMS: Training-free Memory Selection for Long-ran…

200 papers

In this work, we propose a training-free method to inject visual prompts into Multimodal Large Language Models (MLLMs) through test-time optimization of a learnable latent variable. We observe that attention, as the core module of MLLMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Mingrui Wu , Xinyue Cai , Jiayi Ji , Jiale Li , Oucheng Huang , Gen Luo , Hao Fei , Guannan Jiang , Xiaoshuai Sun , Rongrong Ji

The computing cost of transformer self-attention often necessitates breaking long documents to fit in pretrained models in document ranking tasks. In this paper, we design Query-Directed Sparse attention that induces IR-axiomatic structures…

Artificial Intelligence · Computer Science 2020-10-27 Jyun-Yu Jiang , Chenyan Xiong , Chia-Jung Lee , Wei Wang

Reward specification plays a central role in reinforcement learning (RL), guiding the agent's behavior. To express non-Markovian rewards, formalisms such as reward machines have been introduced to capture dependencies on histories. However,…

Artificial Intelligence · Computer Science 2026-05-13 Rajarshi Roy , Anirban Majumdar , Ritam Raha , David Parker , Marta Kwiatkowska

The Transformer architecture has significantly advanced deep learning, particularly in natural language processing, by effectively managing long-range dependencies. However, as the demand for understanding complex relationships grows,…

Computation and Language · Computer Science 2024-06-18 Qian Chen , Wen Wang , Qinglin Zhang , Siqi Zheng , Shiliang Zhang , Chong Deng , Hai Yu , Jiaqing Liu , Yukun Ma , Chong Zhang

This paper presents a novel approach that leverages Transformer-based multivariate time series model and Machine Learning Ensembles to predict the quality of human sleep, emotional states, and stress levels. A formula to calculate the…

Machine Learning · Computer Science 2024-10-16 Jinjae Kim , Minjeong Ma , Eunjee Choi , Keunhee Cho , Chanwoo Lee

Transformer-based models have been achieving state-of-the-art results in several fields of Natural Language Processing. However, its direct application to speech tasks is not trivial. The nature of this sequences carries problems such as…

Computation and Language · Computer Science 2022-05-17 Gerard Sant , Gerard I. Gállego , Belen Alastruey , Marta R. Costa-Jussà

The quadratic computational complexity of self-attention remains a fundamental bottleneck for scaling Large Language Models (LLMs) to long contexts, particularly during the pre-filling phase. In this paper, we rethink the causal attention…

Machine Learning · Computer Science 2026-03-09 Lin Niu , Xin Luo , Linchuan Xie , Yifu Sun , Guanghua Yu , Jianchen Zhu , S Kevin Zhou

We propose a novel class of language models, Latent Thought Models (LTMs), which incorporate explicit latent thought vectors that follow an explicit prior model in latent space. These latent thought vectors guide the autoregressive…

Computation and Language · Computer Science 2025-06-10 Deqian Kong , Minglu Zhao , Dehong Xu , Bo Pang , Shu Wang , Edouardo Honig , Zhangzhang Si , Chuan Li , Jianwen Xie , Sirui Xie , Ying Nian Wu

Large Transformer models routinely achieve state-of-the-art results on a number of tasks but training these models can be prohibitively costly, especially on long sequences. We introduce two techniques to improve the efficiency of…

Machine Learning · Computer Science 2020-02-19 Nikita Kitaev , Łukasz Kaiser , Anselm Levskaya

We explore neural language modeling for speech recognition where the context spans multiple sentences. Rather than encode history beyond the current sentence using a cache of words or document-level features, we focus our study on the…

Computation and Language · Computer Science 2019-11-13 Sarangarajan Parthasarathy , William Gale , Xie Chen , George Polovets , Shuangyu Chang

Transformer-based models are widely used in natural language processing (NLP). Central to the transformer model is the self-attention mechanism, which captures the interactions of token pairs in the input sequences and depends quadratically…

Machine Learning · Computer Science 2021-11-19 Zhanpeng Zeng , Yunyang Xiong , Sathya N. Ravi , Shailesh Acharya , Glenn Fung , Vikas Singh

While large pretrained Transformer models have proven highly capable at tackling natural language tasks, handling long sequence inputs continues to be a significant challenge. One such task is long input summarization, where inputs are…

Computation and Language · Computer Science 2022-08-10 Jason Phang , Yao Zhao , Peter J. Liu

Training and serving long-context large language models (LLMs) incurs substantial overhead. To address this, two critical steps are often required: a pretrained LLM typically undergoes a separate stage for context length extension by…

Computation and Language · Computer Science 2024-12-06 Suyu Ge , Xihui Lin , Yunan Zhang , Jiawei Han , Hao Peng

Transformer-based architectures are the most used architectures in many deep learning fields like Natural Language Processing, Computer Vision or Speech processing. It may encourage the direct use of Transformers in the constrained tasks,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-29 Youness Dkhissi , Valentin Vielzeuf , Elys Allesiardo , Anthony Larcher

Large Language Models (LLMs) have the capacity to store and recall facts. Through experimentation with open-source models, we observe that this ability to retrieve facts can be easily manipulated by changing contexts, even without altering…

Computation and Language · Computer Science 2024-12-02 Yibo Jiang , Goutham Rajendran , Pradeep Ravikumar , Bryon Aragam

In this paper we address the question of how to render sequence-level networks better at handling structured input. We propose a machine reading simulator which processes text incrementally from left to right and performs shallow reasoning…

Computation and Language · Computer Science 2016-09-22 Jianpeng Cheng , Li Dong , Mirella Lapata

The rapid progress seen in terms of large-scale generative AI is largely based on the attention mechanism. It is conversely non-trivial to conceive small-scale applications for which attention-based architectures outperform traditional…

Machine Learning · Computer Science 2025-08-07 Claudius Gros

Deep learning is playing an increasingly important role in time series analysis. We focused on time series forecasting using attention free mechanism, a more efficient framework, and proposed a new architecture for time series prediction…

Machine Learning · Computer Science 2022-09-21 Hugo Inzirillo , Ludovic De Villelongue

Transformers have demonstrated great success in numerous domains including natural language processing and bioinformatics. This success stems from the use of the attention mechanism by these models in order to represent and propagate…

Machine Learning · Computer Science 2025-02-10 Nathaniel Tomczak , Sanmukh Kuppannagari

Pre-training language models (LMs) on large-scale unlabeled text data makes the model much easier to achieve exceptional downstream performance than their counterparts directly trained on the downstream tasks. In this work, we study what…

Computation and Language · Computer Science 2022-02-21 Cheng-Han Chiang , Hung-yi Lee