English
Related papers

Related papers: Sequence Length is a Domain: Length-based Overfitt…

200 papers

The Transformer model has a tendency to overfit various aspects of the training data, such as the overall sequence length. We study elementary string edit functions using a defined set of error indicators to interpret the behaviour of the…

Machine Learning · Computer Science 2024-10-18 Patrik Zavoral , Dušan Variš , Ondřej Bojar

Despite the remarkable practical success of transformer-based language models, recent work has raised concerns about their ability to perform state tracking. In particular, a growing body of literature has shown this limitation primarily…

Machine Learning · Computer Science 2026-02-23 M. Reza Ebrahimi , Michaël Defferrard , Sunny Panchal , Roland Memisevic

Classification algorithms using Transformer architectures can be affected by the sequence length learning problem whenever observations from different classes have a different length distribution. This problem causes models to use sequence…

Machine Learning · Computer Science 2024-03-15 Jean-Thomas Baillargeon , Luc Lamontagne

Length generalization, defined as the ability to extrapolate from shorter training sequences to longer test ones, is a significant challenge for language models. This issue persists even with large-scale Transformers handling relatively…

Machine Learning · Computer Science 2024-02-15 Yongchao Zhou , Uri Alon , Xinyun Chen , Xuezhi Wang , Rishabh Agarwal , Denny Zhou

We study the problem of length generalization (LG) in transformers: the ability of a model trained on shorter sequences to maintain performance when evaluated on much longer, previously unseen inputs. Prior work by Huang et al. (2025)…

Machine Learning · Computer Science 2025-11-03 Zachary Izzo , Eshaan Nichani , Jason D. Lee

Large language models (LLMs) have exhibited impressive performance and surprising emergent properties. However, their effectiveness remains limited by the fixed context window of the transformer architecture, posing challenges for…

Computation and Language · Computer Science 2025-06-16 Tianqi Du , Haotian Huang , Yifei Wang , Yisen Wang

Transformers have theoretical limitations in modeling certain sequence-to-sequence tasks, yet it remains largely unclear if these limitations play a role in large-scale pretrained LLMs, or whether LLMs might effectively overcome these…

Machine Learning · Computer Science 2025-10-24 Mayank Jobanputra , Yana Veitsman , Yash Sarrof , Aleksandra Bakalova , Vera Demberg , Ellie Pavlick , Michael Hahn

Transformer models cannot easily scale to long sequences due to their O(N^2) time and space complexity. This has led to Transformer variants seeking to lower computational complexity, such as Longformer and Performer. While such models have…

Computation and Language · Computer Science 2024-12-10 Guanghui Qin , Yukun Feng , Benjamin Van Durme

Transformer architectures are increasingly effective at processing and generating very long chunks of texts, opening new perspectives for document-level machine translation (MT). In this work, we challenge the ability of MT systems to…

Computation and Language · Computer Science 2025-04-29 Ziqian Peng , Rachel Bawden , François Yvon

Short fixed-length inputs are the main bottleneck of deep learning methods in long time-series forecasting tasks. Prolonging input length causes overfitting, rapidly deteriorating accuracy. Our research indicates that the overfitting is a…

Machine Learning · Computer Science 2025-09-05 Chao Ma , Yikai Hou , Xiang Li , Yinggang Sun , Haining Yu

It is a widely known issue that Transformers, when trained on shorter sequences, fail to generalize robustly to longer ones at test time. This raises the question of whether Transformer models are real reasoning engines, despite their…

Machine Learning · Computer Science 2025-04-04 Ruining Li , Gabrijel Boduljak , Jensen , Zhou

Transformer architectures have facilitated the development of large-scale and general-purpose sequence models for prediction tasks in natural language processing and computer vision, e.g., GPT-3 and Swin Transformer. Although originally…

Machine Learning · Computer Science 2023-06-27 Muning Wen , Runji Lin , Hanjing Wang , Yaodong Yang , Ying Wen , Luo Mai , Jun Wang , Haifeng Zhang , Weinan Zhang

Despite success in many domains, neural models struggle in settings where train and test examples are drawn from different distributions. In particular, in contrast to humans, conventional sequence-to-sequence (seq2seq) models fail to…

Computation and Language · Computer Science 2021-10-28 Bailin Wang , Mirella Lapata , Ivan Titov

The transformer has been shown to outperform recurrent neural network-based sequence-to-sequence models in various word-level NLP tasks. Yet for character-level transduction tasks, e.g. morphological inflection generation and historical…

Computation and Language · Computer Science 2021-01-29 Shijie Wu , Ryan Cotterell , Mans Hulden

Various methods using machine and deep learning have been proposed to tackle different tasks in predictive process monitoring, forecasting for an ongoing case e.g. the most likely next event or suffix, its remaining time, or an…

Machine Learning · Computer Science 2022-12-14 Jari Peeperkorn , Seppe vanden Broucke , Jochen De Weerdt

The recent advances introduced by neural machine translation (NMT) are rapidly expanding the application fields of machine translation, as well as reshaping the quality level to be targeted. In particular, if translations have to fit some…

Computation and Language · Computer Science 2019-10-28 Surafel Melaku Lakew , Mattia Di Gangi , Marcello Federico

Models such as Sequence-to-Sequence and Image-to-Sequence are widely used in real world applications. While the ability of these neural architectures to produce variable-length outputs makes them extremely effective for problems like…

Machine Learning · Computer Science 2019-04-30 Chenglong Wang , Rudy Bunel , Krishnamurthy Dvijotham , Po-Sen Huang , Edward Grefenstette , Pushmeet Kohli

This article describes our experiments in neural machine translation using the recent Tensor2Tensor framework and the Transformer sequence-to-sequence model (Vaswani et al., 2017). We examine some of the critical parameters that affect the…

Computation and Language · Computer Science 2018-05-03 Martin Popel , Ondřej Bojar

This paper introduces the counter-intuitive generalization results of overfitting pre-trained large language models (LLMs) on very small datasets. In the setting of open-ended text generation, it is well-documented that LLMs tend to…

Computation and Language · Computer Science 2025-02-27 Fredrik Carlsson , Fangyu Liu , Daniel Ward , Murathan Kurfali , Joakim Nivre

Sequence-to-sequence transduction is the core problem in language processing applications as diverse as semantic parsing, machine translation, and instruction following. The neural network models that provide the dominant solution to these…

Computation and Language · Computer Science 2021-06-09 Ekin Akyürek , Jacob Andreas
‹ Prev 1 2 3 10 Next ›