English
Related papers

Related papers: Sequence Length is a Domain: Length-based Overfitt…

200 papers

A number of problems in the processing of sound and natural language, as well as in other areas, can be reduced to simultaneously reading an input sequence and writing an output sequence of generally different length. There are well…

Machine Learning · Computer Science 2022-02-17 Grzegorz Rypeść , Łukasz Lepak , Paweł Wawrzyński

The authors of (Cho et al., 2014a) have shown that the recently introduced neural network translation systems suffer from a significant drop in translation quality when translating long sentences, unlike existing phrase-based translation…

Computation and Language · Computer Science 2014-10-08 Jean Pouget-Abadie , Dzmitry Bahdanau , Bart van Merrienboer , Kyunghyun Cho , Yoshua Bengio

Knowledge tracing (KT) aims to predict students' responses to practices based on their historical question-answering behaviors. However, most current KT methods focus on improving overall AUC, leaving ample room for optimization in modeling…

Artificial Intelligence · Computer Science 2023-09-06 Moyu Zhang , Xinning Zhu , Chunhong Zhang , Feng Pan , Wenchen Qian , Hui Zhao

In this paper, we present a substantial step in better understanding the SOTA sequence-to-sequence (Seq2Seq) pretraining for neural machine translation~(NMT). We focus on studying the impact of the jointly pretrained decoder, which is the…

Computation and Language · Computer Science 2022-03-17 Wenxuan Wang , Wenxiang Jiao , Yongchang Hao , Xing Wang , Shuming Shi , Zhaopeng Tu , Michael Lyu

Pre-trained language models represented by the Transformer have been proven to possess strong base capabilities, and the representative self-attention mechanism in the Transformer has become a classic in sequence modeling architectures.…

Computation and Language · Computer Science 2025-10-27 Xin Lu , Yanyan Zhao , Si Wei , Shijin Wang , Bing Qin , Ting Liu

In a controlled experiment of sequence-to-sequence approaches for the task of sentence correction, we find that character-based models are generally more effective than word-based models and models that encode subword information via…

Computation and Language · Computer Science 2017-07-31 Allen Schmaltz , Yoon Kim , Alexander M. Rush , Stuart M. Shieber

Transformers have supplanted recurrent models in a large number of NLP tasks. However, the differences in their abilities to model different syntactic properties remain largely unknown. Past works suggest that LSTMs generalize very well on…

Computation and Language · Computer Science 2020-10-09 Satwik Bhattamishra , Kabir Ahuja , Navin Goyal

Training a deep neural network with a small amount of data is a challenging problem as it is vulnerable to overfitting. However, one of the practical difficulties that we often face is to collect many samples. Transfer learning is a…

Machine Learning · Computer Science 2020-07-13 Yunho Jeon , Yongseok Choi , Jaesun Park , Subin Yi , Dongyeon Cho , Jiwon Kim

This paper presents a new method for training sequence-to-sequence models for speech recognition and translation tasks. Instead of the traditional approach of training models on short segments containing only lowercase or partial…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Nithin Rao Koluguri , Travis Bartley , Hainan Xu , Oleksii Hrinchuk , Jagadeesh Balam , Boris Ginsburg , Georg Kucsko

Overparameterized transformer networks have obtained state of the art results in various natural language processing tasks, such as machine translation, language modeling, and question answering. These models contain hundreds of millions of…

Machine Learning · Computer Science 2019-09-26 Angela Fan , Edouard Grave , Armand Joulin

Large language models (LLMs) based on Transformer have been widely applied in the filed of natural language processing (NLP), demonstrating strong performance, particularly in handling short text tasks. However, when it comes to long…

Computation and Language · Computer Science 2025-07-09 Yijun Liu , Jinzheng Yu , Yang Xu , Zhongyang Li , Qingfu Zhu

A significant effort has been made to train neural networks that replicate algorithmic reasoning, but they often fail to learn the abstract concepts underlying these algorithms. This is evidenced by their inability to generalize to data…

Machine Learning · Computer Science 2020-10-26 Yujun Yan , Kevin Swersky , Danai Koutra , Parthasarathy Ranganathan , Milad Hashemi

Deep learning models usually require a huge amount of data. However, these large datasets are not always attainable. This is common in many challenging NLP tasks. Consider Neural Machine Translation, for instance, where curating such large…

Computation and Language · Computer Science 2020-07-09 Zaid Alyafeai , Maged Saeed AlShaibani , Irfan Ahmad

For years the model performance in machine learning obeyed a power-law relationship with the model size. For the consideration of parameter efficiency, recent studies focus on increasing model depth rather than width to achieve better…

Computation and Language · Computer Science 2023-05-11 Ye Lin , Shuhan Zhou , Yanyang Li , Anxiang Ma , Tong Xiao , Jingbo Zhu

Transformer language models typically operate with a fixed-length context window, which has grown in step with large-scale pretraining datasets. In the BabyLM Challenge, however, many past submissions have defaulted to using much shorter…

Computation and Language · Computer Science 2025-10-23 Suchir Salhan , Richard Diehl Martinez , Zébulon Goriely , Paula Buttery

Sequence-to-Sequence models were introduced to tackle many real-life problems like machine translation, summarization, image captioning, etc. The standard optimization algorithms are mainly based on example-to-example matching like maximum…

Computation and Language · Computer Science 2018-09-05 Wenhu Chen , Guanlin Li , Shujie Liu , Zhirui Zhang , Mu Li , Ming Zhou

Transformer network architecture has proven effective in speech enhancement. However, as its core module, self-attention suffers from quadratic complexity, making it infeasible for training on long speech utterances. In practical scenarios,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Qiquan Zhang , Hongxu Zhu , Xinyuan Qian , Eliathamby Ambikairajah , Haizhou Li

Most of modern neural machine translation (NMT) models are based on an encoder-decoder framework with an attention mechanism. While they perform well on standard datasets, they can have trouble in translation of long inputs that are rare or…

Computation and Language · Computer Science 2026-03-31 Shuhei Kondo , Katsuhito Sudoh , Yuji Matsumoto

Large Language Models (LLMs) have recently revolutionized the NLP field, while they still fall short in some specific down-stream tasks. In the work, we focus on utilizing LLMs to perform machine translation, where we observe that two…

Computation and Language · Computer Science 2024-10-10 Weichuan Wang , Zhaoyi Li , Defu Lian , Chen Ma , Linqi Song , Ying Wei

Extending the context length (i.e., the maximum supported sequence length) of LLMs is of paramount significance. To facilitate long context training of LLMs, sequence parallelism has emerged as an essential technique, which scatters each…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-12 Yujie Wang , Shiju Wang , Shenhan Zhu , Fangcheng Fu , Xinyi Liu , Xuefeng Xiao , Huixia Li , Jiashi Li , Faming Wu , Bin Cui