English
Related papers

Related papers: Scaling Laws of Decoder-Only Models on the Multili…

200 papers

Dual-encoder (DE) models are widely used in retrieval tasks, most commonly studied on open QA benchmarks that are often characterized by multi-class and limited training data. In contrast, their performance in multi-label and data-rich…

Machine Learning · Computer Science 2024-03-19 Nilesh Gupta , Devvrit Khatri , Ankit S Rawat , Srinadh Bhojanapalli , Prateek Jain , Inderjit Dhillon

The question of what kinds of linguistic information are encoded in different layers of Transformer-based language models is of considerable interest for the NLP community. Existing work, however, has overwhelmingly focused on word-level…

Computation and Language · Computer Science 2023-10-19 Dmitry Nikolaev , Sebastian Padó

Decoder-only large language models (LLMs) excel in high-resource languages across various tasks through few-shot or even zero-shot in-context learning (ICL). However, their performance often does not transfer well to low-resource languages,…

Computation and Language · Computer Science 2024-07-03 Chunlan Ma , Yihong Liu , Haotian Ye , Hinrich Schütze

We demonstrate the potential of few-shot translation systems, trained with unpaired language data, for both high and low-resource language pairs. We show that with only 5 examples of high-quality translation data shown at inference, a…

Computation and Language · Computer Science 2023-02-06 Xavier Garcia , Yamini Bansal , Colin Cherry , George Foster , Maxim Krikun , Fangxiaoyu Feng , Melvin Johnson , Orhan Firat

There is a recent trend in machine learning to increase model quality by growing models to sizes previously thought to be unreasonable. Recent work has shown that autoregressive generative models with cross-entropy objective functions…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Jasha Droppo , Oguz Elibol

When data is plentiful, the loss achieved by well-trained neural networks scales as a power-law $L \propto N^{-\alpha}$ in the number of network parameters $N$. This empirical scaling law holds for a wide variety of data modalities, and may…

Machine Learning · Computer Science 2020-04-24 Utkarsh Sharma , Jared Kaplan

Standard methods for multi-label text classification largely rely on encoder-only pre-trained language models, whereas encoder-decoder models have proven more effective in other classification tasks. In this study, we compare four methods…

Computation and Language · Computer Science 2023-05-10 Yova Kementchedjhieva , Ilias Chalkidis

In encoder-decoder neural models, multiple encoders are in general used to represent the contextual information in addition to the individual sentence. In this paper, we investigate multi-encoder approaches in documentlevel neural machine…

Computation and Language · Computer Science 2020-05-19 Bei Li , Hui Liu , Ziyang Wang , Yufan Jiang , Tong Xiao , Jingbo Zhu , Tongran Liu , Changliang Li

Modern LLM pre-training consumes vast amounts of compute and training data, making the scaling behavior, or scaling laws, of different models a key distinguishing factor. Discrete diffusion language models (DLMs) have been proposed as an…

Machine Learning · Computer Science 2026-02-17 Dimitri von Rütte , Janis Fluri , Omead Pooladzandi , Bernhard Schölkopf , Thomas Hofmann , Antonio Orvieto

Neural scaling laws suggest that the test error of large language models trained online decreases polynomially as the model size and data size increase. However, such scaling can be unsustainable when running out of new data. In this work,…

Machine Learning · Computer Science 2025-09-26 Licong Lin , Jingfeng Wu , Peter L. Bartlett

In recent years, the state-of-the-art in deep learning has been dominated by very large models that have been pre-trained on vast amounts of data. The paradigm is very simple: investing more computational resources (optimally) leads to…

Machine Learning · Computer Science 2024-05-24 Sotiris Anagnostidis , Gregor Bachmann , Imanol Schlag , Thomas Hofmann

Representations from transformer-based unidirectional language models are known to be effective at predicting brain responses to natural language. However, most studies comparing language models to brains have used GPT-2 or similarly sized…

Computation and Language · Computer Science 2024-01-31 Richard Antonello , Aditya Vaidya , Alexander G. Huth

Compared to sentence-level systems, document-level neural machine translation (NMT) models produce a more consistent output across a document and are able to better resolve ambiguities within the input. There are many works on…

Computation and Language · Computer Science 2023-06-09 Christian Herold , Hermann Ney

Discovering scaling laws for predicting model performance at scale is a fundamental and open-ended challenge, mostly reliant on slow, case specific human experimentation. To investigate the potential for LLMs to automate this process, we…

Machine Learning · Computer Science 2026-01-23 Haowei Lin , Haotian Ye , Wenzheng Feng , Quzhe Huang , Yujun Li , Hubert Lim , Zhengrui Li , Xiangyu Wang , Jianzhu Ma , Yitao Liang , James Zou

Computational complexity is critical when deploying deep learning-based speech denoising models for on-device applications. Most prior research focused on optimizing model architectures to meet specific computational cost constraints, often…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-15 Hangting Chen , Jianwei Yu , Chao Weng

Recent research in neural machine translation has largely focused on two aspects; neural network architectures and end-to-end learning algorithms. The problem of decoding, however, has received relatively little attention from the research…

Computation and Language · Computer Science 2017-02-09 Jiatao Gu , Kyunghyun Cho , Victor O. K. Li

Deep neural networks exhibit empirical neural scaling laws, with error decreasing as a power law with increasing model or data size, across a wide variety of architectures, tasks, and datasets. This universality suggests that scaling laws…

Machine Learning · Computer Science 2024-12-12 Ari Brill

Data scaling has revolutionized research fields like natural language processing, computer vision, and robotics control, providing foundation models with remarkable multi-task and generalization capabilities. In this paper, we investigate…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Shaohuai Liu , Lin Dong , Chao Tian , Le Xie

The laws of model size, data volume, computation and model performance have been extensively studied in the field of Natural Language Processing (NLP). However, the scaling laws in Optical Character Recognition (OCR) have not yet been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Miao Rang , Zhenni Bi , Chuanjian Liu , Yunhe Wang , Kai Han

Test-time scaling has emerged as a powerful paradigm for enhancing the reasoning capabilities of large language models (LLMs) by allocating additional computational resources during inference. However, this paradigm is inherently…

Computation and Language · Computer Science 2025-09-08 Shengyin Sun , Yiming Li , Xing Li , Yingzhao Lian , Weizhe Lin , Hui-Ling Zhen , Zhiyuan Yang , Chen Chen , Xianzhi Yu , Mingxuan Yuan , Chen Ma