English
Related papers

Related papers: Language models scale reliably with over-training …

200 papers

Scaling laws have been used to describe how large language model (LLM) performance scales with model size, training data size, or amount of computational resources. Motivated by the fact that neural quantum states (NQS) has increasingly…

Machine Learning · Computer Science 2025-09-17 Oliver Knitter , Dan Zhao , Stefan Leichenauer , Shravan Veerapaneni

Neural scaling laws offer valuable insights for designing robust sequence processing architectures. While these laws have been extensively characterized in other modalities, their behavior in speech remains comparatively underexplored. In…

Computation and Language · Computer Science 2025-02-17 William Chen , Jinchuan Tian , Yifan Peng , Brian Yan , Chao-Han Huck Yang , Shinji Watanabe

Neural scaling laws have garnered significant interest due to their ability to predict model performance as a function of increasing parameters, data, and compute. In this work, we propose a simple statistical ansatz based on memorization…

Machine Learning · Statistics 2024-12-10 Noam Levi

Neural scaling laws predict how language model performance improves with increased training inputs. While aggregate metrics like validation loss can follow smooth power-law curves, individual downstream tasks exhibit diverse scaling…

Machine Learning · Computer Science 2026-05-11 Michael Y. Hu , Jane Pan , Ayush Rajesh Jhaveri , Nicholas Lourie , Kyunghyun Cho

Recently, Large Language Models (LLMs) have achieved remarkable success. A key factor behind this success is the scaling law observed by OpenAI. Specifically, for models with Transformer architecture, the test loss exhibits a power-law…

Machine Learning · Computer Science 2025-03-04 Yifang Chen , Xuyang Guo , Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song

The burgeoning interest in developing Large Language Models (LLMs) with up to trillion parameters has been met with concerns regarding resource efficiency and practical expense, particularly given the immense cost of experimentation. This…

Recent research has highlighted the importance of dataset size in scaling language models. However, large language models (LLMs) are notoriously token-hungry during pre-training, and high-quality text data on the web is approaching its…

Machine Learning · Computer Science 2023-10-10 Fuzhao Xue , Yao Fu , Wangchunshu Zhou , Zangwei Zheng , Yang You

Symbolic regression (SR) aims to discover the underlying mathematical expressions that explain observed data. This holds promise for both gaining scientific insight and for producing inherently interpretable and generalizable models for…

Machine Learning · Computer Science 2026-02-05 David Otte , Jörg K. H. Franke , Arbër Zela , Fábio Ferreira , Frank Hutter

Large language models are trained on massive scrapes of the web, as required by current scaling laws. Most progress is made for English, given its abundance of high-quality pretraining data. For most other languages, however, such high…

Computation and Language · Computer Science 2025-02-07 Skyler Seto , Maartje ter Hoeve , Richard He Bai , Natalie Schluter , David Grangier

As neural networks continue to grow in size but datasets might not, it is vital to understand how much performance improvement can be expected: is it more important to scale network size or data volume? Thus, neural network scaling laws,…

Machine Learning · Computer Science 2024-09-10 Akhilan Boopathy , Ila Fiete

The use of machine learning models in system identification has increased due to their ability to approximate complex nonlinear dynamics with high accuracy. However, often it is not clear how the performance of trained models scales with…

Optimization and Control · Mathematics 2026-03-26 Marco Roschkowski , Karim Cherifi , Hannes Gernandt

Existing Speech Language Model (SLM) scaling analysis paints a bleak picture. It predicts that SLMs require much more compute and data compared to text, leading some to question the feasibility of training high-quality SLMs. However, modern…

Computation and Language · Computer Science 2025-07-29 Gallil Maimon , Michael Hassid , Amit Roth , Yossi Adi

The pre-training phase of language models often begins with randomly initialized parameters. With the current trends in scaling models, training their large number of parameters can be extremely slow and costly. In contrast, small language…

Computation and Language · Computer Science 2024-09-23 Mohammad Samragh , Iman Mirzadeh , Keivan Alizadeh Vahid , Fartash Faghri , Minsik Cho , Moin Nabi , Devang Naik , Mehrdad Farajtabar

Large language models have demonstrated remarkable capabilities across various tasks, primarily attributed to the utilization of diversely sourced data. However, the impact of pretraining data composition on model performance remains poorly…

Machine Learning · Computer Science 2025-01-28 Ce Ge , Zhijian Ma , Daoyuan Chen , Yaliang Li , Bolin Ding

Current multimodal language model (MLM) training approaches overlook the influence of instruction templates. Previous research deals with this problem by leveraging hand-crafted or model-generated templates, failing to investigate the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Shijian Wang , Linxin Song , Jieyu Zhang , Ryotaro Shimizu , Jiarui Jin , Ao Luo , Yuan Lu , Li Yao , Cunjian Chen , Julian McAuley , Wentao Zhang , Hanqian Wu

The scaling of large language models (LLMs) is a critical research area for the efficiency and effectiveness of model training and deployment. Our work investigates the transferability and discrepancies of scaling laws between Dense Models…

Machine Learning · Computer Science 2024-10-10 Siqi Wang , Zhengyu Chen , Bei Li , Keqing He , Min Zhang , Jingang Wang

Scale has become a main ingredient in obtaining strong machine learning models. As a result, understanding a model's scaling properties is key to effectively designing both the right training setup as well as future generations of…

Machine Learning · Computer Science 2024-10-18 Alexander Hägele , Elie Bakouch , Atli Kosson , Loubna Ben Allal , Leandro Von Werra , Martin Jaggi

In multilingual pretraining, the test loss of a pretrained model is heavily influenced by the proportion of each language in the pretraining data, namely the \textit{language mixture ratios}. Multilingual scaling laws can predict the test…

Computation and Language · Computer Science 2026-05-29 Xuyang Cao , Qianying Liu , Chuan Xiao , Yusuke Oda , Jiayi Wang , Pontus Stenetorp , Daisuke Kawahara , Makoto Onizuka , Sadao Kurohashi , Shuyuan Zheng

Assessing the capabilities and risks of frontier AI systems is a critical area of research, and recent work has shown that repeated sampling from models can dramatically increase both. For instance, repeated sampling has been shown to…

Artificial Intelligence · Computer Science 2025-10-08 Joshua Kazdan , Rylan Schaeffer , Youssef Allouah , Colin Sullivan , Kyssen Yu , Noam Levi , Sanmi Koyejo

We introduce a framework for optimizing domain-specific dataset construction in foundation model training. Specifically, we seek a cost-efficient way to estimate the quality of data sources (e.g. synthetically generated or filtered web…