English
Related papers

Related papers: Scaling Laws for Cross-Encoder Reranking

200 papers

The remarkable success of large language pretraining and the discovery of scaling laws signify a paradigm shift in machine learning. Notably, the primary objective has evolved from minimizing generalization error to reducing approximation…

Machine Learning · Computer Science 2025-02-17 Lechao Xiao

Traditional scaling laws in natural language processing suggest that increasing model size and training data enhances performance. However, recent studies reveal deviations, particularly in large language models, where performance…

Machine Learning · Computer Science 2025-07-16 Zhengyu Chen , Siqi Wang , Teng Xiao , Yudong Wang , Shiqi Chen , Xunliang Cai , Junxian He , Jingang Wang

Modern foundation models rely heavily on using scaling laws to guide crucial training decisions. Researchers often extrapolate the optimal architecture and hyper parameters settings from smaller training runs by describing the relationship…

Machine Learning · Computer Science 2025-02-27 Margaret Li , Sneha Kudugunta , Luke Zettlemoyer

Recent work has identified simple empirical scaling laws for language models, linking compute budget, dataset size, model size, and autoregressive modeling loss. The validity of these simple power laws across orders of magnitude in model…

Machine Learning · Statistics 2021-09-27 Amélie Chatelain , Amine Djeghri , Daniel Hesslow , Julien Launay , Iacopo Poli

Scaling laws guide the development of large language models (LLMs) by offering estimates for the optimal balance of model size, tokens, and compute. More recently, loss-to-loss scaling laws that relate losses across pretraining datasets and…

Machine Learning · Computer Science 2026-05-21 Prasanna Mayilvahanan , Thaddäus Wiedemer , Sayak Mallick , Matthias Bethge , Wieland Brendel

The quality of Large Language Model (LLM) pretraining depends on multiple factors, including the compute budget and the choice of optimization algorithm. Empirical scaling laws are widely used to predict loss as model size and training data…

Machine Learning · Computer Science 2026-02-25 Alexandra Volkova , Mher Safaryan , Christoph H. Lampert , Dan Alistarh

Neural scaling laws have driven the field's ever-expanding exponential growth in parameters, data and compute. While scaling behaviors for pretraining losses and discriminative benchmarks are well established, generative benchmarks such as…

Machine Learning · Computer Science 2026-02-03 Rylan Schaeffer , Noam Levi , Brando Miranda , Sanmi Koyejo

We study empirical scaling laws for transfer learning between distributions in an unsupervised, fine-tuning setting. When we train increasingly large neural networks from-scratch on a fixed-size dataset, they eventually become data-limited…

Machine Learning · Computer Science 2021-02-03 Danny Hernandez , Jared Kaplan , Tom Henighan , Sam McCandlish

Predicting material properties is crucial for designing better batteries, semiconductors, and medical devices. Deep learning helps scientists quickly find promising materials by predicting their energy, forces, and stresses. Companies scale…

Machine Learning · Computer Science 2025-09-29 Akshay Trikha , Kyle Chu , Advait Gosai , Parker Szachta , Eric Weiner

Scaling of neural networks has recently shown great potential to improve the model capacity in various fields. Specifically, model performance has a power-law relationship with model size or data size, which provides important guidance for…

Information Retrieval · Computer Science 2023-11-21 Gaowei Zhang , Yupeng Hou , Hongyu Lu , Yu Chen , Wayne Xin Zhao , Ji-Rong Wen

As neural networks continue to grow in size but datasets might not, it is vital to understand how much performance improvement can be expected: is it more important to scale network size or data volume? Thus, neural network scaling laws,…

Machine Learning · Computer Science 2024-09-10 Akhilan Boopathy , Ila Fiete

The scaling law is a notable property of neural network models and has significantly propelled the development of large language models. Scaling laws hold great promise in guiding model design and resource allocation. Recent research…

Information Retrieval · Computer Science 2025-09-26 Yunli Wang , Zhen Zhang , Zixuan Yang , Tianyu Xu , Zhiqiang Wang , Yu Li , Rufan Zhou , Zhiqiang Liu , Yanjie Zhu , Jian Yang , Shiyang Wen , Peng Jiang

Low precision training and inference affect both the quality and cost of language models, but current scaling laws do not account for this. In this work, we devise "precision-aware" scaling laws for both training and inference. We propose…

Recent advancement of large-scale pretrained models such as BERT, GPT-3, CLIP, and Gopher, has shown astonishing achievements across various task domains. Unlike vision recognition and language models, studies on general-purpose user…

Information Retrieval · Computer Science 2022-11-23 Kyuyong Shin , Hanock Kwak , Su Young Kim , Max Nihlen Ramstrom , Jisu Jeong , Jung-Woo Ha , Kyung-Min Kim

Scaling laws in language modeling traditionally quantify training loss as a function of dataset size and model parameters, providing compute-optimal estimates but often neglecting the impact of data quality on model generalization. In this…

Computation and Language · Computer Science 2024-10-07 Ernie Chang , Matteo Paltenghi , Yang Li , Pin-Jie Lin , Changsheng Zhao , Patrick Huber , Zechun Liu , Rastislav Rabatin , Yangyang Shi , Vikas Chandra

Scaling laws with respect to the amount of training data and the number of parameters allow us to predict the cost-benefit trade-offs of pretraining language models (LMs) in different configurations. In this paper, we consider another…

Computation and Language · Computer Science 2024-07-19 Rulin Shao , Jacqueline He , Akari Asai , Weijia Shi , Tim Dettmers , Sewon Min , Luke Zettlemoyer , Pang Wei Koh

The ever-growing ecosystem of LLMs has posed a challenge in selecting the most appropriate pre-trained model to fine-tune amidst a sea of options. Given constrained resources, fine-tuning all models and making selections afterward is…

Machine Learning · Computer Science 2024-05-29 Haowei Lin , Baizhou Huang , Haotian Ye , Qinyu Chen , Zihao Wang , Sujian Li , Jianzhu Ma , Xiaojun Wan , James Zou , Yitao Liang

Scaling laws play a central role in the success of Large Language Models (LLMs), enabling the prediction of model performance relative to compute budgets prior to training. While Transformers have been the dominant architecture, recent…

Machine Learning · Computer Science 2026-02-23 Maximilian Beck , Kajetan Schweighofer , Sebastian Böck , Sebastian Lehner , Sepp Hochreiter

Using large language models (LLMs) to predict relevance judgments has shown promising results. Most studies treat this task as a distinct research line, e.g., focusing on prompt design for predicting relevance labels given a query and…

Information Retrieval · Computer Science 2026-01-09 Chuan Meng , Jiqun Liu , Mohammad Aliannejadi , Fengran Mo , Jeff Dalton , Maarten de Rijke

Understanding how language model performance varies with scale is critical to benchmark and algorithm development. Scaling laws are one approach to building this understanding, but the requirement of training models across many different…

Machine Learning · Computer Science 2024-10-03 Yangjun Ruan , Chris J. Maddison , Tatsunori Hashimoto