English
Related papers

Related papers: Forecasting AI Time Horizon Under Compute Slowdown…

200 papers

Compute, data, and algorithmic advances are the three fundamental factors that guide the progress of modern Machine Learning (ML). In this paper we study trends in the most readily quantified factor - compute. We show that before 2010…

Machine Learning · Computer Science 2023-11-21 Jaime Sevilla , Lennart Heim , Anson Ho , Tamay Besiroglu , Marius Hobbhahn , Pablo Villalobos

Data-driven artificial intelligence (AI) models have made significant advancements in weather forecasting, particularly in medium-range and nowcasting. However, most data-driven weather forecasting models are black-box systems that focus on…

Machine Learning · Computer Science 2025-01-14 Wanghan Xu , Fenghua Ling , Wenlong Zhang , Tao Han , Hao Chen , Wanli Ouyang , Lei Bai

Transformative AI technologies have the potential to reshape critical aspects of society in the near future. However, in order to properly prepare policy initiatives for the arrival of such technologies accurate forecasts and timelines are…

Computers and Society · Computer Science 2019-07-17 Ross Gruetzemacher , David Paradice , Kang Bok Lee

Training advanced AI models requires large investments in computational resources, or compute. Yet, as hardware innovation reduces the price of compute and algorithmic advances make its use more efficient, the cost of training an AI model…

Computers and Society · Computer Science 2024-02-15 Konstantin Pilz , Lennart Heim , Nicholas Brown

Regulatory efforts to govern large language model (LLM) development have predominantly focused on restricting access to high-performance computational resources. This study evaluates the efficacy of such measures by examining whether LLM…

Machine Learning · Computer Science 2025-06-06 Jack Sanderson , Teddy Foley , Spencer Guo , Anqi Qu , Henry Josephson

Recent Artificial Intelligence (AI) models have matched or exceeded human experts in several benchmarks of biomedical task performance, but surgical benchmarks in particular are often missing from prominent medical benchmark suites. Since…

This study investigates the labor market consequences of AI by analyzing near real-time changes in employment status and work hours across occupations in relation to advances in AI capabilities. We construct a dynamic Occupational AI…

General Economics · Economics 2025-07-14 Jacob Dominski , Yong Suk Lee

LLMs are hitting the scaling wall - compute grows 10-100x while accuracy barely moves. This note quantifies the slowdown and argues that the next leap in AI will come not from bigger models, but from smarter, more efficient ones.

Instrumentation and Methods for Astrophysics · Physics 2025-12-24 Hemant Shukla

When training autoregressive models to forecast dynamical systems, a critical question arises: how far into the future should the model be trained to predict? Too short a horizon may miss long-term trends, while too long a horizon can…

Machine Learning · Computer Science 2025-06-23 Pau Vilimelis Aceituno , Jack William Miller , Noah Marti , Youssef Farag , Victor Boussange

Scaling law that rewards large datasets, complex models and enhanced data granularity has been observed in various fields of deep learning. Yet, studies on time series forecasting have cast doubt on scaling behaviors of deep learning…

Machine Learning · Computer Science 2024-11-13 Jingzhe Shi , Qinwei Ma , Huan Ma , Lei Li

This paper presents an extensive study on the application of AI techniques for software effort estimation in the past five years from 2017 to 2023. By overcoming the limitations of traditional methods, the study aims to improve accuracy and…

Software Engineering · Computer Science 2024-02-09 Nhi Tran , Tan Tran , Nam Nguyen

We study the problem of predicting the results of computations that are too expensive to run, via the observation of the results of smaller computations. We model this as an online learning problem with delayed feedback, where the length of…

Machine Learning · Computer Science 2016-09-08 Scott Garrabrant , Nate Soares , Jessica Taylor

We study the problem of planning under model uncertainty in an online meta-reinforcement learning (RL) setting where an agent is presented with a sequence of related tasks with limited interactions per task. The agent can use its experience…

Artificial Intelligence · Computer Science 2023-01-02 Khimya Khetarpal , Claire Vernade , Brendan O'Donoghue , Satinder Singh , Tom Zahavy

At any sustained positive growth rate of energy demand, depletion of all terrestrial energy resources, including non-renewable deuterium fusion and renewable solar, occurs within a remarkably compressed period. The time to depletion is…

Physics and Society · Physics 2026-04-28 Robert T. Nachtrieb , Steven J. Smith

This study examines the predictability of artificial intelligence (AI) models for weather prediction. Using a simple deep-learning architecture based on convolutional long short-term memory and the ERA5 data for training, we show that…

Atmospheric and Oceanic Physics · Physics 2024-10-07 Chanh Kieu

Despite extensive investment in artificial intelligence, 95% of enterprises report no measurable profit impact from AI deployments (MIT, 2025). In this theoretical paper, we argue that this gap reflects paradigmatic lock-in that channels AI…

Computers and Society · Computer Science 2025-09-15 Diana A. Wolfe , Alice Choe , Fergus Kidd

Artificial intelligence (AI) and hardware (HW) are advancing at unprecedented rates, yet their trajectories have become inseparably intertwined. The global research community lacks a cohesive, long-term vision to strategically coordinate…

AI systems improve by drawing on more compute, data, energy, and better training methods. This paper asks a precise, testable version of the "runaway growth" question: under what measurable conditions could capability escalate without bound…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Akbar Anbar Jafari , Cagri Ozcinar , Gholamreza Anbarjafari

Large language models now write software, draft legal documents, and produce clinical notes, yet fundamental limits, from Turing and Arrow to the No Free Lunch theorems, shape what computation can do. This thesis turns such impossibility…

Artificial Intelligence · Computer Science 2026-05-25 Dongxin Guo

This paper investigates the online conversion problem, which involves sequentially trading a divisible resource (e.g., energy) under dynamically changing prices to maximize profit. A key challenge in online conversion is managing decisions…

Data Structures and Algorithms · Computer Science 2025-02-07 Yanzhao Wang , Hasti Nourmohammadi Sigaroudi , Bo Sun , Omid Ardakanian , Xiaoqi Tan