English
Related papers

Related papers: Modeling response time with power-law distribution…

200 papers

This letter introduces a mechanism for constructing, through a process of distributed decision-making, substrates for the study of collective dynamics on extended power-law weighted networks with both a desired scaling exponent and a fixed…

Physics and Society · Physics 2013-01-18 P. Moriano , J. Finke

Recently a number of empirical "universal" scaling law papers have been published, most notably by OpenAI. `Scaling laws' refers to power-law decreases of training or test error w.r.t. more data, larger neural networks, and/or more compute.…

Machine Learning · Computer Science 2021-02-15 Marcus Hutter

We investigate scaling properties of human brain functional networks in the resting-state. Analyzing network degree distributions, we statistically test whether their tails scale as power-law or not. Initial studies, based on least-squares…

Neurons and Cognition · Quantitative Biology 2017-02-03 Riccardo Zucca , Xerxes D. Arsiwalla , Hoang Le , Mikail Rubinov , Paul Verschure

Neural scaling laws characterize how model performance improves as the model size scales up. Inspired by empirical observations, we introduce a resource model of neural scaling. A task is usually composite hence can be decomposed into many…

Machine Learning · Computer Science 2024-05-16 Jinyeop Song , Ziming Liu , Max Tegmark , Jeff Gore

An analytical study of the return time distribution of extreme events for stochastic processes with power-law correlation has been carried on. The calculation is based on an epsilon-expansion in the correlation exponent:…

Statistical Mechanics · Physics 2009-11-11 Piero Olla

Neural scaling laws define a predictable relationship between a model's parameter count and its performance after training in the form of a power law. However, most research to date has not explicitly investigated whether scaling laws can…

Computation and Language · Computer Science 2022-10-19 Maor Ivgi , Yair Carmon , Jonathan Berant

Models of how things spread often assume that transmission mechanisms are fixed over time. However, social contagions--the spread of ideas, beliefs, innovations--can lose or gain in momentum as they spread: ideas can get reinforced, beliefs…

Many natural or human-made systems encompassing local reactions and diffusion processes exhibit spatially distributed patterns of some relevant dynamical variable. These interactions, through self-organization and critical phenomena, give…

Pattern Formation and Solitons · Physics 2024-07-08 Jean-François de Kemmeter , Adam Byrne , Amy Dunne , Timoteo Carletti , Malbor Asllani

This study investigates the emergence of power-law and other concentrated distributions through a feedback loop model in crowd interactions. Agents act by their response functions to observations and external forces, while observations…

General Economics · Economics 2024-12-18 Jake J. Xia

Recently, increasing empirical evidence indicates the extensive existence of heavy tails in the interevent time distributions of various human behaviors. Based on the queuing theory, the Barab\'asi model and its variations suggest the…

Physics and Society · Physics 2008-07-26 Xiao-Pu Han , Tao Zhou , Bing-Hong Wang

Queueing theory has been recently proposed as a framework to model the heavy tailed statistics of human activity patterns. The main predictions are the existence of a power-law distribution for the interevent time of human actions and two…

Physics and Society · Physics 2009-02-13 J. G. Oliveira , A. Vazquez

Power law distributions have been repeatedly observed in a wide variety of socioeconomic, biological and technological areas. In many of the observations, e.g., city populations and sizes of living organisms, the objects of interest evolve…

Probability · Mathematics 2009-09-29 Predrag R. Jelenkovic , Jian Tan

Many social, technological, biological, and economical systems are best described by weighted networks, whose properties and dynamics depend not only on their structures but also on the connection weights among their nodes. However, most…

Disordered Systems and Neural Networks · Physics 2015-06-24 Chunguang Li , Guanrong Chen

The recent availability of electronic datasets containing large volumes of communication data has made it possible to study human behavior on a larger scale than ever before. From this, it has been discovered that across a diverse range of…

Physics and Society · Physics 2015-05-08 Gordon J Ross , Tim Jones

The gap between data production and user ability to access, compute and produce meaningful results calls for tools that address the challenges associated with big data volume, velocity and variety. One of the key hurdles is the inability to…

Social and Information Networks · Computer Science 2017-01-25 Vijay Gadepally , Jeremy Kepner

While scaling laws for large language models (LLMs) during pre-training have been extensively studied, their behavior under reinforcement learning (RL) post-training remains largely unexplored. This paper presents a systematic empirical…

The temporal statistics exhibited by written correspondence appear to be media dependent, with features which have so far proven difficult to characterize. We explain the origin of these difficulties by disentangling the role of spontaneous…

Physics and Society · Physics 2015-06-17 M. Formentin , A. Lovison , A. Maritan , G. Zanzotto

The dynamics of technological, economic and social phenomena is controlled by how humans organize their daily tasks in response to both endogenous and exogenous stimulations. Queueing theory is believed to provide a generic answer to…

Physics and Society · Physics 2013-05-29 Thomas Maillart , Didier Sornette , Stefan Frei , Thomas Duebendorfer , Alexander Saichev

The probability distribution of number of ties of an individual in a social network follows a scale-free power-law. However, how this distribution arises has not been conclusively demonstrated in direct analyses of people's actions in…

Physics and Society · Physics 2014-08-25 Lev Muchnik , Sen Pei , Lucas C. Parra , Saulo D. S. Reis , Jose S. Andrade, , Shlomo Havlin , Hernan A. Makse

Strong anomalous diffusion is {often} characterized by a piecewise-linear spectrum of the moments of displacement. The spectrum is characterized by slopes $\xi$ and $\zeta$ for small and large moments, respectively, and by the critical…