English
Related papers

Related papers: Intermittency and scale-free networks: a dynamical…

200 papers

Most of animal and human behavior occurs on time scales much longer than the response times of individual neurons. In many cases, it is plausible that these long time scales emerge from the recurrent dynamics of electrical activity in…

Biological Physics · Physics 2024-08-23 Xiaowen Chen , William Bialek

In this paper we deal with the structural properties of weighted networks. Starting from an empirical analysis of a linguistic network, we analyse the differences between the statistical properties of a real and a shuffled network and we…

Data Analysis, Statistics and Probability · Physics 2009-09-07 A. P. Masucci , G. J. Rodgers

We evaluated the impact of changing the observation scale over the entropy measures for text descriptions. MIDI coded Music, computer code and two human natural languages were studied at the scale of characters, words, and at the…

Information Theory · Computer Science 2017-01-13 Gerardo Febres , Klaus Jaffe

The problem of defining and studying complexity of a time series has interested people for years. In the context of dynamical systems, Grassberger has suggested that a slow approach of the entropy to its extensive asymptotic limit is a sign…

Data Analysis, Statistics and Probability · Physics 2009-11-07 William Bialek , Ilya Nemenman , Naftali Tishby

Human language, the most powerful communication system in history, is closely associated with cognition. Written text is one of the fundamental manifestations of language, and the study of its universal regularities can give clues about how…

Computation and Language · Computer Science 2009-02-05 M. Angeles Serrano , Alessandro Flammini , Filippo Menczer

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

A computer model is described which is used to assess the dynamical complexity of a class of networks of spiking neurons with small-world properties. Networks are constructed by forming an initially segregated set of highly intra-connected…

Biological Physics · Physics 2009-11-13 Murray Shanahan

Here we sketch a new derivation of Zipf's law for word frequencies based on optimal coding. The structure of the derivation is reminiscent of Mandelbrot's random typing model but it has multiple advantages over random typing: (1) it starts…

Computation and Language · Computer Science 2020-09-24 Ramon Ferrer-i-Cancho

We examine the evolution of the vocabulary of a group of individuals (linguistic agents) on a scale-free network, using Monte Carlo simulations and assumptions from evolutionary game theory. It is known that when the agents are arranged in…

Physics and Society · Physics 2009-11-13 Alkiviadis Kalampokis , Kosmas Kosmidis , Panos Argyrakis

Entropy rate of sequential data-streams naturally quantifies the complexity of the generative process. Thus entropy rate fluctuations could be used as a tool to recognize dynamical perturbations in signal sources, and could potentially be…

Information Theory · Computer Science 2014-03-24 Ishanu Chattopadhyay , Hod Lipson

In this overview, we discuss the connections between the observations of critical dynamics in neuronal networks and the maximum entropy models that are often used as statistical models of neural activity, focusing in particular on the…

Neurons and Cognition · Quantitative Biology 2018-12-24 Martino Sorbaro , J. Michael Herrmann , Matthias H. Hennig

Zipf's law has been found in many human-related fields, including language, where the frequency of a word is persistently found as a power law function of its frequency rank, known as Zipf's law. However, there is much dispute whether it is…

Computation and Language · Computer Science 2018-07-06 Shuiyuan Yu , Chunshan Xu , Haitao Liu

Many complex generative systems use languages to create structured objects. We consider a model of random languages, defined by weighted context-free grammars. As the distribution of grammar weights broadens, a transition is found from a…

Disordered Systems and Neural Networks · Physics 2019-04-03 E. DeGiuli

What dynamics govern a time series representing the appearance of words in social media data? In this paper, we investigate an elementary dynamics, from which word-dependent special effects are segregated, such as breaking news, increasing…

Physics and Society · Physics 2017-07-31 Hayafumi Watanabe

There are different ways of measuring diversity in complex systems. In particular, in language, lexical diversity is characterized in terms of the type-token ratio and the word entropy. We here investigate both diversity metrics in six…

Computation and Language · Computer Science 2025-07-16 Pablo Rosillo-Rodes , Maxi San Miguel , David Sanchez

An important body of quantitative linguistics is constituted by a series of statistical laws about language usage. Despite the importance of these linguistic laws, some of them are poorly formulated, and, more importantly, there is no…

Physics and Society · Physics 2020-11-09 Alvaro Corral , Isabel Serra

What processes can explain how very large populations are able to converge on the use of a particular word or grammatical construction without global coordination? Answering this question helps to understand why new language constructs…

Physics and Society · Physics 2007-05-23 A. Baronchelli , M. Felici , E. Caglioti , V. Loreto , L. Steels

We present a statistical mechanics approach for the description of complex networks. We first define an energy and an entropy associated to a degree distribution which have a geometrical interpretation. Next we evaluate the distribution…

Disordered Systems and Neural Networks · Physics 2009-11-13 Ginestra Bianconi

We study by analytical methods and large scale simulations a dynamical model for the spreading of epidemics in complex networks. In networks with exponentially bounded connectivity we recover the usual epidemic behavior with a threshold…

Statistical Mechanics · Physics 2009-11-07 Romualdo Pastor-Satorras , Alessandro Vespignani

Human language, as a typical complex system, its organization and evolution is an attractive topic for both physical and cultural researchers. In this paper, we present the first exhaustive analysis of the text organization of human speech.…

Computation and Language · Computer Science 2015-01-08 Ruokuang Lin , Qianli D. Y. Ma , Chunhua Bian