English
Related papers

Related papers: Word statistics in Blogs and RSS feeds: Towards em…

200 papers

In counting experiments, one can set an upper limit on the rate of a Poisson process based on a count of the number of events observed due to the process. In some experiments, one makes several counts of the number of events, using…

Data Analysis, Statistics and Probability · Physics 2014-11-20 Patrick J. Sutton

We investigate the behavior of the periods and border lengths of random words over a fixed alphabet. We show that the asymptotic probability that a random word has a given maximal border length $k$ is a constant, depending only on $k$ and…

Formal Languages and Automata Theory · Computer Science 2019-12-18 Štěpán Holub , Jeffrey Shallit

We present a theoretical and empirical investigation of the statistical behaviour of the words in a text produced by human language. To this aim, we analyse the word distribution of various texts of Italian language selected from a specific…

Neurons and Cognition · Quantitative Biology 2025-04-15 Diederik Aerts , Jonito Aerts Arguëlles , Lester Beltran , Massimiliano Sassoli de Bianchi , Sandro Sozzo

Records of social interactions provide us with new sources of data for understanding how interaction patterns affect collective dynamics. Such human activity patterns are often bursty, i.e., they consist of short periods of intense activity…

Physics and Society · Physics 2015-06-05 Taro Takaguchi , Naoki Masuda , Petter Holme

We perform statistical analysis of the phenomenon of neology, the process by which new words emerge in a language, using large diachronic corpora of English. We investigate the importance of two factors, semantic sparsity and frequency…

Computation and Language · Computer Science 2020-01-23 Maria Ryskina , Ella Rabinovich , Taylor Berg-Kirkpatrick , David R. Mortensen , Yulia Tsvetkov

We study the relaxation response of a social system after endogenous and exogenous bursts of activity using the time-series of daily views for nearly 5 million videos on YouTube. We find that most activity can be described accurately as a…

Physics and Society · Physics 2009-11-13 R. Crane , D. Sornette

We present the new empirical parameter $f_c$, the most probable usage frequency of a word in a language, computed via the distribution of documents over frequency $x$ of the word. This parameter allows for filtering the core lexicon of a…

Disordered Systems and Neural Networks · Physics 2007-05-23 Dmitri Volchenkov , Philippe Blanchard , Serge Sharoff

Thousands of documents are made available to the users via the web on a daily basis. One of the most extensively studied problems in the context of such document streams is burst identification. Given a term t, a burst is generally…

Databases · Computer Science 2012-05-31 Theodoros Lappas , Marcos R. Vieira , Dimitrios Gunopulos , Vassilis J. Tsotras

The uniform information density (UID) hypothesis posits a preference among language users for utterances structured such that information is distributed uniformly across a signal. While its implications on language production have been well…

Computation and Language · Computer Science 2021-09-27 Clara Meister , Tiago Pimentel , Patrick Haller , Lena Jäger , Ryan Cotterell , Roger Levy

Models of bags of words typically assume topic mixing so that the words in a single bag come from a limited number of topics. We show here that many sets of bag of words exhibit a very different pattern of variation than the patterns that…

Information Retrieval · Computer Science 2012-02-20 Nebojsa Jojic , Alessandro Perina

The distributions of the number of occurrences of words (the distributions of words for short) play key roles in information theory, statistics, probability theory, ergodic theory, computer science, and DNA analysis. Bassino et al. 2010 and…

Information Theory · Computer Science 2022-11-16 Hayato Takahashi

The analysis of strings of $n$ random variables with geometric distribution has recently attracted renewed interest: Archibald et al. consider the number of distinct adjacent pairs in geometrically distributed words. They obtain the…

Probability · Mathematics 2024-02-14 Guy Louchard , Werner Schachinger , Mark Daniel Ward

The dependence of the frequency distributions due to multiple meanings of words in a text is investigated by deleting letters. By coding the words with fewer letters the number of meanings per coded word increases. This increase is measured…

Computation and Language · Computer Science 2017-10-04 Xiaoyong Yan , Petter Minnhagen

On-line social networks publish information on a high volume of real-world events almost instantly, becoming a primary source for breaking news. Some of these real-world events can end up having a very strong impact on on-line social…

Social and Information Networks · Computer Science 2017-02-08 Janani Kalyanam , Mauricio Quezada , Barbara Poblete , Gert Lanckriet

In Twitter, and other microblogging services, the generation of new content by the crowd is often biased towards immediacy: what is happening now. Prompted by the propagation of commentary and information through multiple mediums, users on…

Information Retrieval · Computer Science 2016-02-10 Flávio Martins , João Magalhães , Jamie Callan

The evolution of vocabulary in academic publishing is characterized via keyword frequencies recorded the ISI Web of Science citations database. In four distinct case-studies, evolutionary analysis of keyword frequency change through time is…

Physics and Society · Physics 2009-02-18 R. Alexander Bentley

Keywords in scientific articles have found their significance in information filtering and classification. In this article, we empirically investigated statistical characteristics and evolutionary properties of keywords in a very famous…

Data Analysis, Statistics and Probability · Physics 2009-06-23 Zike Zhang , Linyuan Lv , Jian-Guo Liu , Tao Zhou

In the present paper we demonstrate the results of a statistical analysis of some characteristics of precipitation events and propose a kind of a theoretical explanation of the proposed models in terms of mixed Poisson and mixed exponential…

Probability · Mathematics 2018-06-28 V. Yu. Korolev , A. K. Gorshenin , S. K. Gulev , K. P. Belyaev , A. A. Grusho

The average uncertainty associated with words is an information-theoretic concept at the heart of quantitative and computational linguistics. The entropy has been established as a measure of this average uncertainty - also called average…

Computation and Language · Computer Science 2016-06-23 Christian Bentz , Dimitrios Alikaniotis

The detection of events from online social networks is a recent, evolving field that attracts researchers from across a spectrum of disciplines and domains. Here we report a time-series analysis for predicting events. In particular, we…

Social and Information Networks · Computer Science 2021-11-10 Izzat Alsmadi , Michael O'Brien