English
Related papers

Related papers: An Information-Theoretic Approach to Identifying F…

200 papers

Classic Topic Models are built under the Bag Of Words assumption, in which word position is ignored for simplicity. Besides, symmetric priors are typically used in most applications. In order to easily learn topics with different properties…

Computation and Language · Computer Science 2018-06-27 Simón Roca-Sotelo , Jerónimo Arenas-García

The last decades have not only been characterized by an explosive growth of data, but also an increasing appreciation of data as a valuable resource. Their value comes with the ability to extract meaningful patterns that are of economic,…

Machine Learning · Statistics 2020-02-27 Jonas I. Liechti , Sebastian Bonhoeffer

This paper proposes a new paradigm and computational framework for identification of correspondences between sub-structures of distinct composite systems. For this, we define and investigate a variant of traditional data clustering, termed…

Machine Learning · Computer Science 2007-05-23 Zvika Marx , Ido Dagan , Joachim Buhmann

Distributional text clustering delivers semantically informative representations and captures the relevance between each word and semantic clustering centroids. We extend the neural text clustering approach to text classification tasks by…

Computation and Language · Computer Science 2020-11-25 Yekun Chai , Haidong Zhang , Shuo Jin

The growing societal dependence on social media and user generated content for news and information has increased the influence of unreliable sources and fake content, which muddles public discourse and lessens trust in the media.…

Computation and Language · Computer Science 2022-09-07 Marjan Hosseini , Alireza Javadian Sabet , Suining He , Derek Aguiar

Several mathematical ideas have been investigated for Quantitative Information Flow. Information theory, probability, guessability are the main ideas in most proposals. They aim to quantify how much information is leaked, how likely is to…

Information Theory · Computer Science 2011-01-19 Pasquale Malacaria

New text as data techniques offer a great promise: the ability to inductively discover measures that are useful for testing social science theories of interest from large collections of text. We introduce a conceptual framework for making…

Machine Learning · Statistics 2018-02-08 Naoki Egami , Christian J. Fong , Justin Grimmer , Margaret E. Roberts , Brandon M. Stewart

Texts exhibit considerable stylistic variation. This paper reports an experiment where a corpus of documents (N= 75 000) is analyzed using various simple stylistic metrics. A subset (n = 1000) of the corpus has been previously assessed to…

cmp-lg · Computer Science 2008-02-03 Jussi Karlgren

Statistical topic models provide a general data-driven framework for automated discovery of high-level knowledge from large collections of text documents. While topic models can potentially discover a broad range of themes in a data set,…

Artificial Intelligence · Computer Science 2008-08-08 Chaitanya Chemudugunta , Padhraic Smyth , Mark Steyvers

Subject classification schemes are foundational to the organization, evaluation, and navigation of scientific knowledge. While expert-curated systems like Scopus provide widely used taxonomies, they often suffer from coarse granularity,…

Digital Libraries · Computer Science 2025-12-30 Zhuoqi Lyu , Qing Ke

The automated discovery of constitutive laws forms an emerging research area, that focuses on automatically obtaining symbolic expressions describing the constitutive behavior of solid materials from experimental data. Existing…

Materials Science · Physics 2024-05-10 Georgios Kissas , Siddhartha Mishra , Eleni Chatzi , Laura De Lorenzis

The volume of academic paper submissions and publications is growing at an ever increasing rate. While this flood of research promises progress in various fields, the sheer volume of output inherently increases the amount of noise. We…

Information Retrieval · Computer Science 2020-05-22 Marko Stamenovic , Jeibo Luo

Over the years there has been ongoing interest in detecting authorship of a text based on statistical properties of the text, such as by using occurrence rates of noncontextual words. In previous work, these techniques have been used, for…

Computation and Language · Computer Science 2024-03-21 Todd K Moon , Jacob H. Gunther

Atomic-level modeling performed at large scales enables the investigation of mesoscale materials properties with atom-by-atom resolution. The spatial complexity of such cross-scale simulations renders them unsuitable for simple human visual…

Materials Science · Physics 2022-04-05 Heejung Chung , Rodrigo Freitas , Gowoon Cheon , Evan J. Reed

The Linguistic Annotation Framework (LAF) provides a general, extensible stand-off markup system for corpora. This paper discusses LAF-Fabric, a new tool to analyse LAF resources in general with an extension to process the Hebrew Bible in…

Computation and Language · Computer Science 2015-01-13 Dirk Roorda , Gino Kalkman , Martijn Naaijer , Andreas van Cranenburgh

Document clustering is an unsupervised approach in which a large collection of documents (corpus) is subdivided into smaller, meaningful, identifiable, and verifiable sub-groups (clusters). Meaningful representation of documents and…

Information Retrieval · Computer Science 2014-12-08 Muhammad Rafi , Farnaz Amin , Mohammad Shahid Shaikh

This is a case study, where Taxicab Correspondence Analysis reveals that the underlying structure of an extremely sparse binary textual data set can be represented by a binary tree, where the nodes representing clusters of words can be…

Applications · Statistics 2024-04-11 Vartan Choulakian , Jacques Allard , Ron Kenett

Mining textual patterns in news, tweets, papers, and many other kinds of text corpora has been an active theme in text mining and NLP research. Previous studies adopt a dependency parsing-based pattern discovery approach. However, the…

Computation and Language · Computer Science 2017-03-16 Meng Jiang , Jingbo Shang , Taylor Cassidy , Xiang Ren , Lance M. Kaplan , Timothy P. Hanratty , Jiawei Han

We present an information-theoretic interpretation of quantum formalism based on a Bayesian framework and devoid of any extra axiom or principle. Quantum information is construed as a technique for analyzing a logical system subject to…

Information Theory · Computer Science 2020-12-01 Michel Feldmann

Natural data is often organized as a hierarchical composition of features. How many samples do generative models need in order to learn the composition rules, so as to produce a combinatorially large number of novel data? What signal in the…

Machine Learning · Statistics 2025-06-05 Alessandro Favero , Antonio Sclocchi , Francesco Cagnetta , Pascal Frossard , Matthieu Wyart