English
Related papers

Related papers: Statistical properties of probabilistic context-se…

200 papers

The present paper investigates non-asymptotic properties of two popular procedures of context tree (or Variable Length Markov Chains) estimation: Rissanen's algorithm Context and the Penalized Maximum Likelihood criterion. First showing how…

Statistics Theory · Mathematics 2011-06-30 Aurélien Garivier , Florencia Leonardi

The purpose of unconditional text generation is to train a model with real sentences, then generate novel sentences of the same quality and diversity as the training data. However, when different metrics are used for comparing the methods…

Computation and Language · Computer Science 2020-07-03 Ping Cai , Xingyuan Chen , Peng Jin , Hongjun Wang , Tianrui Li

The described tagger is based on a hidden Markov model and uses tags composed of features such as part-of-speech, gender, etc. The contextual probability of a tag (state transition probability) is deduced from the contextual probabilities…

cmp-lg · Computer Science 2008-02-03 Andre Kempe

Prefix parsing asks whether an input prefix can be extended to a complete string generated by a given grammar. In the weighted setting, it also provides prefix probabilities, which are central to context-free language modeling,…

Computation and Language · Computer Science 2026-05-05 Clemente Pasti , Andreas Opedal , Timothy J. O'Donnell , Ryan Cotterell , Tim Vieira

Traditional natural language parsers are based on rewrite rule systems developed in an arduous, time-consuming manner by grammarians. A majority of the grammarian's efforts are devoted to the disambiguation process, first hypothesizing…

cmp-lg · Computer Science 2016-08-31 David M. Magerman

This paper solves an open problem concerning the generative power of nonerasing context-free rewriting systems using a simple mechanism for checking for context dependencies, in the literature known as semi-conditional grammars of degree…

Formal Languages and Automata Theory · Computer Science 2010-04-22 Tomas Masopust

Transfer learning where the behavior of extracting transferable knowledge from the source domain(s) and reusing this knowledge to target domain has become a research area of great interest in the field of artificial intelligence.…

Machine Learning · Computer Science 2021-09-29 Junyu Xuan , Jie Lu , Guangquan Zhang

In this paper, we propose a semantic communication approach based on probabilistic graphical model (PGM). The proposed approach involves constructing a PGM from a training dataset, which is then shared as common knowledge between the…

Machine Learning · Computer Science 2024-08-09 Haowen Wan , Qianqian Yang , Jiancheng Tang , Zhiguo shi

Phrase-structure grammars are effective models for important syntactic and semantic aspects of natural languages, but can be computationally too demanding for use as language models in real-time speech recognition. Therefore, finite-state…

cmp-lg · Computer Science 2008-02-03 Fernando C. N. Pereira , Rebecca N. Wright

Context-free grammars (CFGs) are the de-facto formalism for declaratively describing concrete syntax for programming languages and generating parsers. One of the major challenges in defining a desired syntax is ruling out all possible…

Programming Languages · Computer Science 2026-02-23 Yunjeong Lee , Gokul Rajiv , Ilya Sergey

There is significant evidence that real-world communication cannot be reduced to sending signals with context-independent meaning. In this work, based on a variant of the classical Lewis (1969) signaling model, we explore the conditions for…

Artificial Intelligence · Computer Science 2024-08-06 Krzysztof Główka , Julian Zubek , Joanna Rączaszek-Leonardi

Neural QCFG is a grammar-based sequence-tosequence (seq2seq) model with strong inductive biases on hierarchical structures. It excels in interpretability and generalization but suffers from expensive inference. In this paper, we study two…

Computation and Language · Computer Science 2023-06-06 Chao Lou , Kewei Tu

Deep neural acoustic models benefit from context-dependent (CD) modeling of output symbols. We consider direct training of CTC networks with CD outputs, and identify two issues. The first one is frame-level normalization of probabilities in…

Computation and Language · Computer Science 2019-04-24 Jan Chorowski , Adrian Lancucki , Bartosz Kostka , Michal Zapotoczny

We study the problem of grammar-constrained context-free language reachability in graphs, focusing on complexity and empirical performance. We present an algorithmic framework for evaluating reachability queries constrained by context-free…

Data Structures and Algorithms · Computer Science 2026-03-02 Faruk Alpay , Levent Sarioglu

As the key to sentiment analysis, sentiment composition considers the classification of a constituent via classifications of its contained sub-constituents and rules operated on them. Such compositionality has been widely studied previously…

Computation and Language · Computer Science 2023-09-01 Zhongtao Jiang , Yuanzhe Zhang , Cao Liu , Jiansong Chen , Jun Zhao , Kang Liu

Slang is a common type of informal language, but its flexible nature and paucity of data resources present challenges for existing natural language systems. We take an initial step toward machine generation of slang by developing a…

Computation and Language · Computer Science 2021-05-25 Zhewei Sun , Richard Zemel , Yang Xu

Probability trees are one of the simplest models of causal generative processes. They possess clean semantics and -- unlike causal Bayesian networks -- they can represent context-specific causal dependencies, which are necessary for e.g.…

Artificial Intelligence · Computer Science 2020-11-13 Tim Genewein , Tom McGrath , Grégoire Déletang , Vladimir Mikulik , Miljan Martic , Shane Legg , Pedro A. Ortega

Measuring the complexity of tree structures can be beneficial in areas that use tree data structures for storage, communication, and processing purposes. This complexity can then be used to compress tree data structures to their…

Information Theory · Computer Science 2023-09-19 Amirmohammad Farzaneh , Mihai-Alin Badiu , Justin P. Coon

Deterministic graph grammars generate regular graphs, that form a structural extension of configuration graphs of pushdown systems. In this paper, we study a probabilistic extension of regular graphs obtained by labelling the terminal arcs…

Formal Languages and Automata Theory · Computer Science 2010-11-02 Nathalie Bertrand , Christophe Morvan

Generative Adversarial Networks (GANs) have shown great capacity on image generation, in which a discriminative model guides the training of a generative model to construct images that resemble real images. Recently, GANs have been extended…

Computation and Language · Computer Science 2018-08-24 Xinyue Liu , Xiangnan Kong , Lei Liu , Kuorong Chiang