English
Related papers

Related papers: A Globally Normalized Neural Model for Semantic Pa…

200 papers

We introduce a globally normalized transition-based neural network model that achieves state-of-the-art part-of-speech tagging, dependency parsing and sentence compression results. Our model is a simple feed-forward neural network that…

Computation and Language · Computer Science 2016-06-09 Daniel Andor , Chris Alberti , David Weiss , Aliaksei Severyn , Alessandro Presta , Kuzman Ganchev , Slav Petrov , Michael Collins

Probabilistic context-free grammars (PCFGs) with neural parameterization have been shown to be effective in unsupervised phrase-structure grammar induction. However, due to the cubic computational complexity of PCFG representation and…

Computation and Language · Computer Science 2021-04-29 Songlin Yang , Yanpeng Zhao , Kewei Tu

This research introduces a new parsing approach, based on earlier syntactic work on context free grammar (CFG) and generalized phrase structure grammar (GPSG). The approach comprises both a new parsing algorithm and a set of syntactic rules…

Computation and Language · Computer Science 2026-02-17 Ghaly Hussein

Semantic parsing can be defined as the process of mapping natural language sentences into a machine interpretable, formal representation of its meaning. Semantic parsing using LSTM encoder-decoder neural networks have become promising…

Computation and Language · Computer Science 2018-07-20 Fabiano Ferreira Luz , Marcelo Finger

We consider two models for the sequence labeling (tagging) problem. The first one is a {\em Pattern-Based Conditional Random Field }(\PB), in which the energy of a string (chain labeling) $x=x_1\ldots x_n\in D^n$ is a sum of terms over…

Formal Languages and Automata Theory · Computer Science 2014-11-04 Rustem Takhanov , Vladimir Kolmogorov

Synchronous Context-Free Grammars (SCFGs), also known as syntax-directed translation schemata, are unlike context-free grammars in that they do not have a binary normal form. In general, parsing with SCFGs takes space and time polynomial in…

Formal Languages and Automata Theory · Computer Science 2013-11-27 Pierluigi Crescenzi , Daniel Gildea , Andrea Marino , Gianluca Rossi , Giorgio Satta

Future predictions on sequence data (e.g., videos or audios) require the algorithms to capture non-Markovian and compositional properties of high-level semantics. Context-free grammars are natural choices to capture such properties, but…

Machine Learning · Statistics 2018-06-12 Siyuan Qi , Baoxiong Jia , Song-Chun Zhu

Understanding how the structure of language can be learned from sentences alone is a central question in both cognitive science and machine learning. Studies of the internal representations of Large Language Models (LLMs) support their…

Machine Learning · Statistics 2026-02-10 Jack T. Parley , Francesco Cagnetta , Matthieu Wyart

In this paper we demonstrate that $\textit{context free grammar (CFG) based methods for grammar induction benefit from modeling lexical dependencies}$. This contrasts to the most popular current methods for grammar induction, which focus on…

Computation and Language · Computer Science 2020-07-31 Hao Zhu , Yonatan Bisk , Graham Neubig

We propose a new approach for universal lossless text compression, based on grammar compression. In the literature, a target string $T$ has been compressed as a context-free grammar $G$ in Chomsky normal form satisfying $L(G) = \{T\}$. Such…

Data Structures and Algorithms · Computer Science 2020-03-19 Hiroaki Naganuma , Diptarama Hendrian , Ryo Yoshinaka , Ayumi Shinohara , Naoki Kobayashi

Globally normalized neural sequence models are considered superior to their locally normalized equivalents because they may ameliorate the effects of label bias. However, when considering high-capacity neural parametrizations that condition…

Machine Learning · Computer Science 2019-04-16 Kartik Goyal , Chris Dyer , Taylor Berg-Kirkpatrick

Traditional Linear Genetic Programming (LGP) algorithms are based only on the selection mechanism to guide the search. Genetic operators combine or mutate random portions of the individuals, without knowing if the result will lead to a…

Neural and Evolutionary Computing · Computer Science 2017-04-05 Léo Françoso Dal Piccol Sotto , Vinícius Veloso de Melo

We propose a simple modification to existing neural machine translation (NMT) models that enables using a single universal model to translate between multiple languages while allowing for language specific parameterization, and that can…

Computation and Language · Computer Science 2018-08-28 Emmanouil Antonios Platanios , Mrinmaya Sachan , Graham Neubig , Tom Mitchell

We describe a Context Free Grammar (CFG) for Bangla language and hence we propose a Bangla parser based on the grammar. Our approach is very much general to apply in Bangla Sentences and the method is well accepted for parsing a language of…

Computation and Language · Computer Science 2012-01-11 K. M. Azharul Hasan , Al-Mahmud , Amit Mondal , Amit Saha

Rapid progress has been made towards question answering (QA) systems that can extract answers from text. Existing neural approaches make use of expensive bi-directional attention mechanisms or score all possible answer spans, limiting…

Computation and Language · Computer Science 2017-09-12 Jonathan Raiman , John Miller

This paper introduces a framework for formally establishing a connection between a portion of an algebraic language and a Graph Neural Network (GNN). The framework leverages Context-Free Grammars (CFG) to organize algebraic operations into…

Machine Learning · Computer Science 2023-10-05 Jason Piquenot , Aldo Moscatelli , Maxime Bérar , Pierre Héroux , Romain raveaux , Jean-Yves Ramel , Sébastien Adam

In this paper we consider the problem of context-free grammars comparison from the analysis point of view. We show that the problem can be reduced to numerical solution of systems of nonlinear matrix equations. The approach presented here…

Formal Languages and Automata Theory · Computer Science 2018-04-23 J. Joao Almeida , Eliana Grande , Georgi Smirnov

To model behavioral and neural correlates of language comprehension in naturalistic environments researchers have turned to broad-coverage tools from natural-language processing and machine learning. Where syntactic structure is explicitly…

Computation and Language · Computer Science 2023-04-18 Miloš Stanojević , Jonathan R. Brennan , Donald Dunagan , Mark Steedman , John T. Hale

Semantic parsing is the task of producing a structured meaning representation for natural language utterances or questions. Recent research has pointed out that the commonly-used sequence-to-sequence (seq2seq) semantic parsers struggle to…

Computation and Language · Computer Science 2022-06-06 Dora Jambor , Dzmitry Bahdanau

Phrase-based statistical machine translation (SMT) systems have previously been used for the task of grammatical error correction (GEC) to achieve state-of-the-art accuracy. The superiority of SMT systems comes from their ability to learn…

Computation and Language · Computer Science 2016-06-02 Shamil Chollampatt , Kaveh Taghipour , Hwee Tou Ng
‹ Prev 1 2 3 10 Next ›