English
Related papers

Related papers: Effective Representation for Easy-First Dependency…

200 papers

We suggest a compositional vector representation of parse trees that relies on a recursive combination of recurrent-neural network encoders. To demonstrate its effectiveness, we use the representation as the backbone of a greedy, bottom-up…

Computation and Language · Computer Science 2018-04-25 Eliyahu Kiperwasser , Yoav Goldberg

We propose a technique for learning representations of parser states in transition-based dependency parsers. Our primary innovation is a new control structure for sequence-to-sequence neural networks---the stack LSTM. Like the conventional…

Computation and Language · Computer Science 2015-06-01 Chris Dyer , Miguel Ballesteros , Wang Ling , Austin Matthews , Noah A. Smith

We reduce phrase-representation parsing to dependency parsing. Our reduction is grounded on a new intermediate representation, "head-ordered dependency trees", shown to be isomorphic to constituent trees. By encoding order information in…

Computation and Language · Computer Science 2015-03-03 Daniel Fernández-González , André F. T. Martins

Neural networks with tree-based sentence encoders have shown better results on many downstream tasks. Most of existing tree-based encoders adopt syntactic parsing trees as the explicit structure prior. To study the effectiveness of…

Computation and Language · Computer Science 2018-08-30 Haoyue Shi , Hao Zhou , Jiaze Chen , Lei Li

Many complicated real-world tasks can be broken down into smaller, more manageable parts, and planning with prior knowledge extracted from these simplified pieces is crucial for humans to make accurate decisions. However, replicating this…

Artificial Intelligence · Computer Science 2024-05-21 Jingqing Ruan , Kaishen Wang , Qingyang Zhang , Dengpeng Xing , Bo Xu

Both bottom-up and top-down strategies have been used for neural transition-based constituent parsing. The parsing strategies differ in terms of the order in which they recognize productions in the derivation tree, where bottom-up…

Computation and Language · Computer Science 2017-07-18 Jiangming Liu , Yue Zhang

Latent tree learning models represent sentences by composing their words according to an induced parse tree, all based on a downstream task. These models often outperform baselines which use (externally provided) syntax trees to drive the…

Computation and Language · Computer Science 2020-01-16 Jean Maillard , Stephen Clark

Transformer-based models achieve state-of-the-art dependency parsing for high-resource languages, yet their advantage over simpler architectures in low-resource settings remains poorly understood. We evaluate four parsers -- the Biaffine…

Computation and Language · Computer Science 2026-05-05 Kevin Guan , Happy Buzaaba , Christiane Fellbaum

We propose a method to create document representations that reflect their internal structure. We modify Tree-LSTMs to hierarchically merge basic elements such as words and sentences into blocks of increasing complexity. Our Structure…

Computation and Language · Computer Science 2019-10-08 Khalil Mrini , Claudiu Musat , Michael Baeriswyl , Martin Jaggi

We present a simple LSTM-based transition-based dependency parser. Our model is composed of a single LSTM hidden layer replacing the hidden layer in the usual feed-forward network architecture. We also propose a new initialization method…

Computation and Language · Computer Science 2017-09-12 Mohab Elkaref , Bernd Bohnet

This thesis tackles the problem of learning efficient representations of complex, structured data with a natural application to web page and element classification. We hypothesise that the context around the element inside the web page is…

Machine Learning · Computer Science 2021-11-09 Cedric Cook

We introduce a neural network that represents sentences by composing their words according to induced binary parse trees. We use Tree-LSTM as our composition function, applied along a tree structure found by a fully differentiable natural…

Computation and Language · Computer Science 2020-01-16 Jean Maillard , Stephen Clark , Dani Yogatama

We recast dependency parsing as a sequence labeling problem, exploring several encodings of dependency trees as labels. While dependency parsing by means of sequence labeling had been attempted in existing work, results suggested that the…

Computation and Language · Computer Science 2019-04-01 Michalina Strzyz , David Vilares , Carlos Gómez-Rodríguez

We introduce a novel architecture for dependency parsing: \emph{stack-pointer networks} (\textbf{\textsc{StackPtr}}). Combining pointer networks~\citep{vinyals2015pointer} with an internal stack, the proposed model first reads and encodes…

Computation and Language · Computer Science 2018-05-04 Xuezhe Ma , Zecong Hu , Jingzhou Liu , Nanyun Peng , Graham Neubig , Eduard Hovy

The need for tree structure modelling on top of sequence modelling is an open issue in neural dependency parsing. We investigate the impact of adding a tree layer on top of a sequential model by recursively composing subtree representations…

Computation and Language · Computer Science 2019-02-27 Miryam de Lhoneux , Miguel Ballesteros , Joakim Nivre

We propose a transition-based dependency parser using Recurrent Neural Networks with Long Short-Term Memory (LSTM) units. This extends the feedforward neural network parser of Chen and Manning (2014) and enables modelling of entire…

Computation and Language · Computer Science 2016-07-01 Adhiguna Kuncoro , Yuichiro Sawai , Kevin Duh , Yuji Matsumoto

In Vietnamese dependency parsing, several methods have been proposed. Dependency parser which uses deep neural network model has been reported that achieved state-of-the-art results. In this paper, we proposed a new method which applies…

Computation and Language · Computer Science 2019-10-31 Binh Duc Nguyen , Kiet Van Nguyen , Ngan Luu-Thuy Nguyen

Transformer-based pre-trained language models (PLMs) have dramatically improved the state of the art in NLP across many tasks. This has led to substantial interest in analyzing the syntactic knowledge PLMs learn. Previous approaches to this…

Computation and Language · Computer Science 2020-10-20 Bowen Li , Taeuk Kim , Reinald Kim Amplayo , Frank Keller

To promote and further develop RST-style discourse parsing models, we need a strong baseline that can be regarded as a reference for reporting reliable experimental results. This paper explores a strong baseline by integrating existing…

Computation and Language · Computer Science 2022-11-02 Naoki Kobayashi , Tsutomu Hirao , Hidetaka Kamigaito , Manabu Okumura , Masaaki Nagata

We present extensions to a continuous-state dependency parsing method that makes it applicable to morphologically rich languages. Starting with a high-performance transition-based parser that uses long short-term memory (LSTM) recurrent…

Computation and Language · Computer Science 2015-08-12 Miguel Ballesteros , Chris Dyer , Noah A. Smith
‹ Prev 1 2 3 10 Next ›