English
Related papers

Related papers: Hierarchical Bracketing Encodings for Dependency P…

200 papers

Recent progress on parse tree encoder for sentence representation learning is notable. However, these works mainly encode tree structures recursively, which is not conducive to parallelization. On the other hand, these works rarely take…

Computation and Language · Computer Science 2022-05-10 Junhua Ma , Jiajun Li , Yuxuan Liu , Shangbo Zhou , Xue Li

The connection between dependency trees and spanning trees is exploited by the NLP community to train and to decode graph-based dependency parsers. However, the NLP literature has missed an important difference between the two structures:…

Computation and Language · Computer Science 2020-10-08 Ran Zmigrod , Tim Vieira , Ryan Cotterell

In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models.…

Machine Learning · Computer Science 2021-09-07 Junran Wu , Jianhao Li , Yicheng Pan , Ke Xu

We introduce a novel architecture for dependency parsing: \emph{stack-pointer networks} (\textbf{\textsc{StackPtr}}). Combining pointer networks~\citep{vinyals2015pointer} with an internal stack, the proposed model first reads and encodes…

Computation and Language · Computer Science 2018-05-04 Xuezhe Ma , Zecong Hu , Jingzhou Liu , Nanyun Peng , Graham Neubig , Eduard Hovy

We propose methods that enable efficient hierarchical classification in parallel. Our methods transform a batch of classification scores and labels, corresponding to given nodes in a semantic tree, to scores and labels corresponding to all…

Machine Learning · Computer Science 2022-09-22 Franz A. Heinsen

Conventional graph-based dependency parsers guarantee a tree structure both during training and inference. Instead, we formalize dependency parsing as the problem of independently selecting the head of each word in a sentence. Our model…

Computation and Language · Computer Science 2016-12-23 Xingxing Zhang , Jianpeng Cheng , Mirella Lapata

Transition-based top-down parsing with pointer networks has achieved state-of-the-art results in multiple parsing tasks, while having a linear time complexity. However, the decoder of these parsers has a sequential structure, which does not…

Computation and Language · Computer Science 2022-10-21 Linlin Liu , Xiang Lin , Shafiq Joty , Simeng Han , Lidong Bing

Language recognition system is typically trained directly to optimize classification error on the target language labels, without using the external, or meta-information in the estimation of the model parameters. However labels are not…

Artificial Intelligence · Computer Science 2018-05-01 Trung Ngo Trong , Ville Hautamäki , Kristiina Jokinen

Higher-order methods for dependency parsing can partially but not fully address the issue that edges in dependency trees should be constructed at the text span/subtree level rather than word level. In this paper, we propose a new method for…

Computation and Language · Computer Science 2022-05-24 Leilei Gan , Yuxian Meng , Kun Kuang , Xiaofei Sun , Chun Fan , Fei Wu , Jiwei Li

We study the problem of learning a hierarchical tree representation of data from labeled samples, taken from an arbitrary (and possibly adversarial) distribution. Consider a collection of data tuples labeled according to their hierarchical…

Machine Learning · Computer Science 2023-02-10 Dmitrii Avdiukhin , Grigory Yaroslavtsev , Danny Vainstein , Orr Fischer , Sauman Das , Faraz Mirza

Multi-label classification is a common challenge in various machine learning applications, where a single data instance can be associated with multiple classes simultaneously. The current paper proposes a novel tree-based method for…

Methodology · Statistics 2024-05-01 Chhavi Tyagi , Wenge Guo

We present a semantic parser for Abstract Meaning Representations which learns to parse strings into tree representations of the compositional structure of an AMR graph. This allows us to use standard neural techniques for supertagging and…

Computation and Language · Computer Science 2021-06-10 Jonas Groschwitz , Matthias Lindemann , Meaghan Fowlie , Mark Johnson , Alexander Koller

Sparse coding consists in representing signals as sparse linear combinations of atoms selected from a dictionary. We consider an extension of this framework where the atoms are further assumed to be embedded in a tree. This is achieved…

Machine Learning · Statistics 2011-08-18 Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski , Francis Bach

In this paper, we introduce TreeCoders, a novel family of transformer trees. We moved away from traditional linear transformers to complete k-ary trees. Transformer blocks serve as nodes, and generic classifiers learn to select the best…

Computation and Language · Computer Science 2024-11-12 Pierre Colonna D'Istria , Abdulrahman Altahhan

Arc-standard derivations over projective dependency trees can be interpreted as the incremental construction of lexicalized ordered trees with contiguous yields. Each \textsc{shift}, \textsc{leftarc}, and \textsc{rightarc} transition…

Computation and Language · Computer Science 2026-05-28 Zihao Huang , Ai Ka Lee , Jungyeul Park

We present substructure distribution projection (SubDP), a technique that projects a distribution over structures in one domain to another, by projecting substructure distributions separately. Models for the target domains can be then…

Computation and Language · Computer Science 2021-10-19 Haoyue Shi , Kevin Gimpel , Karen Livescu

We propose a novel architecture for graph-based dependency parsing that explicitly constructs vectors, from which both arcs and labels are scored. Our method addresses key limitations of the standard two-pipeline approach by unifying arc…

Computation and Language · Computer Science 2025-01-17 Nicolas Floquet , Joseph Le Roux , Nadi Tomeh , Thierry Charnois

The connection between the maximum spanning tree in a directed graph and the best dependency tree of a sentence has been exploited by the NLP community. However, for many dependency parsing schemes, an important detail of this approach is…

Computation and Language · Computer Science 2021-06-03 Ran Zmigrod , Tim Vieira , Ryan Cotterell

Modern graph-based syntactic dependency parsers operate by predicting, for each token within a sentence, a probability distribution over its possible syntactic heads (i.e., all other tokens) and then extracting a maximum spanning tree from…

Computation and Language · Computer Science 2021-06-16 Stefan Grünewald

The focus of this paper is on the evaluation of sixteen labeling methods for hierarchical document clusters over five datasets. All of the methods are independent from clustering algorithms, applied subsequently to the dendrogram…

Information Retrieval · Computer Science 2018-05-28 Maria Fernanda Moura , Fabiano Fernandes dos Santos , Solange Oliveira Rezende