English
Related papers

Related papers: Learning compositional structures for semantic gra…

200 papers

Dependency parsing is an important NLP task. A popular approach for dependency parsing is structured perceptron. Still, graph-based dependency parsing has the time complexity of $O(n^3)$, and it suffers from slow training. To deal with this…

Computation and Language · Computer Science 2017-03-03 Xu Sun , Shuming Ma

Sentence ordering is to restore the original paragraph from a set of sentences. It involves capturing global dependencies among sentences regardless of their input order. In this paper, we propose a novel and flexible graph-based neural…

Computation and Language · Computer Science 2019-12-17 Yongjing Yin , Linfeng Song , Jinsong Su , Jiali Zeng , Chulun Zhou , Jiebo Luo

When trained on language data, do transformers learn some arbitrary computation that utilizes the full capacity of the architecture or do they learn a simpler, tree-like computation, hypothesized to underlie compositional meaning systems…

Computation and Language · Computer Science 2022-11-07 Shikhar Murty , Pratyusha Sharma , Jacob Andreas , Christopher D. Manning

A longstanding question in cognitive science concerns the learning mechanisms underlying compositionality in human cognition. Humans can infer the structured relationships (e.g., grammatical rules) implicit in their sensory observations…

Machine Learning · Computer Science 2021-05-20 Jacob Russin , Roland Fernandez , Hamid Palangi , Eric Rosen , Nebojsa Jojic , Paul Smolensky , Jianfeng Gao

Recent work on aspect-level sentiment classification has demonstrated the efficacy of incorporating syntactic structures such as dependency trees with graph neural networks(GNN), but these approaches are usually vulnerable to parsing…

Computation and Language · Computer Science 2021-03-23 Xiaochen Hou , Peng Qi , Guangtao Wang , Rex Ying , Jing Huang , Xiaodong He , Bowen Zhou

Semantic parses are directed acyclic graphs (DAGs), so semantic parsing should be modeled as graph prediction. But predicting graphs presents difficult technical challenges, so it is simpler and more common to predict the linearized graphs…

Computation and Language · Computer Science 2019-10-22 Federico Fancellu , Sorcha Gilroy , Adam Lopez , Mirella Lapata

Pre-trained seq2seq models excel at graph semantic parsing with rich annotated data, but generalize worse to out-of-distribution (OOD) and long-tail examples. In comparison, symbolic parsers under-perform on population-level metrics, but…

Computation and Language · Computer Science 2023-01-30 Zi Lin , Jeremiah Liu , Jingbo Shang

Graphs are a highly expressive data structure, but it is often difficult for humans to find patterns from a complex graph. Hence, generating human-interpretable sequences from graphs have gained interest, called graph2seq learning. It is…

Machine Learning · Computer Science 2022-01-31 Takeshi D. Itoh , Takatomi Kubo , Kazushi Ikeda

We describe a new semantic parsing setting that allows users to query the system using both natural language questions and actions within a graphical user interface. Multiple time series belonging to an entity of interest are stored in a…

Computation and Language · Computer Science 2019-05-02 Charles Chen , Razvan Bunescu

We describe a procedure for explaining neurons in deep representations by identifying compositional logical concepts that closely approximate neuron behavior. Compared to prior work that uses atomic labels as explanations, analyzing neurons…

Machine Learning · Computer Science 2021-02-04 Jesse Mu , Jacob Andreas

Transition-based and graph-based dependency parsers have previously been shown to have complementary strengths and weaknesses: transition-based parsers exploit rich structural features but suffer from error propagation, while graph-based…

Computation and Language · Computer Science 2019-08-28 Artur Kulmizev , Miryam de Lhoneux , Johannes Gontrum , Elena Fano , Joakim Nivre

We propose a novel graph-based approach for semantic parsing that resolves two problems observed in the literature: (1) seq2seq models fail on compositional generalization tasks; (2) previous work using phrase structure parsers cannot cover…

Computation and Language · Computer Science 2023-02-16 Alban Petit , Caio Corro

We present a new framework for compositional distributional semantics in which the distributional contexts of lexemes are expressed in terms of anchored packed dependency trees. We show that these structures have the potential to capture…

Computation and Language · Computer Science 2016-08-26 David Weir , Julie Weeds , Jeremy Reffin , Thomas Kober

We present algorithms for aligning components of Abstract Meaning Representation (AMR) graphs to spans in English sentences. We leverage unsupervised learning in combination with heuristics, taking the best of both worlds from previous AMR…

Computation and Language · Computer Science 2021-06-14 Austin Blodgett , Nathan Schneider

Dependency trees convey rich structural information that is proven useful for extracting relations among entities in text. However, how to effectively make use of relevant information while ignoring irrelevant information from the…

Computation and Language · Computer Science 2020-09-08 Zhijiang Guo , Yan Zhang , Wei Lu

While neural network models have been successfully applied to domains that require substantial generalisation skills, recent studies have implied that they struggle when solving the task they are trained on requires inferring its underlying…

Computation and Language · Computer Science 2019-07-08 Dieuwke Hupkes , Anand Singh , Kris Korrel , German Kruszewski , Elia Bruni

Predicting linearized Abstract Meaning Representation (AMR) graphs using pre-trained sequence-to-sequence Transformer models has recently led to large improvements on AMR parsing benchmarks. These parsers are simple and avoid explicit…

Computation and Language · Computer Science 2021-11-01 Jiawei Zhou , Tahira Naseem , Ramón Fernandez Astudillo , Young-Suk Lee , Radu Florian , Salim Roukos

Syntactic parsing is the task of assigning a syntactic structure to a sentence. There are two popular syntactic parsing methods: constituency and dependency parsing. Recent works have used syntactic embeddings based on constituency trees,…

Computation and Language · Computer Science 2023-02-20 Subba Reddy Oota , Mounika Marreddy , Manish Gupta , Bapi Raju Surampud

Compositional generalization is the ability to generalize systematically to a new data distribution by combining known components. Although humans seem to have a great ability to generalize compositionally, state-of-the-art neural models…

Machine Learning · Computer Science 2021-06-22 Juyong Kim , Pradeep Ravikumar , Joshua Ainslie , Santiago Ontañón

In some contexts, well-formed natural language cannot be expected as input to information or communication systems. In these contexts, the use of grammar-independent input (sequences of uninflected semantic units like e.g.…

Computation and Language · Computer Science 2007-05-23 Pascal Vaillant