English
Related papers

Related papers: Modeling Graph Structure in Transformer for Better…

200 papers

The dominant graph-to-sequence transduction models employ graph neural networks for graph representation learning, where the structural information is reflected by the receptive field of neurons. Unlike graph neural networks that restrict…

Computation and Language · Computer Science 2019-12-03 Deng Cai , Wai Lam

AMR-to-text generation is a problem recently introduced to the NLP community, in which the goal is to generate sentences from Abstract Meaning Representation (AMR) graphs. Sequence-to-sequence models can be used to this end by converting…

Computation and Language · Computer Science 2019-05-22 Marco Damonte , Shay B. Cohen

Generating text from graph-based data, such as Abstract Meaning Representation (AMR), is a challenging task due to the inherent difficulty in how to properly encode the structure of a graph with labeled edges. To address this difficulty, we…

Computation and Language · Computer Science 2019-09-04 Leonardo F. R. Ribeiro , Claire Gardent , Iryna Gurevych

Predicting linearized Abstract Meaning Representation (AMR) graphs using pre-trained sequence-to-sequence Transformer models has recently led to large improvements on AMR parsing benchmarks. These parsers are simple and avoid explicit…

Computation and Language · Computer Science 2021-11-01 Jiawei Zhou , Tahira Naseem , Ramón Fernandez Astudillo , Young-Suk Lee , Radu Florian , Salim Roukos

Abstract meaning representation (AMR) highlights the core semantic information of text in a graph structure. Recently, pre-trained language models (PLMs) have advanced tasks of AMR parsing and AMR-to-text generation, respectively. However,…

Computation and Language · Computer Science 2022-05-05 Xuefeng Bai , Yulong Chen , Yue Zhang

The celebrated Seq2Seq technique and its numerous variants achieve excellent performance on many tasks such as neural machine translation, semantic parsing, and math word problem solving. However, these models either only consider input…

Computation and Language · Computer Science 2020-10-07 Shucheng Li , Lingfei Wu , Shiwei Feng , Fangli Xu , Fengyuan Xu , Sheng Zhong

Sequence-to-sequence models have shown strong performance across a broad range of applications. However, their application to parsing and generating text usingAbstract Meaning Representation (AMR)has been limited, due to the relatively…

Computation and Language · Computer Science 2017-08-21 Ioannis Konstas , Srinivasan Iyer , Mark Yatskar , Yejin Choi , Luke Zettlemoyer

Meaning Representations (AMRs) are broad-coverage sentence-level semantic graphs. Existing approaches to generating text from AMR have focused on training sequence-to-sequence or graph-to-sequence models on AMR annotated data only. In this…

Computation and Language · Computer Science 2020-05-28 Manuel Mager , Ramon Fernandez Astudillo , Tahira Naseem , Md Arafat Sultan , Young-Suk Lee , Radu Florian , Salim Roukos

Neural machine translation (NMT) usually works in a seq2seq learning way by viewing either source or target sentence as a linear sequence of words, which can be regarded as a special case of graph, taking words in the sequence as nodes and…

Computation and Language · Computer Science 2020-09-17 Sufeng Duan , Hai Zhao , Rui Wang

Abstract Meaning Representation parsing is a sentence-to-graph prediction task where target nodes are not explicitly aligned to sentence tokens. However, since graph nodes are semantically based on one or more sentence tokens, implicit…

Computation and Language · Computer Science 2021-05-19 Jiawei Zhou , Tahira Naseem , Ramón Fernandez Astudillo , Radu Florian

In the literature, the research on abstract meaning representation (AMR) parsing is much restricted by the size of human-curated dataset which is critical to build an AMR parser with good performance. To alleviate such data size…

Computation and Language · Computer Science 2020-10-06 Dongqin Xu , Junhui Li , Muhua Zhu , Min Zhang , Guodong Zhou

We propose a novel framework for modeling the interaction between graphical structures and the natural language text associated with their nodes and edges. Existing approaches typically fall into two categories. On group ignores the…

Computation and Language · Computer Science 2021-05-12 Aryan Arbabi , Mingqiu Wang , Laurent El Shafey , Nan Du , Izhak Shafran

The problem of AMR-to-text generation is to recover a text representing the same meaning as an input AMR graph. The current state-of-the-art method uses a sequence-to-sequence model, leveraging LSTM for encoding a linearized AMR structure.…

Computation and Language · Computer Science 2018-08-29 Linfeng Song , Yue Zhang , Zhiguo Wang , Daniel Gildea

Scene graph is structured semantic representation that can be modeled as a form of graph from images and texts. Image-based scene graph generation research has been actively conducted until recently, whereas text-based scene graph…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Woo Suk Choi , Yu-Jung Heo , Byoung-Tak Zhang

We present a novel abstractive summarization framework that draws on the recent development of a treebank for the Abstract Meaning Representation (AMR). In this framework, the source text is parsed to a set of AMR graphs, the graphs are…

Computation and Language · Computer Science 2018-05-29 Fei Liu , Jeffrey Flanigan , Sam Thomson , Norman Sadeh , Noah A. Smith

We propose an attention-based model that treats AMR parsing as sequence-to-graph transduction. Unlike most AMR parsers that rely on pre-trained aligners, external semantic resources, or data augmentation, our proposed parser is…

Computation and Language · Computer Science 2019-06-25 Sheng Zhang , Xutai Ma , Kevin Duh , Benjamin Van Durme

This work addresses the task of generating English sentences from Abstract Meaning Representation (AMR) graphs. To cope with this task, we transform each input AMR graph into a structure similar to a dependency tree and annotate it with…

Computation and Language · Computer Science 2017-07-25 Timo Schick

We propose a new end-to-end model that treats AMR parsing as a series of dual decisions on the input sequence and the incrementally constructed graph. At each time step, our model performs multiple rounds of attention, reasoning, and…

Computation and Language · Computer Science 2020-04-30 Deng Cai , Wai Lam

We present Graformer, a novel Transformer-based encoder-decoder architecture for graph-to-text generation. With our novel graph self-attention, the encoding of a node relies on all nodes in the input graph - not only direct neighbors -…

Computation and Language · Computer Science 2021-04-28 Martin Schmitt , Leonardo F. R. Ribeiro , Philipp Dufter , Iryna Gurevych , Hinrich Schütze

Convolutional neural networks (CNN) have recently achieved remarkable performance in a wide range of applications. In this research, we equip convolutional sequence-to-sequence (seq2seq) model with an efficient graph linearization technique…

Computation and Language · Computer Science 2017-11-21 Lai Dac Viet , Vu Trong Sinh , Nguyen Le Minh , Ken Satoh
‹ Prev 1 2 3 10 Next ›