English
Related papers

Related papers: Graph-to-Tree Neural Networks for Learning Structu…

200 papers

The majority of existing human parsing methods formulate the task as semantic segmentation, which regard each semantic category equally and fail to exploit the intrinsic physiological structure of human body, resulting in inaccurate…

Computer Vision and Pattern Recognition · Computer Science 2019-12-23 Ruyi Ji , Dawei Du , Libo Zhang , Longyin Wen , Yanjun Wu , Chen Zhao , Feiyue Huang , Siwei Lyu

Research on question answering with knowledge base has recently seen an increasing use of deep architectures. In this extended abstract, we study the application of the neural machine translation paradigm for question parsing. We employ a…

Computation and Language · Computer Science 2018-07-10 Tommaso Soru , Edgard Marx , André Valdestilhas , Diego Esteves , Diego Moussallem , Gustavo Publio

Semantic parsing has emerged as a significant and powerful paradigm for natural language interface and question answering systems. Traditional methods of building a semantic parser rely on high-quality lexicons, hand-crafted grammars and…

Computation and Language · Computer Science 2017-05-10 Liang Li , Pengyu Li , Yifan Liu , Tao Wan , Zengchang Qin

In this paper, we present a substantial step in better understanding the SOTA sequence-to-sequence (Seq2Seq) pretraining for neural machine translation~(NMT). We focus on studying the impact of the jointly pretrained decoder, which is the…

Computation and Language · Computer Science 2022-03-17 Wenxuan Wang , Wenxiang Jiao , Yongchang Hao , Xing Wang , Shuming Shi , Zhaopeng Tu , Michael Lyu

In the past few years, neural abstractive text summarization with sequence-to-sequence (seq2seq) models have gained a lot of popularity. Many interesting techniques have been proposed to improve seq2seq models, making them capable of…

Computation and Language · Computer Science 2020-09-22 Tian Shi , Yaser Keneshloo , Naren Ramakrishnan , Chandan K. Reddy

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

Machine Learning · Computer Science 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

Most neural machine translation (NMT) models are based on the sequential encoder-decoder framework, which makes no use of syntactic information. In this paper, we improve this model by explicitly incorporating source-side syntactic trees.…

Computation and Language · Computer Science 2017-07-19 Huadong Chen , Shujian Huang , David Chiang , Jiajun Chen

Seq2seq models have been shown to struggle with compositional generalization in semantic parsing, i.e. generalizing to unseen compositions of phenomena that the model handles correctly in isolation. We phrase semantic parsing as a two-step…

Computation and Language · Computer Science 2023-05-29 Matthias Lindemann , Alexander Koller , Ivan Titov

In deep neural networks, better results can often be obtained by increasing the complexity of previously developed basic models. However, it is unclear whether there is a way to boost performance by decreasing the complexity of such models.…

Machine Learning · Computer Science 2021-09-07 Junran Wu , Jianhao Li , Yicheng Pan , Ke Xu

We present a semantic parser for Abstract Meaning Representations which learns to parse strings into tree representations of the compositional structure of an AMR graph. This allows us to use standard neural techniques for supertagging and…

Computation and Language · Computer Science 2021-06-10 Jonas Groschwitz , Matthias Lindemann , Meaghan Fowlie , Mark Johnson , Alexander Koller

Identifying implicit discourse relations between text spans is a challenging task because it requires understanding the meaning of the text. To tackle this task, recent studies have tried several deep learning methods but few of them…

Computation and Language · Computer Science 2018-03-06 Yizhong Wang , Sujian Li , Jingfeng Yang , Xu Sun , Houfeng Wang

Frame semantic parsing is a semantic analysis task based on FrameNet which has received great attention recently. The task usually involves three subtasks sequentially: (1) target identification, (2) frame classification and (3) semantic…

Computation and Language · Computer Science 2021-09-28 Zhichao Lin , Yueheng Sun , Meishan Zhang

Advances in Large Language Models (LLMs) have led to remarkable capabilities, yet their inner mechanisms remain largely unknown. To understand these models, we need to unravel the functions of individual neurons and their contribution to…

Machine Learning · Computer Science 2023-06-01 Alex Foote , Neel Nanda , Esben Kran , Ioannis Konstas , Shay Cohen , Fazl Barez

Solving arithmetic word problems is a cornerstone task in assessing language understanding and reasoning capabilities in NLP systems. Recent works use automatic extraction and ranking of candidate solution equations providing the answer to…

Computation and Language · Computer Science 2021-03-10 Klim Zaporojets , Giannis Bekoulis , Johannes Deleu , Thomas Demeester , Chris Develder

Existing neural semantic parsers mainly utilize a sequence encoder, i.e., a sequential LSTM, to extract word order features while neglecting other valuable syntactic information such as dependency graph or constituent trees. In this paper,…

Computation and Language · Computer Science 2018-08-24 Kun Xu , Lingfei Wu , Zhiguo Wang , Mo Yu , Liwei Chen , Vadim Sheinin

Because of their superior ability to preserve sequence information over time, Long Short-Term Memory (LSTM) networks, a type of recurrent neural network with a more complex computational unit, have obtained strong results on a variety of…

Computation and Language · Computer Science 2015-06-02 Kai Sheng Tai , Richard Socher , Christopher D. Manning

Many problems in machine learning can be cast as learning functions from sets to graphs, or more generally to hypergraphs; in short, Set2Graph functions. Examples include clustering, learning vertex and edge features on graphs, and learning…

Machine Learning · Computer Science 2020-11-30 Hadar Serviansky , Nimrod Segol , Jonathan Shlomi , Kyle Cranmer , Eilam Gross , Haggai Maron , Yaron Lipman

Neural QCFG is a grammar-based sequence-tosequence (seq2seq) model with strong inductive biases on hierarchical structures. It excels in interpretability and generalization but suffers from expensive inference. In this paper, we study two…

Computation and Language · Computer Science 2023-06-06 Chao Lou , Kewei Tu

We propose a new deep neural network model and its training scheme for text classification. Our model Sequence-to-convolution Neural Networks(Seq2CNN) consists of two blocks: Sequential Block that summarizes input texts and Convolution…

Computation and Language · Computer Science 2020-06-04 Taehoon Kim , Jihoon Yang

Investigating graph feature learning becomes essentially important with the emergence of graph data in many real-world applications. Several graph neural network approaches are proposed for node feature learning and they generally follow a…

Machine Learning · Computer Science 2021-01-07 Hao Yuan , Shuiwang Ji