中文
相关论文

相关论文: Incorporating Graph Information in Transformer-bas…

200 篇论文

Metric learning projects samples into an embedded space, where similarities and dissimilarities are quantified based on their learned representations. However, existing methods often rely on label-guided representation learning, where…

声音 · 计算机科学 2025-01-17 Donghuo Zeng , Kazushi Ikeda

We present a transition-based AMR parser that directly generates AMR parses from plain text. We use Stack-LSTMs to represent our parser state and make decisions greedily. In our experiments, we show that our parser achieves very competitive…

计算与语言 · 计算机科学 2017-08-03 Miguel Ballesteros , Yaser Al-Onaizan

Knowledge graphs play a pivotal role in various applications, such as question-answering and fact-checking. Abstract Meaning Representation (AMR) represents text as knowledge graphs. Evaluating the quality of these graphs involves matching…

计算与语言 · 计算机科学 2024-04-03 Zoher Kachwala , Jisun An , Haewoon Kwak , Filippo Menczer

Abstract Meaning Representation (AMR) provides many information of a sentence such as semantic relations, coreferences, and named entity relation in one representation. However, research on AMR parsing for Indonesian sentence is fairly…

计算与语言 · 计算机科学 2021-03-08 Adylan Roaffa Ilmy , Masayu Leylia Khodra

Convolutional neural networks (CNN) have recently achieved remarkable performance in a wide range of applications. In this research, we equip convolutional sequence-to-sequence (seq2seq) model with an efficient graph linearization technique…

计算与语言 · 计算机科学 2017-11-21 Lai Dac Viet , Vu Trong Sinh , Nguyen Le Minh , Ken Satoh

Analytical reasoning is an essential and challenging task that requires a system to analyze a scenario involving a set of particular circumstances and perform reasoning over it to make conclusions. In this paper, we study the challenge of…

计算与语言 · 计算机科学 2021-04-16 Wanjun Zhong , Siyuan Wang , Duyu Tang , Zenan Xu , Daya Guo , Jiahai Wang , Jian Yin , Ming Zhou , Nan Duan

We present TRANX, a transition-based neural semantic parser that maps natural language (NL) utterances into formal meaning representations (MRs). TRANX uses a transition system based on the abstract syntax description language for the…

计算与语言 · 计算机科学 2018-10-08 Pengcheng Yin , Graham Neubig

In visual tasks, large teacher models capture essential features and deep information, enhancing performance. However, distilling this information into smaller student models often leads to performance loss due to structural differences and…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Zhiwei Wang , Jun Huang , Longhua Ma , Chengyu Wu , Hongyu Ma

We evaluate the character-level translation method for neural semantic parsing on a large corpus of sentences annotated with Abstract Meaning Representations (AMRs). Using a sequence-to-sequence model, and some trivial preprocessing and…

计算与语言 · 计算机科学 2017-10-10 Rik van Noord , Johan Bos

The goal of this work is to train strong models for visual speech recognition without requiring human annotated ground truth data. We achieve this by distilling from an Automatic Speech Recognition (ASR) model that has been trained on a…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Triantafyllos Afouras , Joon Son Chung , Andrew Zisserman

Dynamic graph representation learning strategies are based on different neural architectures to capture the graph evolution over time. However, the underlying neural architectures require a large amount of parameters to train and suffer…

机器学习 · 计算机科学 2020-11-12 Stefanos Antaris , Dimitrios Rafailidis

Automatic Modulation Recognition (AMR) detects modulation schemes of received signals for further processing of signals without any priori information, which is critically important for civil spectrum regulation, information countermea…

网络与互联网体系结构 · 计算机科学 2025-08-20 Bojun Zhang

How can we learn effective node representations on textual graphs? Graph Neural Networks (GNNs) that use Language Models (LMs) to encode textual information of graphs achieve state-of-the-art performance in many node classification tasks.…

Pretrained language models (PLM) have recently advanced graph-to-text generation, where the input graph is linearized into a sequence and fed into the PLM to obtain its representation. However, efficiently encoding the graph structure in…

计算与语言 · 计算机科学 2021-09-09 Leonardo F. R. Ribeiro , Yue Zhang , Iryna Gurevych

Integrating the structural inductive biases of Graph Neural Networks (GNNs) with the global contextual modeling capabilities of Transformers represents a pivotal challenge in graph representation learning. While GNNs excel at capturing…

机器学习 · 计算机科学 2025-03-05 Zhihua Duan , Jialin Wang

Abstract Meaning Representation (AMR) parsing aims to translate sentences to semantic representation with a hierarchical structure, and is recently empowered by pretrained sequence-to-sequence models. However, there exists a gap between…

计算与语言 · 计算机科学 2022-04-27 Peiyi Wang , Liang Chen , Tianyu Liu , Damai Dai , Yunbo Cao , Baobao Chang , Zhifang Sui

Abstract Meaning Representation (AMR) annotation efforts have mostly focused on English. In order to train parsers on other languages, we propose a method based on annotation projection, which involves exploiting annotations in a source…

计算与语言 · 计算机科学 2018-02-27 Marco Damonte , Shay B. Cohen

Pre-trained language models have made great progress on dialogue tasks. However, these models are typically trained on surface dialogue text, thus are proven to be weak in understanding the main semantic meaning of a dialogue context. We…

计算与语言 · 计算机科学 2022-09-20 Xuefeng Bai , Linfeng Song , Yue Zhang

As alignment links are not given between English sentences and Abstract Meaning Representation (AMR) graphs in the AMR annotation, automatic alignment becomes indispensable for training an AMR parser. Previous studies formalize it as a…

计算与语言 · 计算机科学 2017-02-21 Chenhui Chu , Sadao Kurohashi

Abstractive summarization, the task of generating a concise summary of input documents, requires: (1) reasoning over the source document to determine the salient pieces of information scattered across the long document, and (2) composing a…