English
Related papers

Related papers: Graph2Seq: Graph to Sequence Learning with Attenti…

200 papers

Graph embedding is a transformation of nodes of a graph into a set of vectors. A~good embedding should capture the graph topology, node-to-node relationship, and other relevant information about the graph, its subgraphs, and nodes. If these…

Social and Information Networks · Computer Science 2022-06-22 Arash Dehghan-Kooshkghazi , Bogumił Kamiński , Łukasz Kraiński , Paweł Prałat , François Théberge

Graph-structured information offers rich contextual information that can enhance language models by providing structured relationships and hierarchies, leading to more expressive embeddings for various applications such as retrieval,…

While sequence-to-sequence (seq2seq) models achieve state-of-the-art performance in many natural language processing tasks, they can be too slow for real-time applications. One performance bottleneck is predicting the most likely next token…

Computation and Language · Computer Science 2019-07-26 Chunyang Xiao , Christoph Teichmann , Konstantine Arkoudas

Graph generation with Machine Learning is an open problem with applications in various research fields. In this work, we propose to cast the generative process of a graph into a sequential one, relying on a node ordering procedure. We use…

Machine Learning · Statistics 2020-04-24 Davide Bacciu , Alessio Micheli , Marco Podda

Sentence matching is a fundamental task of natural language processing with various applications. Most recent approaches adopt attention-based neural models to build word- or phrase-level alignment between two sentences. However, these…

Computation and Language · Computer Science 2021-10-22 Peng Cui , Le Hu , Yuanchao Liu

Multi-label text classification (MLTC) aims to assign multiple labels to each sample in the dataset. The labels usually have internal correlations. However, traditional methods tend to ignore the correlations between labels. In order to…

Computation and Language · Computer Science 2018-09-11 Pengcheng Yang , Shuming Ma , Yi Zhang , Junyang Lin , Qi Su , Xu Sun

Neural networks mapping sequences to sequences (seq2seq) lead to significant progress in machine translation and speech recognition. Their traditional architecture includes two recurrent networks (RNs) followed by a linear predictor. In…

Machine Learning · Computer Science 2021-06-29 Boris Rubinstein

Graphs representation learning has been a very active research area in recent years. The goal of graph representation learning is to generate graph representation vectors that capture the structure and features of large graphs accurately.…

Machine Learning · Computer Science 2022-06-16 Shima Khoshraftar , Aijun An

Subsequence anomaly detection in long sequences is an important problem with applications in a wide range of domains. However, the approaches proposed so far in the literature have severe limitations: they either require prior domain…

Machine Learning · Computer Science 2022-07-26 Paul Boniol , Themis Palpanas

Following the success of deep convolutional networks in various vision and speech related tasks, researchers have started investigating generalizations of the well-known technique for graph-structured data. A recently-proposed method called…

Social and Information Networks · Computer Science 2018-09-21 John Boaz Lee , Ryan A. Rossi , Xiangnan Kong , Sungchul Kim , Eunyee Koh , Anup Rao

We investigate the integration of a planning mechanism into sequence-to-sequence models using attention. We develop a model which can plan ahead in the future when it computes its alignments between input and output sequences, constructing…

Machine Learning · Computer Science 2017-11-29 Francis Dutil , Caglar Gulcehre , Adam Trischler , Yoshua Bengio

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

Machine Learning · Computer Science 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli

The paper addresses challenges in storing and retrieving sequences in contexts like anomaly detection, behavior prediction, and genetic information analysis. Associative Knowledge Graphs (AKGs) offer a promising approach by leveraging…

Artificial Intelligence · Computer Science 2025-09-11 Przemysław Stokłosa , Janusz A. Starzyk , Paweł Raif , Adrian Horzyk , Marcin Kowalik

Graphs are data structures used to represent irregular networks and are prevalent in numerous real-world applications. Previous methods directly model graph structures and achieve significant success. However, these methods encounter…

Machine Learning · Computer Science 2025-01-03 Shuo Yu , Yingbo Wang , Ruolin Li , Guchun Liu , Yanming Shen , Shaoxiong Ji , Bowen Li , Fengling Han , Xiuzhen Zhang , Feng Xia

Complex networks represented as node adjacency matrices constrains the application of machine learning and parallel algorithms. To address this limitation, network embedding (i.e., graph representation) has been intensively studied to learn…

Social and Information Networks · Computer Science 2019-10-24 Huang Zhenhua , Wang Zhenyu , Zhang Rui , Zhao Yangyang , Xie Xiaohui , Sharad Mehrotra

This work proposes an attention-based sequence-to-sequence model for handwritten word recognition and explores transfer learning for data-efficient training of HTR systems. To overcome training data scarcity, this work leverages models…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Dmitrijs Kass , Ekta Vats

In this paper, we propose an end-to-end graph learning framework, namely Deep Iterative and Adaptive Learning for Graph Neural Networks (DIAL-GNN), for jointly learning the graph structure and graph embeddings simultaneously. We first cast…

Machine Learning · Computer Science 2019-12-18 Yu Chen , Lingfei Wu , Mohammed J. Zaki

Graph-based and sequential methods are two popular recommendation paradigms, each excelling in its domain but lacking the ability to leverage signals from the other. To address this, we propose a novel method that integrates both approaches…

Information Retrieval · Computer Science 2025-01-30 Yuwei Cao , Liangwei Yang , Zhiwei Liu , Yuqing Liu , Chen Wang , Yueqing Liang , Hao Peng , Philip S. Yu

Graph Neural Networks (GNNs) are de facto solutions to structural data learning. However, it is susceptible to low-quality and unreliable structure, which has been a norm rather than an exception in real-world graphs. Existing graph…

Machine Learning · Computer Science 2023-03-20 Dongcheng Zou , Hao Peng , Xiang Huang , Renyu Yang , Jianxin Li , Jia Wu , Chunyang Liu , Philip S. Yu

Generating longer textual sequences when conditioned on the visual information is an interesting problem to explore. The challenge here proliferate over the standard vision conditioned sentence-level generation (e.g., image or video…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Aditya Mogadala , Marius Mosbach , Dietrich Klakow