English
Related papers

Related papers: To Understand Representation of Layer-aware Sequen…

200 papers

The incredible success of transformers on sequence modeling tasks can be largely attributed to the self-attention mechanism, which allows information to be transferred between different parts of a sequence. Self-attention allows…

Machine Learning · Computer Science 2024-08-14 Eshaan Nichani , Alex Damian , Jason D. Lee

Graph convolutional networks (GCNs) have achieved remarkable learning ability for dealing with various graph structural data recently. In general, deep GCNs do not work well since graph convolution in conventional GCNs is a special form of…

Machine Learning · Computer Science 2021-12-08 Zhilong Xiong , Jia Cai

Motivation: Molecular interaction networks summarize complex biological processes as graphs, whose structure is informative of biological function at multiple scales. Simultaneously, omics technologies measure the variation or activity of…

Quantitative Methods · Quantitative Biology 2020-12-24 Ramin Hasibi , Tom Michoel

This work proposes a neural network architecture that learns policies for multiple agent classes in a heterogeneous multi-agent reinforcement setting. The proposed network uses directed labeled graph representations for states, encodes…

Artificial Intelligence · Computer Science 2020-10-22 Douglas De Rizzo Meneghetti , Reinaldo Augusto da Costa Bianchi

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph…

Computation and Language · Computer Science 2023-10-10 Junhan Yang , Zheng Liu , Shitao Xiao , Chaozhuo Li , Defu Lian , Sanjay Agrawal , Amit Singh , Guangzhong Sun , Xing Xie

We present a novel Multi-Relational Graph Convolutional Network (MRGCN) based framework to model on-road vehicle behaviors from a sequence of temporally ordered frames as grabbed by a moving monocular camera. The input to MRGCN is a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Sravan Mylavarapu , Mahtab Sandhu , Priyesh Vijayan , K Madhava Krishna , Balaraman Ravindran , Anoop Namboodiri

We present a scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs. We motivate the choice of our convolutional…

Machine Learning · Computer Science 2017-02-23 Thomas N. Kipf , Max Welling

We introduce an extension of the multi-instance learning problem where examples are organized as nested bags of instances (e.g., a document could be represented as a bag of sentences, which in turn are bags of words). This framework can be…

Machine Learning · Computer Science 2020-10-06 Alessandro Tibo , Manfred Jaeger , Paolo Frasconi

Many NLP applications can be framed as a graph-to-sequence learning problem. Previous work proposing neural architectures on this setting obtained promising results compared to grammar-based approaches but still rely on linearisation…

Computation and Language · Computer Science 2018-06-27 Daniel Beck , Gholamreza Haffari , Trevor Cohn

Graph neural networks (GNNs) have been used extensively for addressing problems in drug design and discovery. Both ligand and target molecules are represented as graphs with node and edge features encoding information about atomic elements…

Machine Learning · Computer Science 2021-10-14 Dhananjay Bhaskar , Jackson D. Grady , Michael A. Perlmutter , Smita Krishnaswamy

We present a novel graph Transformer generative adversarial network (GTGAN) to learn effective graph node relations in an end-to-end fashion for challenging graph-constrained architectural layout generation tasks. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Hao Tang , Ling Shao , Nicu Sebe , Luc Van Gool

Abstract Meaning Representation (AMR) parsing aims to extract an abstract semantic graph from a given sentence. The sequence-to-sequence approaches, which linearize the semantic graph into a sequence of nodes and edges and generate the…

Computation and Language · Computer Science 2023-10-16 Bofei Gao , Liang Chen , Peiyi Wang , Zhifang Sui , Baobao Chang

This paper introduces layout-aware graph modeling for multimodal RAG. Different from traditional RAG methods that mostly deal with flat text chunks, the proposed method takes into account the relationship of multimodalities by using a graph…

Computation and Language · Computer Science 2025-03-10 Jeff Yang , Duy-Khanh Vu , Minh-Tien Nguyen , Xuan-Quang Nguyen , Linh Nguyen , Hung Le

Scene graph generation aims to produce structured representations for images, which requires to understand the relations between objects. Due to the continuous nature of deep neural networks, the prediction of scene graphs is divided into…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Meng Wei , Chun Yuan , Xiaoyu Yue , Kuo Zhong

Node tokenized graph Transformers (GTs) have shown promising performance in node classification. The generation of token sequences is the key module in existing tokenized GTs which transforms the input graph into token sequences,…

Machine Learning · Computer Science 2025-02-13 Jinsong Chen , Chenyang Li , GaiChao Li , John E. Hopcroft , Kun He

We propose a selective encoding model to extend the sequence-to-sequence framework for abstractive sentence summarization. It consists of a sentence encoder, a selective gate network, and an attention equipped decoder. The sentence encoder…

Computation and Language · Computer Science 2017-07-31 Qingyu Zhou , Nan Yang , Furu Wei , Ming Zhou

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Graph Representation Learning (GRL) is an influential methodology, enabling a more profound understanding of graph-structured data and aiding graph clustering, a critical task across various domains. The recent incursion of attention…

Machine Learning · Computer Science 2023-08-15 Shuo Han , Jiacheng Liu , Jiayun Wu , Yinan Chen , Li Tao

Convolutional neural networks (CNNs) leverage the great power in representation learning on regular grid data such as image and video. Recently, increasing attention has been paid on generalizing CNNs to graph or network data which is…

Social and Information Networks · Computer Science 2018-08-21 Yao Ma , Suhang Wang , Charu C. Aggarwal , Dawei Yin , Jiliang Tang

Generative graph models create instances of graphs that mimic the properties of real-world networks. Generative models are successful at retaining pairwise associations in the underlying networks but often fail to capture higher-order…

Social and Information Networks · Computer Science 2019-11-14 Anuththari Gamage , Eli Chien , Jianhao Peng , Olgica Milenkovic