English
Related papers

Related papers: Autoregressive Models for Sequences of Graphs

200 papers

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

We propose a first-order autoregressive (i.e. AR(1)) model for dynamic network processes in which edges change over time while nodes remain unchanged. The model depicts the dynamic changes explicitly. It also facilitates simple and…

Methodology · Statistics 2022-05-12 Binyan Jiang , Jailing Li , Qiwei Yao

This paper introduces Graph Convolutional Recurrent Network (GCRN), a deep learning model able to predict structured sequences of data. Precisely, GCRN is a generalization of classical recurrent neural networks (RNN) to data structured by…

Machine Learning · Statistics 2016-12-23 Youngjoo Seo , Michaël Defferrard , Pierre Vandergheynst , Xavier Bresson

The ability to model and predict ego-vehicle's surrounding traffic is crucial for autonomous pilots and intelligent driver-assistance systems. Acceleration prediction is important as one of the major components of traffic prediction. This…

Machine Learning · Computer Science 2020-05-11 Jianyu Su , Peter A. Beling , Rui Guo , Kyungtae Han

Session-based recommendation systems suggest relevant items to users by modeling user behavior and preferences using short-term anonymous sessions. Existing methods leverage Graph Neural Networks (GNNs) that propagate and aggregate…

Information Retrieval · Computer Science 2022-01-10 Sai Mitheran , Abhinav Java , Surya Kant Sahu , Arshad Shaikh

We propose an approach for improving sequence modeling based on autoregressive normalizing flows. Each autoregressive transform, acting across time, serves as a moving frame of reference, removing temporal correlations, and simplifying the…

Machine Learning · Computer Science 2022-03-09 Joseph Marino , Lei Chen , Jiawei He , Stephan Mandt

Graph convolutional networks (GCNs) enable end-to-end learning on graph structured data. However, many works assume a given graph structure. When the input graph is noisy or unavailable, one approach is to construct or learn a latent graph…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Avishkar Saha , Oscar Mendez , Chris Russell , Richard Bowden

The paper develops a general flexible framework for Network Autoregressive Processes (NAR), wherein the response of each node linearly depends on its past values, a prespecified linear combination of neighboring nodes and a set of…

Methodology · Statistics 2021-10-20 Hang Yin , Abolfazl Safikhani , George Michailidis

In this paper, we propose a novel graph-based approach for semi-supervised learning problems, which considers an adaptive adjacency of the examples throughout the unsupervised portion of the training. Adjacency of the examples is inferred…

Machine Learning · Computer Science 2020-08-06 Ozsel Kilinc , Ismail Uysal

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each…

Machine Learning · Computer Science 2022-05-25 Lukas Faber , Roger Wattenhofer

Autoregressive models have recently shown great promise in visual generation by leveraging discrete token sequences akin to language modeling. However, existing approaches often suffer from inefficiency, either due to token-by-token…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ruiqing Yang , Kaixin Zhang , Zheng Zhang , Shan You , Tao Huang

Classical graph algorithms work well for combinatorial problems that can be thoroughly formalized and abstracted. Once the algorithm is derived, it generalizes to instances of any size. However, developing an algorithm that handles complex…

Machine Learning · Computer Science 2022-12-12 Florian Grötschla , Joël Mathys , Roger Wattenhofer

Deep generative models have achieved great success in areas such as image, speech, and natural language processing in the past few years. Thanks to the advances in graph-based deep learning, and in particular graph representation learning,…

Machine Learning · Computer Science 2021-01-01 Faezeh Faez , Yassaman Ommi , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Graph Neural Networks (GNNs) and Graph Transformers (GTs) are now a fundamental paradigm for graph learning, combining the representation-learning capabilities of deep models with the sample efficiency induced by their inductive biases.…

Machine Learning · Computer Science 2026-05-19 Stefano Carotti , Marco Pacini , Alessio Gravina , Davide Bacciu , Bruno Lepri , Sebastiano Bontorin

Modeling complex spatial and temporal correlations in the correlated time series data is indispensable for understanding the traffic dynamics and predicting the future status of an evolving traffic system. Recent works focus on designing…

Machine Learning · Computer Science 2020-10-23 Lei Bai , Lina Yao , Can Li , Xianzhi Wang , Can Wang

Numerous important problems can be framed as learning from graph data. We propose a framework for learning convolutional neural networks for arbitrary graphs. These graphs may be undirected, directed, and with both discrete and continuous…

Machine Learning · Computer Science 2016-06-09 Mathias Niepert , Mohamed Ahmed , Konstantin Kutzkov

Autoregressive (AR) models have been the dominating approach to conditional sequence generation, but are suffering from the issue of high inference latency. Non-autoregressive (NAR) models have been recently proposed to reduce the latency…

Machine Learning · Computer Science 2020-07-01 Zhiqing Sun , Yiming Yang

Many NLP applications can be framed as a graph-to-sequence learning problem. Previous work proposing neural architectures on this setting obtained promising results compared to grammar-based approaches but still rely on linearisation…

Computation and Language · Computer Science 2018-06-27 Daniel Beck , Gholamreza Haffari , Trevor Cohn

Autoregressive models have emerged as a powerful approach for visual generation but suffer from slow inference speed due to their sequential token-by-token prediction process. In this paper, we propose a simple yet effective approach for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Yuqing Wang , Shuhuai Ren , Zhijie Lin , Yujin Han , Haoyuan Guo , Zhenheng Yang , Difan Zou , Jiashi Feng , Xihui Liu

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia