English
Related papers

Related papers: Neural Topological Ordering for Computation Graphs

200 papers

The problem of accelerating drug discovery relies heavily on automatic tools to optimize precursor molecules to afford them with better biochemical properties. Our work in this paper substantially extends prior state-of-the-art on…

Chemical Physics · Physics 2019-10-22 Wengong Jin , Regina Barzilay , Tommi Jaakkola

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

We propose a novel sequence prediction method for sequential data capturing node traversals in graphs. Our method builds on a statistical modelling framework that combines multiple higher-order network models into a single multi-order…

Machine Learning · Computer Science 2023-10-25 Christoph Gote , Giona Casiraghi , Frank Schweitzer , Ingo Scholtes

We consider the problem of information aggregation in sensor networks, where one is interested in computing a function of the sensor measurements. We allow for block processing and study in-network function computation in directed graphs…

Information Theory · Computer Science 2015-03-19 Hemant Kowshik , P. R. Kumar

Seeking effective neural networks is a critical and practical field in deep learning. Besides designing the depth, type of convolution, normalization, and nonlinearities, the topological connectivity of neural networks is also important.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Kun Yuan , Quanquan Li , Jing Shao , Junjie Yan

The past few years have witnessed a growth in size and computational requirements for training and inference with neural networks. Currently, a common approach to address these requirements is to use a heterogeneous distributed environment…

We present a simple algorithm which maintains the topological order of a directed acyclic graph with n nodes under an online edge insertion sequence in O(n^{2.75}) time, independent of the number of edges m inserted. For dense DAGs, this is…

Data Structures and Algorithms · Computer Science 2007-05-23 Deepak Ajwani , Tobias Friedrich , Ulrich Meyer

Following the success of deep convolutional networks in various vision and speech related tasks, researchers have started investigating generalizations of the well-known technique for graph-structured data. A recently-proposed method called…

Social and Information Networks · Computer Science 2018-09-21 John Boaz Lee , Ryan A. Rossi , Xiangnan Kong , Sungchul Kim , Eunyee Koh , Anup Rao

Combinatorial optimization problems are notoriously challenging for neural networks, especially in the absence of labeled instances. This work proposes an unsupervised learning framework for CO problems on graphs that can provide integral…

Machine Learning · Computer Science 2021-03-09 Nikolaos Karalias , Andreas Loukas

There has been a surge of recent interest in learning representations for graph-structured data. Graph representation learning methods have generally fallen into three main categories, based on the availability of labeled data. The first,…

Machine Learning · Computer Science 2022-04-13 Ines Chami , Sami Abu-El-Haija , Bryan Perozzi , Christopher Ré , Kevin Murphy

Conditional graph generation tasks involve training a model to generate a graph given a set of input conditions. Many previous studies employ autoregressive models to incrementally generate graph components such as nodes and edges. However,…

Machine Learning · Computer Science 2023-05-26 Jie Bu , Kazi Sajeed Mehrab , Anuj Karpatne

Learning the structure of a causal graphical model using both observational and interventional data is a fundamental problem in many scientific fields. A promising direction is continuous optimization for score-based methods, which,…

Machine Learning · Computer Science 2022-02-28 Phillip Lippe , Taco Cohen , Efstratios Gavves

Computational topology is an area that revisits topological problems from an algorithmic point of view, and develops topological tools for improved algorithms. We survey results in computational topology that are concerned with graphs drawn…

Computational Geometry · Computer Science 2017-09-06 Éric Colin de Verdière

Training with backpropagation (BP) in standard deep learning consists of two main steps: a forward pass that maps a data point to its prediction, and a backward pass that propagates the error of this prediction back through the network.…

Machine Learning · Computer Science 2022-10-13 Tommaso Salvatori , Luca Pinchetti , Beren Millidge , Yuhang Song , Tianyi Bao , Rafal Bogacz , Thomas Lukasiewicz

Graph signal processing deals with algorithms and signal representations that leverage graph structures for multivariate data analysis. Often said graph topology is not readily available and may be time-varying, hence (dynamic) graph…

Signal Processing · Electrical Eng. & Systems 2024-09-20 Hector Chahuara , Gonzalo Mateos

Many optimization, inference and learning tasks can be accomplished efficiently by means of decentralized processing algorithms where the network topology (i.e., the graph) plays a critical role in enabling the interactions among…

Multiagent Systems · Computer Science 2020-08-06 Vincenzo Matta , Augusto Santos , Ali H. Sayed

Emerging reconfigurable optical communication technologies allow to enhance datacenter topologies with demand-aware links optimized towards traffic patterns. This paper studies the algorithmic problem of jointly optimizing topology and…

Performance · Computer Science 2024-01-10 Wenkai Dai , Michael Dinitz , Klaus-Tycho Foerster , Long Luo , Stefan Schmid

In a nutshell, submodular functions encode an intuitive notion of diminishing returns. As a result, submodularity appears in many important machine learning tasks such as feature selection and data summarization. Although there has been a…

Data Structures and Algorithms · Computer Science 2018-03-19 Marko Mitrovic , Moran Feldman , Andreas Krause , Amin Karbasi

Graph Transformer has demonstrated impressive capabilities in the field of graph representation learning. However, existing approaches face two critical challenges: (1) most models suffer from exponentially increasing computational…

Graph neural networks (GNNs) have excelled in various graph learning tasks, particularly node classification. However, their performance is often hampered by noisy measurements in real-world graphs, which can corrupt critical patterns in…

Machine Learning · Computer Science 2025-03-14 Shuyi Chen , Kaize Ding , Shixiang Zhu