English
Related papers

Related papers: Neural Topological Ordering for Computation Graphs

200 papers

Modeling distributed computing in a way enabling the use of formal methods is a challenge that has been approached from different angles, among which two techniques emerged at the turn of the century: protocol complexes, and directed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-21 Pierre Fraigniaud , Ami Paz

The Transformer architecture has achieved remarkable success in a number of domains including natural language processing and computer vision. However, when it comes to graph-structured data, transformers have not achieved competitive…

Machine Learning · Computer Science 2022-10-11 Zaixi Zhang , Qi Liu , Qingyong Hu , Chee-Kong Lee

Causal structure learning has been a challenging task in the past decades and several mainstream approaches such as constraint- and score-based methods have been studied with theoretical guarantees. Recently, a new approach has transformed…

Machine Learning · Computer Science 2019-11-19 Ignavier Ng , Shengyu Zhu , Zhitang Chen , Zhuangyan Fang

Causal discovery, the learning of causality in a data mining scenario, has been of strong scientific and theoretical interest as a starting point to identify "what causes what?" Contingent on assumptions and a proper learning algorithm, it…

Methodology · Statistics 2022-05-23 Gabriel Ruiz , Oscar Hernan Madrid Padilla , Qing Zhou

Compared to sequential learning models, graph-based neural networks exhibit some excellent properties, such as ability capturing global information. In this paper, we investigate graph-based neural networks for text classification problem.…

Computation and Language · Computer Science 2020-02-27 Xien Liu , Xinxin You , Xiao Zhang , Ji Wu , Ping Lv

In this work, we propose novel families of positional encodings tailored to graph neural networks obtained with quantum computers. These encodings leverage the long-range correlations inherent in quantum systems that arise from mapping the…

Sentence ordering is to restore the original paragraph from a set of sentences. It involves capturing global dependencies among sentences regardless of their input order. In this paper, we propose a novel and flexible graph-based neural…

Computation and Language · Computer Science 2019-12-17 Yongjing Yin , Linfeng Song , Jinsong Su , Jiali Zeng , Chulun Zhou , Jiebo Luo

Many applications like pointer analysis and incremental compilation require maintaining a topological ordering of the nodes of a directed acyclic graph (DAG) under dynamic updates. All known algorithms for this problem are either only…

Data Structures and Algorithms · Computer Science 2008-02-08 Deepak Ajwani , Tobias Friedrich

Optimization of directed acyclic graph (DAG) structures has many applications, such as neural architecture search (NAS) and probabilistic graphical model learning. Encoding DAGs into real vectors is a dominant component in most…

Machine Learning · Computer Science 2022-12-14 Zehao Dong , Muhan Zhang , Fuhai Li , Yixin Chen

We train an agent to navigate in 3D environments using a hierarchical strategy including a high-level graph based planner and a local policy. Our main contribution is a data driven learning based approach for planning under uncertainty in…

Machine Learning · Computer Science 2020-07-13 Edward Beeching , Jilles Dibangoye , Olivier Simonin , Christian Wolf

We view molecular optimization as a graph-to-graph translation problem. The goal is to learn to map from one molecular graph to another with better properties based on an available corpus of paired molecules. Since molecules can be…

Machine Learning · Computer Science 2019-01-30 Wengong Jin , Kevin Yang , Regina Barzilay , Tommi Jaakkola

We propose a continuous optimization framework for discovering a latent directed acyclic graph (DAG) from observational data. Our approach optimizes over the polytope of permutation vectors, the so-called Permutahedron, to learn a…

Machine Learning · Computer Science 2023-02-14 Valentina Zantedeschi , Luca Franceschi , Jean Kaddour , Matt J. Kusner , Vlad Niculae

We consider a decentralized optimization problem for networks affected by communication delays. Examples of such networks include collaborative machine learning, sensor networks, and multi-agent systems. To mimic communication delays, we…

Machine Learning · Computer Science 2024-10-03 Tomas Ortega , Hamid Jafarkhani

Node2vec is a graph embedding method that learns a vector representation for each node of a weighted graph while seeking to preserve relative proximity and global structure. Numerical experiments suggest Node2vec struggles to recreate the…

Machine Learning · Statistics 2023-09-18 Yasuaki Hiraoka , Yusuke Imoto , Killian Meehan , Théo Lacombe , Toshiaki Yachimura

This paper proposes a deep Convolutional Neural Network(CNN) with strong generalization ability for structural topology optimization. The architecture of the neural network is made up of encoding and decoding parts, which provide down- and…

Machine Learning · Computer Science 2020-04-01 Yiquan Zhang , Bo Peng , Xiaoyi Zhou , Cheng Xiang , Dalei Wang

Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Xiang Gao , Wei Hu , Guo-Jun Qi

For distributed graph processing on massive graphs, a graph is partitioned into multiple equally-sized parts which are distributed among machines in a compute cluster. In the last decade, many partitioning algorithms have been developed…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-12 Nikolai Merkel , Ruben Mayer , Tawkir Ahmed Fakir , Hans-Arno Jacobsen

Aiming at better representing multivariate relationships, this paper investigates a motif dimensional framework for higher-order graph learning. The graph learning effectiveness can be improved through OFFER. The proposed framework mainly…

Social and Information Networks · Computer Science 2020-08-31 Shuo Yu , Feng Xia , Jin Xu , Zhikui Chen , Ivan Lee

Computing latent representations for graph-structured data is an ubiquitous learning task in many industrial and academic applications ranging from molecule synthetization to social network analysis and recommender systems. Knowledge graphs…

Neural and Evolutionary Computing · Computer Science 2023-08-25 Victor Caceres Chian , Marcel Hildebrandt , Thomas Runkler , Dominik Dold

Graph neural network models have been extensively used to learn node representations for graph structured data in an end-to-end setting. These models often rely on localized first order approximations of spectral graph convolutions and…

Machine Learning · Computer Science 2020-10-20 Mohammed Haroon Dupty , Wee Sun Lee