English
Related papers

Related papers: Learning Algebraic Multigrid Using Graph Neural Ne…

200 papers

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

Outstanding achievements of graph neural networks for spatiotemporal time series analysis show that relational constraints introduce an effective inductive bias into neural forecasting architectures. Often, however, the relational…

Machine Learning · Computer Science 2023-08-03 Andrea Cini , Daniele Zambon , Cesare Alippi

Learning the structure of Directed Acyclic Graphs (DAGs) presents a significant challenge due to the vast combinatorial search space of possible graphs, which scales exponentially with the number of nodes. Recent advancements have redefined…

Machine Learning · Computer Science 2024-11-01 Klea Ziu , Slavomír Hanzely , Loka Li , Kun Zhang , Martin Takáč , Dmitry Kamzolov

We consider learning an undirected graphical model from sparse data. While several efficient algorithms have been proposed for graphical lasso (GL), the alternating direction method of multipliers (ADMM) is the main approach taken…

Optimization and Control · Mathematics 2021-12-15 Jie Chen , Ryosuke Shimmura , Joe Suzuki

We propose a novel approach to iterated sparse matrix dense matrix multiplication, a fundamental computational kernel in scientific computing and graph neural network training. In cases where matrix sizes exceed the memory of a single…

In many machine learning tasks, models are trained to predict structure data such as graphs. For example, in natural language processing, it is very common to parse texts into dependency trees or abstract meaning representation (AMR)…

Computation and Language · Computer Science 2022-01-25 Hoang Thanh Lam , Gabriele Picco , Yufang Hou , Young-Suk Lee , Lam M. Nguyen , Dzung T. Phan , Vanessa López , Ramon Fernandez Astudillo

There has been a rise in the popularity of algebraic methods for graph algorithms given the development of the GraphBLAS library and other sparse matrix methods. An exemplar for these approaches is Breadth-First Search (BFS). The algebraic…

Data Structures and Algorithms · Computer Science 2021-05-14 Paul Burkhardt

Graph convolutional networks (GCNs) allow us to learn topologically-aware node embeddings, which can be useful for classification or link prediction. However, they are unable to capture long-range dependencies between nodes without adding…

Machine Learning · Computer Science 2023-08-17 Reza Namazi , Elahe Ghalebi , Sinead Williamson , Hamidreza Mahyar

Convolution-type integral equations commonly occur in signal processing and image processing. Discretizing these equations yields large and ill-conditioned linear systems. While the classic multigrid method is effective for solving linear…

Machine Learning · Computer Science 2026-03-03 Lingfeng Li , Yin King Chu , Raymond Chan , Justin Wan

Strength-of-connection algorithms play a key role in algebraic multigrid (AMG). Specifically, they determine which matrix nonzeros are classified as weak and so ignored when coarsening matrix graphs and defining interpolation sparsity…

Numerical Analysis · Mathematics 2026-04-16 Chris Siefert , Raymond Tuminaro , Daniel Sunderland

It is still a challenging task to learn a neural text generation model under the framework of generative adversarial networks (GANs) since the entire training process is not differentiable. The existing training strategies either suffer…

Computation and Language · Computer Science 2023-07-25 Liping Yuan , Jiehang Zeng , Xiaoqing Zheng

Sparse graph recovery methods work well where the data follows their assumptions but often they are not designed for doing downstream probabilistic queries. This limits their adoption to only identifying connections among the input…

Machine Learning · Computer Science 2024-10-23 Harsh Shrivastava , Urszula Chajewska

Optimization problems are considered in the framework of tropical algebra to minimize and maximize a nonlinear objective function defined on vectors over an idempotent semifield, and calculated using multiplicative conjugate transposition.…

Optimization and Control · Mathematics 2017-06-05 Nikolai Krivulin

In geometry processing, numerical optimization methods often involve solving sparse linear systems of equations. These linear systems have a structure that strongly resembles to adjacency graphs of the underlying mesh. We observe how…

Numerical Analysis · Computer Science 2015-10-06 Nicolas Ray , Sokolov Dmitry

To enable heterogeneous computing systems with autonomous programming and optimization capabilities, we propose a unified, end-to-end, programmable graph representation learning (PGL) framework that is capable of mining the complexity of…

Machine Learning · Computer Science 2022-04-27 Yao Xiao , Guixiang Ma , Nesreen K. Ahmed , Mihai Capota , Theodore Willke , Shahin Nazarian , Paul Bogdan

The inference and training stages of Graph Neural Networks (GNNs) are often dominated by the time required to compute a long sequence of matrix multiplications between the sparse graph adjacency matrix and its embedding. To accelerate these…

Data Structures and Algorithms · Computer Science 2024-09-05 João N. F. Alves , Samir Moustafa , Siegfried Benkner , Alexandre P. Francisco , Wilfried N. Gansterer , Luís M. S. Russo

Automatic segmentation of an image to identify all meaningful parts is one of the most challenging as well as useful tasks in a number of application areas. This is widely studied. Selective segmentation, less studied, aims to use limited…

Numerical Analysis · Mathematics 2019-07-08 Michael Roberts , Ke Chen , Klaus L. Irion

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

Node classification is an important problem in graph data management. It is commonly solved by various label propagation methods that work iteratively starting from a few labeled seed nodes. For graphs with arbitrary compatibilities between…

Machine Learning · Computer Science 2020-03-06 Krishna Kumar P. , Paul Langton , Wolfgang Gatterbauer

The similarity of graph structures, such as Meaning Representations (MRs), is often assessed via structural matching algorithms, such as Smatch (Cai and Knight, 2013). However, Smatch involves a combinatorial problem that suffers from…

Computation and Language · Computer Science 2023-06-02 Juri Opitz , Philipp Meier , Anette Frank
‹ Prev 1 8 9 10 Next ›