English
Related papers

Related papers: D-VAE: A Variational Autoencoder for Directed Acyc…

200 papers

Graphs are a fundamental abstraction for modeling relational data. However, graphs are discrete and combinatorial in nature, and learning representations suitable for machine learning tasks poses statistical and computational challenges. In…

Machine Learning · Statistics 2019-05-16 Aditya Grover , Aaron Zweig , Stefano Ermon

Graph self-supervised learning seeks to learn effective graph representations without relying on labeled data. Among various approaches, graph autoencoders (GAEs) have gained significant attention for their efficiency and scalability.…

Machine Learning · Computer Science 2025-06-17 Yang Liu , Deyu Bo , Wenxuan Cao , Yuan Fang , Yawen Li , Chuan Shi

Non-autoregressive Transformers (NATs) significantly reduce the decoding latency by generating all tokens in parallel. However, such independent predictions prevent NATs from capturing the dependencies between the tokens for generating…

Computation and Language · Computer Science 2022-05-17 Fei Huang , Hao Zhou , Yang Liu , Hang Li , Minlie Huang

We present RL-VAE, a graph-to-graph variational autoencoder that uses reinforcement learning to decode molecular graphs from latent embeddings. Methods have been described previously for graph-to-graph autoencoding, but these approaches…

Machine Learning · Computer Science 2019-06-06 Steven Kearnes , Li Li , Patrick Riley

Multimodal recommender systems amalgamate multimodal information (e.g., textual descriptions, images) into a collaborative filtering framework to provide more accurate recommendations. While the incorporation of multimodal information could…

Information Retrieval · Computer Science 2024-02-27 Xin Zhou , Chunyan Miao

Variational autoencoder (VAE) is a widely used generative model for learning latent representations. Burda et al. in their seminal paper showed that learning capacity of VAE is limited by over-pruning. It is a phenomenon where a significant…

Machine Learning · Computer Science 2020-08-10 Rayyan Ahmad Khan , Muhammad Umer Anwaar , Martin Kleinsteuber

Learning the structure of Directed Acyclic Graphs (DAGs) presents a significant challenge due to the vast combinatorial search space of possible graphs, which scales exponentially with the number of nodes. Recent advancements have redefined…

Machine Learning · Computer Science 2024-11-01 Klea Ziu , Slavomír Hanzely , Loka Li , Kun Zhang , Martin Takáč , Dmitry Kamzolov

Graph autoencoders (AE) and variational autoencoders (VAE) are powerful node embedding methods, but suffer from scalability issues. In this paper, we introduce FastGAE, a general framework to scale graph AE and VAE to large graphs with…

Machine Learning · Computer Science 2021-04-14 Guillaume Salha , Romain Hennequin , Jean-Baptiste Remy , Manuel Moussallam , Michalis Vazirgiannis

Directed acyclic graphs (DAGs) are directed graphs in which there is no path from a vertex to itself. DAGs are an omnipresent data structure in computer science and the problem of counting the DAGs of given number of vertices and to sample…

Discrete Mathematics · Computer Science 2025-10-03 Martin Pépin , Alfredo Viola

Latent representations of drugs and their targets produced by contemporary graph autoencoder-based models have proved useful in predicting many types of node-pair interactions on large networks, including drug-drug, drug-target, and…

Biomolecules · Quantitative Biology 2022-11-01 Nhat Khang Ngo , Truong Son Hy , Risi Kondor

Optimization of directed acyclic graph (DAG) structures has many applications, such as neural architecture search (NAS) and probabilistic graphical model learning. Encoding DAGs into real vectors is a dominant component in most…

Machine Learning · Computer Science 2022-12-14 Zehao Dong , Muhan Zhang , Fuhai Li , Yixin Chen

We propose a novel score-based approach to learning a directed acyclic graph (DAG) from observational data. We adapt a recently proposed continuous constrained optimization formulation to allow for nonlinear relationships between variables…

Machine Learning · Computer Science 2020-02-19 Sébastien Lachapelle , Philippe Brouillard , Tristan Deleu , Simon Lacoste-Julien

We propose a combination of a variational autoencoder and a transformer based model which fully utilises graph convolutional and graph pooling layers to operate directly on graphs. The transformer model implements a novel node encoding…

Machine Learning · Computer Science 2021-04-12 Joshua Mitton , Hans M. Senn , Klaas Wynne , Roderick Murray-Smith

Due to their high computational efficiency on a continuous space, gradient optimization methods have shown great potential in the neural architecture search (NAS) domain. The mapping of network representation from the discrete space to a…

Machine Learning · Computer Science 2020-06-20 Jian Li , Yong Liu , Jiankun Liu , Weiping Wang

Over the last few years, graph autoencoders (AE) and variational autoencoders (VAE) emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and…

Machine Learning · Computer Science 2020-06-18 Guillaume Salha , Romain Hennequin , Michalis Vazirgiannis

By composing graphical models with deep learning architectures, we learn generative models with the strengths of both frameworks. The structured variational autoencoder (SVAE) inherits structure and interpretability from graphical models,…

Machine Learning · Computer Science 2023-11-15 Harry Bendekgey , Gabriel Hope , Erik B. Sudderth

Bayesian networks represent relations between variables using a directed acyclic graph (DAG). Learning the DAG is an NP-hard problem and exact learning algorithms are feasible only for small sets of variables. We propose two scalable…

Machine Learning · Computer Science 2021-07-02 Pierre Gillot , Pekka Parviainen

Learning low-dimensional representations of single-cell transcriptomics has become instrumental to its downstream analysis. The state of the art is currently represented by neural network models such as variational autoencoders (VAEs) which…

Machine Learning · Computer Science 2024-02-01 Viktoria Schuster , Anders Krogh

We develop data-driven methods incorporating geometric and topological information to learn parsimonious representations of nonlinear dynamics from observations. The approaches learn nonlinear state-space models of the dynamics for general…

Machine Learning · Computer Science 2025-03-28 Ryan Lopez , Paul J. Atzberger

Graph autoencoders (GAE) and variational graph autoencoders (VGAE) emerged as two powerful groups of unsupervised node embedding methods, with various applications to graph-based machine learning problems such as link prediction and…

Machine Learning · Computer Science 2025-06-19 Guillaume Salha-Galvan