English
Related papers

Related papers: Neural Architecture Optimization with Graph VAE

200 papers

Graph neural networks (GNNs) have been successfully applied to learning representation on graphs in many relational tasks. Recently, researchers study neural architecture search (NAS) to reduce the dependence of human expertise and explore…

Machine Learning · Computer Science 2021-09-06 Shaofei Cai , Liang Li , Xinzhe Han , Zheng-jun Zha , Qingming Huang

Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on…

Machine Learning · Computer Science 2019-10-30 Muhan Zhang , Shali Jiang , Zhicheng Cui , Roman Garnett , Yixin Chen

In neural architecture search (NAS) methods based on latent space optimization (LSO), a deep generative model is trained to embed discrete neural architectures into a continuous latent space. In this case, different optimization algorithms…

Machine Learning · Computer Science 2025-04-28 Xuan Rao , Bo Zhao , Derong Liu

Neural Architecture Search (NAS) is a powerful tool for automating effective image processing DNN designing. The ranking has been advocated to design an efficient performance predictor for NAS. The previous contrastive method solves the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Bicheng Guo , Tao Chen , Shibo He , Haoyu Liu , Lilin Xu , Peng Ye , Jiming Chen

Graph Bayesian optimization (BO) has shown potential as a powerful and data-efficient tool for neural architecture search (NAS). Most existing graph BO works focus on developing graph surrogates models, i.e., metrics of networks and/or…

Machine Learning · Computer Science 2025-05-30 Yilin Xie , Shiqiang Zhang , Jixiang Qing , Ruth Misener , Calvin Tsay

How to improve generative modeling by better exploiting spatial regularities and coherence in images? We introduce a novel neural network for building image generators (decoders) and apply it to variational autoencoders (VAEs). In our…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Đorđe Miladinović , Aleksandar Stanić , Stefan Bauer , Jürgen Schmidhuber , Joachim M. Buhmann

Over the last few years, graph autoencoders (AE) and variational autoencoders (VAE) emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and…

Machine Learning · Computer Science 2020-06-18 Guillaume Salha , Romain Hennequin , Michalis Vazirgiannis

We introduce the variational graph auto-encoder (VGAE), a framework for unsupervised learning on graph-structured data based on the variational auto-encoder (VAE). This model makes use of latent variables and is capable of learning…

Machine Learning · Statistics 2016-11-23 Thomas N. Kipf , Max Welling

Existing neural architecture representation learning methods focus on continuous representation learning, typically using Variational Autoencoders (VAEs) to map discrete architectures onto a continuous Gaussian distribution. However,…

Neural Architecture Search (NAS) automates the design of high-performing neural networks but typically targets a single predefined task, thereby restricting its real-world applicability. To address this, Meta Neural Architecture Search…

Machine Learning · Computer Science 2025-08-14 Zijun Sun , Yanning Shen

In computer vision research, the process of automating architecture engineering, Neural Architecture Search (NAS), has gained substantial interest. Due to the high computational costs, most recent approaches to NAS as well as the few…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jovita Lukasik , David Friede , Heiner Stuckenschmidt , Margret Keuper

Graph autoencoders (GAEs) are powerful tools in representation learning for graph embedding. However, the performance of GAEs is very dependent on the quality of the graph structure, i.e., of the adjacency matrix. In other words, GAEs would…

Machine Learning · Computer Science 2021-03-24 Rui Zhang , Yunxing Zhang , Xuelong Li

Time-intensive performance evaluations significantly impede progress in Neural Architecture Search (NAS). To address this, neural predictors leverage surrogate models trained on proxy datasets, allowing for direct performance predictions…

Machine Learning · Computer Science 2025-09-24 Jindi Lv , Yuhao Zhou , Yuxin Tian , Qing Ye , Wentao Feng , Jiancheng Lv

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Early neural network architectures were designed by so-called "grad student descent". Since then, the field of Neural Architecture Search (NAS) has developed with the goal of algorithmically designing architectures tailored for a dataset of…

Machine Learning · Computer Science 2019-11-14 Sam Green , Craig M. Vineyard , Ryan Helinski , Çetin Kaya Koç

Neural Architecture Search (NAS) automates and prospers the design of neural networks. Estimator-based NAS has been proposed recently to model the relationship between architectures and their performance to enable scalable and flexible…

Artificial Intelligence · Computer Science 2020-09-29 Hsin-Pai Cheng , Tunhou Zhang , Yixing Zhang , Shiyu Li , Feng Liang , Feng Yan , Meng Li , Vikas Chandra , Hai Li , Yiran Chen

Neural Architecture Search (NAS) methods have shown to output networks that largely outperform human-designed networks. However, conventional NAS methods have mostly tackled the single dataset scenario, incuring in a large computational…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Sofia Casarin , Oswald Lanz , Sergio Escalera

Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods, with promising performances on challenging tasks such as link prediction and node clustering. Graph AE, VAE and most of their…

Machine Learning · Computer Science 2019-10-03 Guillaume Salha , Romain Hennequin , Michalis Vazirgiannis

Neural networks are powerful models that have a remarkable ability to extract patterns that are too complex to be noticed by humans or other machine learning models. Neural networks are the first class of models that can train end-to-end…

Machine Learning · Computer Science 2021-08-05 Ibrahim Alshubaily

Graph link prediction has long been a central problem in graph representation learning in both network analysis and generative modeling. Recent progress in deep learning has introduced increasingly sophisticated architectures for capturing…

Machine Learning · Computer Science 2025-12-02 Siddhant Karki