English
Related papers

Related papers: EmProx: Neural Network Performance Estimation For …

200 papers

Neural Architecture Search (NAS) has recently gained increased attention, as a class of approaches that automatically searches in an input space of network architectures. A crucial part of the NAS pipeline is the encoding of the…

Machine Learning · Computer Science 2021-08-18 Michail Chatzianastasis , George Dasoulas , Georgios Siolas , Michalis Vazirgiannis

Reliable yet efficient evaluation of generalisation performance of a proposed architecture is crucial to the success of neural architecture search (NAS). Traditional approaches face a variety of limitations: training each architecture to…

Machine Learning · Statistics 2021-06-09 Binxin Ru , Clare Lyle , Lisa Schut , Miroslav Fil , Mark van der Wilk , Yarin Gal

Recent studies on automatic neural architectures search have demonstrated significant performance, competitive to or even better than hand-crafted neural architectures. However, most of the existing network architecture tend to use…

Machine Learning · Computer Science 2020-06-12 Peiye Liu , Bo Wu , Huadong Ma , Mingoo Seok

Neural Architecture Search (NAS) aims to facilitate the design of deep networks for new tasks. Existing techniques rely on two stages: searching over the architecture space and validating the best architecture. NAS algorithms are currently…

Machine Learning · Computer Science 2019-11-25 Kaicheng Yu , Christian Sciuto , Martin Jaggi , Claudiu Musat , Mathieu Salzmann

Node embedding methods find latent lower-dimensional representations which are used as features in machine learning models. In the last few years, these methods have become extremely popular as a replacement for manual feature engineering.…

Social and Information Networks · Computer Science 2020-06-01 Christoph Martin , Meike Riebeling

This paper addresses the efficiency challenge of Neural Architecture Search (NAS) by formulating the task as a ranking problem. Previous methods require numerous training examples to estimate the accurate performance of architectures,…

Computation and Language · Computer Science 2021-09-20 Chi Hu , Chenglong Wang , Xiangnan Ma , Xia Meng , Yinqiao Li , Tong Xiao , Jingbo Zhu , Changliang Li

Predictor-based algorithms have achieved remarkable performance in the Neural Architecture Search (NAS) tasks. However, these methods suffer from high computation costs, as training the performance predictor usually requires training and…

Machine Learning · Computer Science 2021-08-19 Ruochen Wang , Xiangning Chen , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

Prediction-based approaches are widely used in neural architecture search (NAS), where a predictor estimates the performance of candidate architectures to guide selection. However, existing predictors are typically trained via supervised…

Machine Learning · Computer Science 2026-05-12 Liping Deng , MingQing Xiao

The automation of feature extraction of machine learning has been successfully realized by the explosive development of deep learning. However, the structures and hyperparameters of deep neural network architectures also make huge…

Machine Learning · Computer Science 2024-10-01 Wenzhu Shao

We propose a new method for learning the structure of convolutional neural networks (CNNs) that is more efficient than recent state-of-the-art methods based on reinforcement learning and evolutionary algorithms. Our approach uses a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Chenxi Liu , Barret Zoph , Maxim Neumann , Jonathon Shlens , Wei Hua , Li-Jia Li , Li Fei-Fei , Alan Yuille , Jonathan Huang , Kevin Murphy

Neural Architecture Search (NAS) automates and prospers the design of neural networks. Estimator-based NAS has been proposed recently to model the relationship between architectures and their performance to enable scalable and flexible…

Artificial Intelligence · Computer Science 2020-09-29 Hsin-Pai Cheng , Tunhou Zhang , Yixing Zhang , Shiyu Li , Feng Liang , Feng Yan , Meng Li , Vikas Chandra , Hai Li , Yiran Chen

Much of the recent improvement in neural networks for computer vision has resulted from discovery of new networks architectures. Most prior work has used the performance of candidate models following limited training to automatically guide…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Pouya Bashivan , Mark Tensen , James J DiCarlo

Methods for neural network hyperparameter optimization and meta-modeling are computationally expensive due to the need to train a large number of model configurations. In this paper, we show that standard frequentist regression models can…

Machine Learning · Computer Science 2017-11-09 Bowen Baker , Otkrist Gupta , Ramesh Raskar , Nikhil Naik

Neural network (NN) models are increasingly used in scientific simulations, AI, and other high performance computing (HPC) fields to extract knowledge from datasets. Each dataset requires tailored NN model architecture, but designing…

Machine Learning · Computer Science 2021-08-12 Ariel Keller Rorabaugh , Silvina Caíno-Lores , Michael R. Wyatt , Travis Johnston , Michela Taufer

Deep neural networks have brought significant advancements to speech emotion recognition (SER). However, the architecture design in SER is mainly based on expert knowledge and empirical (trial-and-error) evaluations, which is time-consuming…

Sound · Computer Science 2022-04-01 Xixin Wu , Shoukang Hu , Zhiyong Wu , Xunying Liu , Helen Meng

Neural architecture search (NAS) aims to automatically design deep neural networks of satisfactory performance. Wherein, architecture performance predictor is critical to efficiently value an intermediate neural architecture. But for the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Yehui Tang , Yunhe Wang , Yixing Xu , Hanting Chen , Chunjing Xu , Boxin Shi , Chao Xu , Qi Tian , Chang Xu

In recent years, deep neural networks have had great success in machine learning and pattern recognition. Architecture size for a neural network contributes significantly to the success of any neural network. In this study, we optimize the…

Machine Learning · Computer Science 2021-01-19 Yigit Alparslan , Ethan Jacob Moyer , Isamu Mclean Isozaki , Daniel Schwartz , Adam Dunlop , Shesh Dave , Edward Kim

Neural Architecture Search aims at automatically finding neural architectures that are competitive with architectures designed by human experts. While recent approaches have achieved state-of-the-art predictive performance for image…

Machine Learning · Statistics 2019-02-27 Thomas Elsken , Jan Hendrik Metzen , Frank Hutter

Link prediction is the task of predicting missing connections between entities in the knowledge graph (KG). While various forms of models are proposed for the link prediction task, most of them are designed based on a few known relation…

Computation and Language · Computer Science 2020-08-19 Xiaoyu Kou , Bingfeng Luo , Huang Hu , Yan Zhang

Evolutionary Neural Architecture Search (ENAS) can automatically design the architectures of Deep Neural Networks (DNNs) using evolutionary computation algorithms. However, most ENAS algorithms require intensive computational resource,…

Machine Learning · Computer Science 2020-09-08 Yanan Sun , Xian Sun , Yuhan Fang , Gary Yen