English
Related papers

Related papers: Generalized Global Ranking-Aware Neural Architectu…

200 papers

Neural architecture search (NAS) has been extensively studied in the past few years. A popular approach is to represent each neural architecture in the search space as a directed acyclic graph (DAG), and then search over all DAGs by…

Machine Learning · Computer Science 2022-06-07 Colin White , Willie Neiswanger , Sam Nolen , Yash Savani

Neural Architecture Search (NAS) is a powerful tool to automatically design deep neural networks for many tasks, including image classification. Due to the significant computational burden of the search phase, most NAS methods have focused…

Neural architecture search (NAS) has gained significant traction in automating the design of neural networks. To reduce search time, differentiable architecture search (DAS) reframes the traditional paradigm of discrete candidate sampling…

Machine Learning · Computer Science 2025-11-26 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Penghui Ruan

Neural networks are powerful models that have a remarkable ability to extract patterns that are too complex to be noticed by humans or other machine learning models. Neural networks are the first class of models that can train end-to-end…

Machine Learning · Computer Science 2021-08-05 Ibrahim Alshubaily

The emergence of neural architecture search (NAS) has greatly advanced the research on network design. Recent proposals such as gradient-based methods or one-shot approaches significantly boost the efficiency of NAS. In this paper, we…

Machine Learning · Computer Science 2019-12-09 Yizhou Zhou , Xiaoyan Sun , Chong Luo , Zheng-Jun Zha , Wenjun Zeng

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor

Recent advances in Neural Architecture Search (NAS) such as one-shot NAS offer the ability to extract specialized hardware-aware sub-network configurations from a task-specific super-network. While considerable effort has been employed…

Machine Learning · Computer Science 2022-05-24 Daniel Cummings , Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Juan Pablo Munoz , Sairam Sundaresan

In neural architecture search (NAS), the space of neural network architectures is automatically explored to maximize predictive accuracy for a given task. Despite the success of recent approaches, most existing methods cannot be directly…

Machine Learning · Statistics 2019-02-15 Francesco Paolo Casale , Jonathan Gordon , Nicolo Fusi

Typically, deep learning architectures are handcrafted for their respective learning problem. As an alternative, neural architecture search (NAS) has been proposed where the architecture's structure is learned in an additional optimization…

Image and Video Processing · Electrical Eng. & Systems 2019-07-29 Nils Gessert , Alexander Schlaefer

We present the first differentiable Network Architecture Search (NAS) for Graph Neural Networks (GNNs). GNNs show promising performance on a wide range of tasks, but require a large amount of architecture engineering. First, graphs are…

Machine Learning · Computer Science 2020-03-24 Yiren Zhao , Duo Wang , Xitong Gao , Robert Mullins , Pietro Lio , Mateja Jamnik

In prediction-based Neural Architecture Search (NAS), performance indicators derived from graph convolutional networks have shown remarkable success. These indicators, achieved by representing feed-forward structures as component graphs…

Machine Learning · Computer Science 2023-09-25 Minh Le , Nhan Nguyen , Ngoc Hoang Luong

Differentiable Architecture Search (DARTS) has received massive attention in recent years, mainly because it significantly reduces the computational cost through weight sharing and continuous relaxation. However, more recent works find that…

Machine Learning · Computer Science 2021-11-29 Miao Zhang , Jilin Hu , Steven Su , Shirui Pan , Xiaojun Chang , Bin Yang , Gholamreza Haffari

How to benefit from plenty of existing denoising designs? Few methods via Neural Architecture Search (NAS) intend to answer this question. However, these NAS-based denoising methods explore limited search space and are hard to extend in…

Image and Video Processing · Electrical Eng. & Systems 2025-02-20 Zheyu Zhang , Yueyi Zhang , Xiaoyan sun

Neural architecture search (NAS) with an accuracy predictor that predicts the accuracy of candidate architectures has drawn increasing attention due to its simplicity and effectiveness. Previous works usually employ neural network-based…

Machine Learning · Computer Science 2021-07-20 Renqian Luo , Xu Tan , Rui Wang , Tao Qin , Enhong Chen , Tie-Yan Liu

The standard paradigm in Neural Architecture Search (NAS) is to search for a fully deterministic architecture with specific operations and connections. In this work, we instead propose to search for the optimal operation distribution, thus…

Machine Learning · Computer Science 2021-11-09 Xingchen Wan , Binxin Ru , Pedro M. Esperança , Fabio M. Carlucci

Neural predictors are effective in boosting the time-consuming performance evaluation stage in neural architecture search (NAS), owing to their direct estimation of unseen architectures. Despite the effectiveness, training a powerful neural…

Machine Learning · Computer Science 2024-06-05 Han Ji , Yuqi Feng , Yanan Sun

This paper proposes a novel differentiable architecture search method by formulating it into a distribution learning problem. We treat the continuously relaxed architecture mixing weight as random variables, modeled by Dirichlet…

Machine Learning · Computer Science 2021-03-17 Xiangning Chen , Ruochen Wang , Minhao Cheng , Xiaocheng Tang , Cho-Jui Hsieh

We present a neural architecture search (NAS) technique to enhance the performance of unsupervised image de-noising, in-painting and super-resolution under the recently proposed Deep Image Prior (DIP). We show that evolutionary search can…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Kary Ho , Andrew Gilbert , Hailin Jin , John Collomosse

The neural architecture search (NAS) algorithm with reinforcement learning can be a powerful and novel framework for the automatic discovering process of neural architectures. However, its application is restricted by noncontinuous and…

Machine Learning · Computer Science 2020-03-27 Chun-Ting Liu

This paper studies the neural architecture search (NAS) problem for developing efficient generator networks. Compared with deep models for visual recognition tasks, generative adversarial network (GAN) are usually designed to conduct…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Jiahao Wang , Han Shu , Weihao Xia , Yujiu Yang , Yunhe Wang