English
Related papers

Related papers: Semi-Supervised Neural Architecture Search

200 papers

Point cloud architecture design has become a crucial problem for 3D deep learning. Several efforts exist to manually design architectures with high accuracy in point cloud tasks such as classification, segmentation, and detection. Recent…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Guohao Li , Mengmeng Xu , Silvio Giancola , Ali Thabet , Bernard Ghanem

This paper addresses the difficult problem of finding an optimal neural architecture design for a given image classification task. We propose a method that aggregates two main results of the previous state-of-the-art in neural architecture…

Computer Vision and Pattern Recognition · Computer Science 2018-08-02 Juan-Manuel Perez-Rua , Moez Baccouche , Stephane Pateux

Recent neural architecture search (NAS) works proposed training-free metrics to rank networks which largely reduced the search cost in NAS. In this paper, we revisit these training-free metrics and find that: (1) the number of parameters…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Taojiannan Yang , Linjie Yang , Xiaojie Jin , Chen Chen

Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiong Zhang , Hongmin Xu , Hong Mo , Jianchao Tan , Cheng Yang , Lei Wang , Wenqi Ren

GNAS (Graph Neural Architecture Search) has demonstrated great effectiveness in automatically designing the optimal graph neural architectures for multiple downstream tasks, such as node classification and link prediction. However, most…

Machine Learning · Computer Science 2024-12-04 Guanghui Zhu , Zipeng Ji , Jingyan Chen , Limin Wang , Chunfeng Yuan , Yihua Huang

Neural architecture search (NAS) and network pruning are widely studied efficient AI techniques, but not yet perfect. NAS performs exhaustive candidate architecture search, incurring tremendous search cost. Though (structured) pruning can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Yanyu Li , Pu Zhao , Geng Yuan , Xue Lin , Yanzhi Wang , Xin Chen

Neural Architecture Search (NAS) has significantly improved productivity in the design and deployment of neural networks (NN). As NAS typically evaluates multiple models by training them partially or completely, the improved productivity…

Machine Learning · Computer Science 2022-12-22 Yash Akhauri , J. Pablo Munoz , Nilesh Jain , Ravi Iyer

Automating the research for the best neural network model is a task that has gained more and more relevance in the last few years. In this context, Neural Architecture Search (NAS) represents the most effective technique whose results rival…

Machine Learning · Computer Science 2022-10-07 Andrea Falanti , Eugenio Lomurno , Stefano Samele , Danilo Ardagna , Matteo Matteucci

Recent advancements in deep convolutional neural networks have significantly improved the performance of saliency prediction. However, the manual configuration of the neural network architectures requires domain knowledge expertise and can…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Chakkrit Termritthikun , Ayaz Umer , Suwichaya Suwanwimolkul , Feng Xia , Ivan Lee

Architecture design has become a crucial component of successful deep learning. Recent progress in automatic neural architecture search (NAS) shows a lot of promise. However, discovered architectures often fail to generalize in the final…

Machine Learning · Computer Science 2020-04-03 Guohao Li , Guocheng Qian , Itzel C. Delgadillo , Matthias Müller , Ali Thabet , Bernard Ghanem

Neural Architecture Search (NAS) aims to automatically excavate the optimal network architecture with superior test performance. Recent neural architecture search (NAS) approaches rely on validation loss or accuracy to find the superior…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Joonhyun Jeong , Joonsang Yu , Geondo Park , Dongyoon Han , YoungJoon Yoo

Early methods in the rapidly developing field of neural architecture search (NAS) required fully training thousands of neural networks. To reduce this extreme computational cost, dozens of techniques have since been proposed to predict the…

Machine Learning · Computer Science 2021-10-29 Colin White , Arber Zela , Binxin Ru , Yang Liu , Frank Hutter

Neural architecture search has become an indispensable part of the deep learning field. Modern methods allow to find one of the best performing architectures, or to build one from scratch, but they typically make decisions based on the…

Machine Learning · Computer Science 2021-10-01 Ekaterina Gracheva

Neural architecture search (NAS) has attracted a lot of attention and has been illustrated to bring tangible benefits in a large number of applications in the past few years. Architecture topology and architecture size have been regarded as…

Machine Learning · Computer Science 2021-01-27 Xuanyi Dong , Lu Liu , Katarzyna Musial , Bogdan Gabrys

Neural network architectures found by sophistic search algorithms achieve strikingly good test performance, surpassing most human-crafted network models by significant margins. Although computationally efficient, their design is often very…

Machine Learning · Computer Science 2021-04-23 Kevin Alexander Laube , Andreas Zell

Architectures obtained by Neural Architecture Search (NAS) have achieved highly competitive performance in various computer vision tasks. However, the prohibitive computation demand of forward-backward propagation in deep neural networks…

Machine Learning · Computer Science 2019-08-15 Xiawu Zheng , Rongrong Ji , Lang Tang , Baochang Zhang , Jianzhuang Liu , Qi Tian

In this paper, we propose a new neural architecture search (NAS) problem of Symmetric Positive Definite (SPD) manifold networks, aiming to automate the design of SPD neural architectures. To address this problem, we first introduce a…

Machine Learning · Computer Science 2021-06-15 Rhea Sanjay Sukthanker , Zhiwu Huang , Suryansh Kumar , Erik Goron Endsjo , Yan Wu , Luc Van Gool

Recent advances in Neural Architecture Search (NAS) which extract specialized hardware-aware configurations (a.k.a. "sub-networks") from a hardware-agnostic "super-network" have become increasingly popular. While considerable effort has…

Artificial Intelligence · Computer Science 2022-03-01 Anthony Sarah , Daniel Cummings , Sharath Nittur Sridhar , Sairam Sundaresan , Maciej Szankin , Tristan Webb , J. Pablo Munoz

Designing quantum neural networks (QNNs) that are both accurate and deployable on NISQ hardware is challenging. Handcrafted ansatze must balance expressivity, trainability, and resource use, while limited qubits often necessitate circuit…

Quantum Physics · Physics 2026-04-09 Kooshan Maleki , Alberto Marchisio , Muhammad Shafique

One of the primary challenges impeding the progress of Neural Architecture Search (NAS) is its extensive reliance on exorbitant computational resources. NAS benchmarks aim to simulate runs of NAS experiments at zero cost, remediating the…

Machine Learning · Computer Science 2024-06-19 Afzal Ahmad , Linfeng Du , Zhiyao Xie , Wei Zhang