English
Related papers

Related papers: Probabilistic Dual Network Architecture Search on …

200 papers

Automatic methods for Neural Architecture Search (NAS) have been shown to produce state-of-the-art network models. Yet, their main drawback is the computational complexity of the search process. As some primal methods optimized over a…

Machine Learning · Statistics 2019-10-11 Asaf Noy , Niv Nayman , Tal Ridnik , Nadav Zamir , Sivan Doveh , Itamar Friedman , Raja Giryes , Lihi Zelnik-Manor

Graph Neural Networks (GNNs) have emerged as powerful tools for analyzing and learning representations from graph-structured data. A crucial prerequisite for the outstanding performance of GNNs is the availability of complete graph…

Machine Learning · Computer Science 2024-08-12 Peng Yuan , Peng Tang

In computer vision research, the process of automating architecture engineering, Neural Architecture Search (NAS), has gained substantial interest. Due to the high computational costs, most recent approaches to NAS as well as the few…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Jovita Lukasik , David Friede , Heiner Stuckenschmidt , Margret Keuper

Convolutional Neural Networks (CNN) have been regarded as a capable class of models for visual recognition problems. Nevertheless, it is not trivial to develop generic and powerful network architectures, which requires significant efforts…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Zhaofan Qiu , Ting Yao , Yiheng Zhang , Yongdong Zhang , Tao Mei

Neural Architecture Search (NAS) has recently gained increased attention, as a class of approaches that automatically searches in an input space of network architectures. A crucial part of the NAS pipeline is the encoding of the…

Machine Learning · Computer Science 2021-08-18 Michail Chatzianastasis , George Dasoulas , Georgios Siolas , Michalis Vazirgiannis

Aiming at two molecular graph datasets and one protein association subgraph dataset in OGB graph classification task, we design a graph neural network framework for graph classification task by introducing PAS(Pooling Architecture Search).…

Machine Learning · Computer Science 2022-07-14 Xu Wang , Huan Zhao , Lanning Wei , Quanming Yao

Graph NAS has emerged as a promising approach for autonomously designing GNN architectures by leveraging the correlations between graphs and architectures. Existing methods fail to generalize under distribution shifts that are ubiquitous in…

Machine Learning · Computer Science 2024-12-31 Peiwen Li , Xin Wang , Zeyang Zhang , Yijian Qin , Ziwei Zhang , Jialong Wang , Yang Li , Wenwu Zhu

We propose Efficient Neural Architecture Search (ENAS), a fast and inexpensive approach for automatic model design. In ENAS, a controller learns to discover neural network architectures by searching for an optimal subgraph within a large…

Machine Learning · Computer Science 2018-02-13 Hieu Pham , Melody Y. Guan , Barret Zoph , Quoc V. Le , Jeff Dean

Neural architecture search enables automation of architecture design. Despite its success, it is computationally costly and does not provide an insight on how to design a desirable architecture. Here we propose a new way of searching neural…

Machine Learning · Computer Science 2021-12-16 Zhenhan Huang , Chunheng Jiang , Pin-Yu Chen , Jianxi Gao

In this paper, we present a general and effective framework for Neural Architecture Search (NAS), named PredNAS. The motivation is that given a differentiable performance estimation function, we can directly optimize the architecture…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Liuchun Yuan , Zehao Huang , Naiyan Wang

There are many research works on the designing of architectures for the deep neural networks (DNN), which are named neural architecture search (NAS) methods. Although there are many automatic and manual techniques for NAS problems, there is…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Emad Malekhosseini , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

Deep learning has largely reduced the need for manual feature selection in image segmentation. Nevertheless, network architecture optimization and hyperparameter tuning are mostly manual and time consuming. Although there are increasing…

Image and Video Processing · Electrical Eng. & Systems 2019-09-16 Ken C. L. Wong , Mehdi Moradi

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Vasco Lopes , Luís A. Alexandre

Neural architecture search (NAS) aims to automate architecture design processes and improve the performance of deep neural networks. Platform-aware NAS methods consider both performance and complexity and can find well-performing…

Neural and Evolutionary Computing · Computer Science 2022-07-22 Yuhei Noda , Shota Saito , Shinichi Shirakawa

Binary Neural Networks (BNNs) have received significant attention due to their promising efficiency. Currently, most BNN studies directly adopt widely-used CNN architectures, which can be suboptimal for BNNs. This paper proposes a novel…

Artificial Intelligence · Computer Science 2021-03-30 Tianchen Zhao , Xuefei Ning , Xiangsheng Shi , Songyi Yang , Shuang Liang , Peng Lei , Jianfei Chen , Huazhong Yang , Yu Wang

Neural architecture search (NAS) methods aim to automatically find the optimal deep neural network (DNN) architecture as measured by a given objective function, typically some combination of task accuracy and inference efficiency. For many…

Machine Learning · Computer Science 2021-10-29 Ravi Krishna , Aravind Kalaiah , Bichen Wu , Maxim Naumov , Dheevatsa Mudigere , Misha Smelyanskiy , Kurt Keutzer

The deployment of Deep Neural Networks (DNNs) on edge devices is hindered by the substantial gap between performance requirements and available processing power. While recent research has made significant strides in developing pruning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Hamid Mousavi , Mohammad Loni , Mina Alibeigi , Masoud Daneshtalab

An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS). To save computational cost, most of existing NAS algorithms often train and evaluate intermediate neural…

Machine Learning · Computer Science 2021-09-27 Yixing Xu , Yunhe Wang , Kai Han , Yehui Tang , Shangling Jui , Chunjing Xu , Chang Xu

Differential Neural Architecture Search (NAS) requires all layer choices to be held in memory simultaneously; this limits the size of both search space and final architecture. In contrast, Probabilistic NAS, such as PARSEC, learns a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Zhicheng Yan , Xiaoliang Dai , Peizhao Zhang , Yuandong Tian , Bichen Wu , Matt Feiszli

In this paper, we propose Broad Neural Architecture Search (BNAS) where we elaborately design broad scalable architecture dubbed Broad Convolutional Neural Network (BCNN) to solve the above issue. On one hand, the proposed broad scalable…

Machine Learning · Statistics 2021-03-17 Zixiang Ding , Yaran Chen , Nannan Li , Dongbin Zhao , Zhiquan Sun , C. L. Philip Chen
‹ Prev 1 3 4 5 6 7 10 Next ›